-- Logs begin at Thu 2021-06-03 07:36:40 UTC, end at Thu 2021-06-03 08:50:44 UTC. --
Jun 03 08:22:15.637249 dv-cinder-787262-5-iscsi systemd[1]: Started Devstack devstack@q-svc.service.
Jun 03 08:22:16.600919 dv-cinder-787262-5-iscsi neutron-server[92216]: Beware of the coming changes in the project packaging
Jun 03 08:22:16.601522 dv-cinder-787262-5-iscsi neutron-server[92216]: https://github.com/svinota/pyroute2/discussions/786
Jun 03 08:22:18.072858 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.common.config [-] Logging enabled!
Jun 03 08:22:18.073521 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev251
Jun 03 08:22:18.073612 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=92216) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
Jun 03 08:22:18.076739 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.common.config [-] Logging enabled!
Jun 03 08:22:18.076995 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev251
Jun 03 08:22:18.077303 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=92216) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
Jun 03 08:22:18.078229 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jun 03 08:22:18.078459 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jun 03 08:22:18.078839 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jun 03 08:22:18.079084 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jun 03 08:22:18.079308 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jun 03 08:22:18.079620 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] allow_bulk                     = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.079912 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] allow_overlapping_ips          = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.080203 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] api_extensions_path            =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.080428 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] api_paste_config               = api-paste.ini {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.080716 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] api_workers                    = 2 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.080999 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] auth_strategy                  = keystone {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.081278 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] backlog                        = 4096 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.081561 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.081849 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] bind_host                      = 0.0.0.0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.082129 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] bind_port                      = 9696 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.082402 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] client_socket_timeout          = 900 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.082706 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] config_dir                     = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.082933 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.083206 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] config_source                  = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.083487 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] control_exchange               = neutron {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.083766 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] core_plugin                    = ml2 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.083985 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] debug                          = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.084264 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] default_availability_zones     = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.084831 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.085155 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] dhcp_agent_notification        = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.085432 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] dhcp_lease_duration            = 86400 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.085717 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] dns_domain                     = openstacklocal {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.085993 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] enable_traditional_dhcp        = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.086259 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] external_dns_driver            = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.087172 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] filter_validation              = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.087463 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] global_physnet_mtu             = 1500 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.087860 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] host                           = dv-cinder-787262-5-iscsi {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.088140 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] http_retries                   = 3 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.088428 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] instance_format                = [instance: %(uuid)s]  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.088715 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.089001 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ipam_driver                    = internal {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.089271 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ipv6_pd_enabled                = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.089545 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] log_config_append              = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.089830 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.090100 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] log_dir                        = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.090369 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] log_file                       = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.090671 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] log_rotate_interval            = 1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.090957 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] log_rotate_interval_type       = days {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.091240 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] log_rotation_type              = none {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.091530 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.091752 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.091972 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.092256 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.092541 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.092816 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] max_dns_nameservers            = 5 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.093094 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] max_header_line                = 16384 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.093366 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] max_logfile_count              = 30 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.093641 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] max_logfile_size_mb            = 200 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.093914 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] max_subnet_host_routes         = 20 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.094179 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] network_link_prefix            = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.094461 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.094774 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.095055 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] pagination_max_limit           = -1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.095325 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] periodic_fuzzy_delay           = 5 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.095596 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] periodic_interval              = 40 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.095863 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] publish_errors                 = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.096133 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] rate_limit_burst               = 0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.096413 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] rate_limit_except_level        = CRITICAL {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.096683 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] rate_limit_interval            = 0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.096949 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] retry_until_window             = 30 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.097218 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] rpc_response_max_timeout       = 600 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.097498 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] rpc_state_report_workers       = 0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.097766 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] rpc_workers                    = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.098035 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] send_events_interval           = 2 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.098329 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.098730 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] setproctitle                   = on {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.098993 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] state_path                     = /opt/stack/data/neutron {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.099276 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] syslog_log_facility            = LOG_USER {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.099548 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] tcp_keepidle                   = 600 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.099829 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] transport_url                  = **** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.100097 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] use_eventlog                   = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.100365 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] use_journal                    = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.100631 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] use_json                       = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.100897 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] use_ssl                        = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.101161 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] use_stderr                     = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.101436 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] use_syslog                     = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.101702 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] vlan_transparent               = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.101968 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] watch_log_file                 = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.103547 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] wsgi_default_pool_size         = 100 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.103828 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] wsgi_keep_alive                = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.104120 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:18.104423 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.104724 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.105136 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] profiler.connection_string     = messaging:// {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.105425 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] profiler.enabled               = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.105723 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] profiler.es_doc_type           = notification {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.106004 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] profiler.es_scroll_size        = 10000 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.106292 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] profiler.es_scroll_time        = 2m {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.106596 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] profiler.filter_error_trace    = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.106889 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] profiler.hmac_keys             = SECRET_KEY {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.107177 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.107471 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] profiler.socket_timeout        = 0.1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.107749 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy      = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.108033 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.108305 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope      = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.108604 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.108907 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.109200 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.109489 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.109761 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.110037 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.110306 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.110673 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.110960 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] nova.auth_section              = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.111251 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] nova.auth_type                 = password {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.111540 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.111809 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] nova.certfile                  = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.112084 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] nova.collect_timing            = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.112370 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] nova.endpoint_type             = public {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.112646 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] nova.insecure                  = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.112915 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] nova.keyfile                   = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.113187 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] nova.live_migration_events     = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.113474 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] nova.region_name               = RegionOne {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.113742 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] nova.split_loggers             = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.114013 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] nova.timeout                   = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.114291 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] placement.auth_section         = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.114616 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] placement.auth_type            = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.114951 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] placement.cafile               = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.115224 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] placement.certfile             = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.115500 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] placement.collect_timing       = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.115789 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] placement.endpoint_type        = public {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.116062 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] placement.insecure             = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.116329 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] placement.keyfile              = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.116598 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] placement.region_name          = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.116872 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] placement.split_loggers        = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.117142 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] placement.timeout              = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.117422 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.auth_section            = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.117758 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.auth_type               = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.118052 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.cafile                  = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.118320 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.certfile                = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.118632 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.collect_timing          = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.118913 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.connect_retries         = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.119185 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.connect_retry_delay     = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.119460 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.enable_notifications    = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.119729 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.endpoint_override       = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.120004 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.insecure                = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.120274 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.interface               = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.120544 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.keyfile                 = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.120818 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.max_version             = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.121087 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.min_version             = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.121355 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.region_name             = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.121623 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.service_name            = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.121890 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.service_type            = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.122159 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.split_loggers           = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.122428 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.status_code_retries     = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.122719 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.122992 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.timeout                 = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.123266 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.valid_interfaces        = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.123532 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ironic.version                 = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.123810 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.124107 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.124382 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.124663 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.124947 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.125225 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.125499 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.125773 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.126049 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.126327 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.126626 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.126919 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.127203 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.127488 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.127768 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.128047 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.128340 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.128619 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.128902 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.129179 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.129456 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.129744 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.130023 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl      = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.130315 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.130729 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.131008 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.131305 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.131598 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.131881 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.132190 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.132471 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:18.132689 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jun 03 08:22:18.132932 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=92216) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}}
Jun 03 08:22:18.485100 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=92216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:22:18.485282 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=92216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:22:18.485570 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=92216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:22:18.485896 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.manager [-] Loading core plugin: ml2
Jun 03 08:22:18.880346 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:18.880630 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:18.880902 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:18.882195 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:18.882469 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:18.882758 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:18.918263 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:18.918561 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:18.918839 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:18.931902 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:18.932248 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:18.932520 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:18.962052 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:18.962328 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:18.962622 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:18.999004 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:18.999282 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:18.999549 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.231999 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7fae88600a60> agent after_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.232604 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7fae88600a60> agent after_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.232604 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _add_segment_host_mapping_for_segment at 0x7fae886adc10> segment precommit_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.232774 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _delete_segments_for_network at 0x7fae886adee0> network precommit_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.233445 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _prevent_segment_delete_with_port_bound at 0x7fae886bb0d0> segment before_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.357971 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._before_network_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> network before_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.358287 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function DVRDbMixin._delete_mac_associated_with_agent at 0x7fae88690700> agent before_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.358594 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_net of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> network before_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.358870 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> port before_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.359138 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> port before_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.359447 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> segment precommit_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.359706 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> segment precommit_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.359961 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> segment after_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.360214 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> segment after_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.360492 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> network after_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.360746 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> network precommit_delete 0 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.361008 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._port_provisioned of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> port provisioning_complete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.361269 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_create of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> rbac-policy before_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.361522 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_delete of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> rbac-policy after_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.361797 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._retry_binding_revived_agents of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> agent after_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.362068 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> subnet after_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.362324 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> subnet precommit_delete 0 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.362616 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> rbac-policy before_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.362869 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> rbac-policy before_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.363148 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> segment_host_mapping after_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.363493 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> port after_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.363743 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> port after_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.363991 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> port after_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.364269 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> rbac-policy before_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.364517 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> rbac-policy before_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.364764 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fae88e82ca0>> rbac-policy before_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.365138 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=92216) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 03 08:22:19.365375 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=92216) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 03 08:22:19.365610 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=92216) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 03 08:22:19.365841 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=92216) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 03 08:22:19.366070 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=92216) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 03 08:22:19.366298 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=92216) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 03 08:22:19.366685 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve']
Jun 03 08:22:19.369901 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1']
Jun 03 08:22:19.373768 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete
Jun 03 08:22:19.377502 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(500, 549)])])
Jun 03 08:22:19.379288 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']
Jun 03 08:22:19.379735 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'])
Jun 03 08:22:19.380068 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan']
Jun 03 08:22:19.380447 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security']
Jun 03 08:22:19.383754 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security']
Jun 03 08:22:19.384003 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security']
Jun 03 08:22:19.384405 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv']
Jun 03 08:22:19.411654 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa']
Jun 03 08:22:19.412097 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.qos.drivers.openvswitch.driver.OVSDriver object at 0x7fae8844ef40>> qos_plugin after_init 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.412392 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=92216) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}}
Jun 03 08:22:19.412752 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.logapi.drivers.openvswitch.driver.OVSDriver object at 0x7fae8844ea60>> logging-plugin after_init 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.414088 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=92216) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}}
Jun 03 08:22:19.414369 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv']
Jun 03 08:22:19.414679 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv']
Jun 03 08:22:19.418278 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7fae8844e2b0>> floatingip before_response 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.418587 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7fae8844e2b0>> port before_response 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:19.482546 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat'
Jun 03 08:22:19.482743 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete
Jun 03 08:22:19.482978 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve'
Jun 03 08:22:19.483342 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)]
Jun 03 08:22:19.513062 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_db.sqlalchemy.engines [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 03 08:22:20.036403 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.managers [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Initializing driver for type 'gre'
Jun 03 08:22:20.036929 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] gre ID ranges: [(1, 1000)]
Jun 03 08:22:20.287564 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.managers [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Initializing driver for type 'local'
Jun 03 08:22:20.288111 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.managers [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Initializing driver for type 'vlan'
Jun 03 08:22:20.385184 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] VlanTypeDriver initialization complete
Jun 03 08:22:20.386528 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.managers [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Initializing driver for type 'vxlan'
Jun 03 08:22:20.388516 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] vxlan ID ranges: [(1, 1000)]
Jun 03 08:22:20.647612 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.managers [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Initializing extension driver 'port_security'
Jun 03 08:22:20.647889 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.extensions.port_security [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] PortSecurityExtensionDriver initialization complete
Jun 03 08:22:20.648221 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.managers [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Initializing mechanism driver 'openvswitch'
Jun 03 08:22:20.648560 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.managers [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Initializing mechanism driver 'hyperv'
Jun 03 08:22:20.656545 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.plugins.ml2.plugin [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=92216) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:22:20.657316 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fae8835cd90>> port after_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.657693 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fae8835cd90>> port after_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.658052 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fae8835cd90>> port after_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.658440 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fae883e4b50>> subnet after_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.658868 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fae883e4b50>> subnet after_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.659279 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fae883e4b50>> subnet after_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.659689 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fae87f119a0>> network after_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.660045 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fae87f119a0>> network after_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.660398 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fae87f119a0>> network after_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.660782 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fae87f11c40>> security_group after_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.661136 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fae87f11c40>> security_group after_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.661480 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fae87f11c40>> security_group after_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.661858 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fae87f11eb0>> security_group_rule after_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.662204 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fae87f11eb0>> security_group_rule after_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.662573 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fae87f11eb0>> security_group_rule after_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.665124 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fae87f11f40>> address_group after_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.665124 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fae87f11f40>> address_group after_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.665124 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fae87f11f40>> address_group after_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.665124 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] ML2 OVO RPC backend initialized. {{(pid=92216) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:160}}
Jun 03 08:22:20.665697 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_created of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fae87f17520>> router_interface after_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.665697 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_deleted of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fae87f17520>> router_interface after_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.666125 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fae87f17520>> network before_response 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.666546 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fae87f17520>> networks before_response 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.666965 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fae87f17520>> port before_response 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.667354 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fae87f17520>> ports before_response 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.667698 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fae87f17520>> subnet before_response 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.668052 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fae87f17520>> subnets before_response 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.668387 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fae87f17520>> network after_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.668724 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fae87f17520>> network after_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.669064 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fae87f17520>> network after_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.669401 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fae87f17520>> port after_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.669736 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fae87f17520>> port after_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.670069 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fae87f17520>> port after_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.670404 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fae87f17520>> subnet after_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.670765 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fae87f17520>> subnet after_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.671102 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fae87f17520>> subnet after_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.671673 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.plugin [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Modular L2 Plugin initialization complete
Jun 03 08:22:20.671997 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading services supported by the core plugin {{(pid=92216) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}}
Jun 03 08:22:20.672320 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.plugins.ml2.managers [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Got port-security extension from driver 'port_security'
Jun 03 08:22:20.672773 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.extensions.vlantransparent [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Disabled vlantransparent extension.
Jun 03 08:22:20.673253 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=92216) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}}
Jun 03 08:22:20.673561 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading Plugin: router
Jun 03 08:22:20.712669 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DVRResourceOperationHandler._add_csnat_on_interface_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fae87f17640>> router_interface before_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.713068 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method L3_HA_NAT_db_mixin._after_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fae87f17640>> router after_create 55549900 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.713439 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method L3_HA_NAT_db_mixin._before_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fae87f17640>> router before_create 55549900 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.713807 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fae87f17640>> router_interface before_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.714179 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DVRResourceOperationHandler._cleanup_after_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fae87f17640>> router_interface after_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.714556 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method L3_HA_NAT_db_mixin._cleanup_ha_network of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fae87f17640>> router after_delete 55549900 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.714920 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DVRResourceOperationHandler._create_dvr_floating_gw_port of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fae87f17640>> floatingip after_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.715291 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fae87f17640>> router after_create 55549900 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.715640 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fae87f17640>> router after_update 55549900 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.715992 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DVRResourceOperationHandler._delete_distributed_port_bindings_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fae87f17640>> router after_update 55549900 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.716342 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DVRResourceOperationHandler._delete_dvr_internal_ports of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fae87f17640>> router_gateway after_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.716701 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DVRResourceOperationHandler._delete_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fae87f17640>> router after_update 55549900 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.717114 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DVRResourceOperationHandler._handle_distributed_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fae87f17640>> router precommit_update 55549900 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.717483 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <function L3RpcNotifierMixin._notify_gateway_port_ip_changed at 0x7fae8863b430> port after_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.717825 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <function L3RpcNotifierMixin._notify_routers_callback at 0x7fae8863b310> port after_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.718162 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <function L3RpcNotifierMixin._notify_subnet_gateway_ip_update at 0x7fae8863b3a0> subnet after_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.718515 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <function L3RpcNotifierMixin._notify_subnetpool_address_scope_update at 0x7fae8863b4c0> subnetpool_address_scope after_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.718882 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method L3_NAT_dbonly_mixin._precommit_delete_port_callback of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fae87f17640>> port precommit_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.719232 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method L3_HA_NAT_db_mixin._precommit_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fae87f17640>> router precommit_create 55549900 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.719576 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback at 0x7fae88620d30> port before_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.719921 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method RouterAvailabilityZoneMixin._process_az_request of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fae87f17640>> router precommit_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.720278 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method L3_HA_NAT_db_mixin._reconfigure_ha_resources of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fae87f17640>> router after_update 55549900 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.720620 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method L3_HA_NAT_db_mixin._release_router_vr_id of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fae87f17640>> router precommit_delete 55549900 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.720971 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DVRResourceOperationHandler._set_distributed_flag of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fae87f17640>> router precommit_create 55549900 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.721334 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fae87f17640>> router_interface after_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.721681 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method L3_HA_NAT_db_mixin._validate_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fae87f17640>> router precommit_update 55549900 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.722055 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fae87f17640>> network after_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.722944 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Tracking information for resource: router configured {{(pid=92216) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 03 08:22:20.723281 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Tracking information for resource: floatingip configured {{(pid=92216) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 03 08:22:20.728686 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.db.l3_agentschedulers_db [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Skipping period L3 agent status check because automatic router rescheduling is disabled.
Jun 03 08:22:20.729266 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <function _notify_l3_agent_port_update at 0x7fae87ecb700> port after_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.729627 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <function _notify_l3_agent_new_port at 0x7fae87ecb5e0> port after_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.729982 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <function _notify_port_delete at 0x7fae87ecb670> port after_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.730333 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <function _notify_l3_agent_ha_port_update at 0x7fae87ecb9d0> port after_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.731146 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DriverController._check_router_request of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fae87ee9e50>> router before_create 55550100 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.731511 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DriverController._clear_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fae87ee9e50>> router precommit_delete 55550100 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.731872 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DriverController._set_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fae87ee9e50>> router precommit_create 55550100 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.732232 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method DriverController._update_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fae87ee9e50>> router precommit_update 55550100 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.736645 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.services.provider_configuration [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Service providers = [] {{(pid=92216) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}}
Jun 03 08:22:20.737018 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.db.servicetype_db [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=92216) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}}
Jun 03 08:22:20.740094 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.services.service_base [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=92216) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 03 08:22:20.740446 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.services.service_base [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=92216) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 03 08:22:20.740789 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.services.service_base [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=92216) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 03 08:22:20.741672 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.services.service_base [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=92216) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 03 08:22:20.742043 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.services.service_base [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Default provider is not specified for service type L3_ROUTER_NAT
Jun 03 08:22:20.742422 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=92216) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 03 08:22:20.743302 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin
Jun 03 08:22:20.753601 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Successfully loaded METERING plugin. Description: METERING {{(pid=92216) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 03 08:22:20.753940 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading Plugin: auto_allocate
Jun 03 08:22:20.760646 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7fae87e92ca0> network precommit_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.761013 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7fae87e92ca0> network precommit_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.761536 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=92216) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 03 08:22:20.761860 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading Plugin: tag
Jun 03 08:22:20.768600 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=92216) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 03 08:22:20.768930 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading Plugin: timestamp
Jun 03 08:22:20.772704 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=92216) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 03 08:22:20.773038 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading Plugin: network_ip_availability
Jun 03 08:22:20.779293 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fae87ea5e50>> rbac-policy before_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.779667 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fae87ea5e50>> rbac-policy before_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.780029 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fae87ea5e50>> rbac-policy before_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:20.780748 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=92216) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 03 08:22:20.781071 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading Plugin: flavors
Jun 03 08:22:20.785937 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=92216) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 03 08:22:20.786272 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading Plugin: revisions
Jun 03 08:22:20.791060 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=92216) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 03 08:22:20.791452 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_concurrency.lockutils [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 2.306s {{(pid=92216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:22:20.792180 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=92216) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}}
Jun 03 08:22:20.792520 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Initializing extension manager.
Jun 03 08:22:20.793024 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: __init__.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.793367 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: __pycache__ {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.793704 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.794040 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: address_group.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.794813 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.802606 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: address-group
Jun 03 08:22:20.802606 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: address_scope.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.802606 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.802606 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: address-scope
Jun 03 08:22:20.802606 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: admin_state_down_before_update.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.803130 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.803656 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: router-admin-state-down-before-update
Jun 03 08:22:20.803982 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: agent.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.804687 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.805691 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: agent
Jun 03 08:22:20.806028 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: agent_resources_synced.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.806975 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.807491 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: agent-resources-synced
Jun 03 08:22:20.807819 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: allowedaddresspairs.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.809596 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.810123 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: allowed-address-pairs
Jun 03 08:22:20.810452 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: auto_allocated_topology.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.811559 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.812072 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: auto-allocated-topology
Jun 03 08:22:20.812454 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: availability_zone.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.813138 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.813649 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: availability_zone
Jun 03 08:22:20.813972 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: availability_zone_filter.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.814907 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.815418 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: availability_zone_filter
Jun 03 08:22:20.815743 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: data_plane_status.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.816635 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.817137 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension data-plane-status not supported by any of loaded plugins
Jun 03 08:22:20.817491 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: default_subnetpools.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.818400 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.818936 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: default-subnetpools
Jun 03 08:22:20.819261 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: dhcpagentscheduler.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.820326 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.821880 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: dhcp_agent_scheduler
Jun 03 08:22:20.822233 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: dns.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.823167 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.823678 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension dns-integration not supported by any of loaded plugins
Jun 03 08:22:20.824046 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: dns_domain_ports.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.824950 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.825462 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension dns-domain-ports not supported by any of loaded plugins
Jun 03 08:22:20.825788 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: dvr.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.826456 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.826994 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: dvr
Jun 03 08:22:20.827319 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: empty_string_filtering.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.828215 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.828729 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: empty-string-filtering
Jun 03 08:22:20.829057 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.833030 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.833538 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins
Jun 03 08:22:20.833861 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.834792 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.835306 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins
Jun 03 08:22:20.835631 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: external_net.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.837579 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.838098 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: external-net
Jun 03 08:22:20.838426 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: extra_dhcp_opt.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.839359 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.839873 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: extra_dhcp_opt
Jun 03 08:22:20.840197 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: extraroute.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.841097 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.841606 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: extraroute
Jun 03 08:22:20.841932 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: extraroute_atomic.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.842976 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.843491 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: extraroute-atomic
Jun 03 08:22:20.843816 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: filter_validation.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.844669 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.845186 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: filter-validation
Jun 03 08:22:20.845511 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: fip_pf_description.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.846443 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.846939 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins
Jun 03 08:22:20.847263 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: fip_port_details.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.848165 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.848674 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: fip-port-details
Jun 03 08:22:20.848998 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: flavors.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.850211 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.850755 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: flavors
Jun 03 08:22:20.851082 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.853244 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.853773 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins
Jun 03 08:22:20.854107 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: floatingip_pools.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.854821 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.855346 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: floatingip-pools
Jun 03 08:22:20.855674 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: ip_allocation.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.856581 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.857090 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension ip_allocation not supported by any of loaded plugins
Jun 03 08:22:20.857414 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: ip_substring_port_filtering.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.858320 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.858868 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: ip-substring-filtering
Jun 03 08:22:20.859194 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: l2_adjacency.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.860113 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.860619 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension l2_adjacency not supported by any of loaded plugins
Jun 03 08:22:20.860941 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: l3.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.861902 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.862419 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: router
Jun 03 08:22:20.862770 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: l3_conntrack_helper.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.864990 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.865521 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension l3-conntrack-helper not supported by any of loaded plugins
Jun 03 08:22:20.865853 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: l3_ext_gw_mode.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.866810 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.867338 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: ext-gw-mode
Jun 03 08:22:20.868196 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: l3_ext_ha_mode.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.869116 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.869637 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: l3-ha
Jun 03 08:22:20.869973 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: l3_flavors.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.870897 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.871418 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: l3-flavors
Jun 03 08:22:20.871745 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.872662 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.873175 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: l3-port-ip-change-not-allowed
Jun 03 08:22:20.873500 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: l3agentscheduler.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.874574 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.875139 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: l3_agent_scheduler
Jun 03 08:22:20.875471 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: logging.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.876941 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.877466 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension logging not supported by any of loaded plugins
Jun 03 08:22:20.877799 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: metering.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.878562 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.879147 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: metering
Jun 03 08:22:20.879476 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.880675 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.881197 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: metering_source_and_destination_fields
Jun 03 08:22:20.881525 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: multiprovidernet.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.885014 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.885534 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: multi-provider
Jun 03 08:22:20.885863 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: netmtu.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.886804 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.887321 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: net-mtu
Jun 03 08:22:20.887651 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: netmtu_writable.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.888554 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.889065 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: net-mtu-writable
Jun 03 08:22:20.889389 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: network_availability_zone.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.890050 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.890592 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: network_availability_zone
Jun 03 08:22:20.890919 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: network_ip_availability.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.892004 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.892529 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: network-ip-availability
Jun 03 08:22:20.892856 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: network_segment_range.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.893608 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.894119 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension network-segment-range not supported by any of loaded plugins
Jun 03 08:22:20.894441 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: pagination.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.895425 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.895759 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: pagination
Jun 03 08:22:20.896076 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: port_device_profile.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.896976 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.897499 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: port-device-profile
Jun 03 08:22:20.897867 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: port_mac_address_regenerate.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.898785 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.900298 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: port-mac-address-regenerate
Jun 03 08:22:20.900623 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: port_numa_affinity_policy.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.901534 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.902050 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: port-numa-affinity-policy
Jun 03 08:22:20.902373 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: port_resource_request.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.903326 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.903884 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension port-resource-request not supported by any of loaded plugins
Jun 03 08:22:20.904204 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: portbindings.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.905126 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.905636 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: binding
Jun 03 08:22:20.905957 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: portbindings_extended.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.907248 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.907776 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: binding-extended
Jun 03 08:22:20.908110 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: portsecurity.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.916128 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.916643 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: port-security
Jun 03 08:22:20.916970 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: project_id.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.917938 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.918268 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: project-id
Jun 03 08:22:20.918632 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: providernet.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.919537 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.920056 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: provider
Jun 03 08:22:20.920379 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: qos.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.923895 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.924424 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension qos not supported by any of loaded plugins
Jun 03 08:22:20.924766 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: qos_bw_limit_direction.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.925993 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.926591 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension qos-bw-limit-direction not supported by any of loaded plugins
Jun 03 08:22:20.926921 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.927839 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.928360 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins
Jun 03 08:22:20.928686 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: qos_default.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.929581 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.930637 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension qos-default not supported by any of loaded plugins
Jun 03 08:22:20.930980 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: qos_fip.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.931633 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.932150 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension qos-fip not supported by any of loaded plugins
Jun 03 08:22:20.932475 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: qos_gateway_ip.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.933387 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.933900 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension qos-gateway-ip not supported by any of loaded plugins
Jun 03 08:22:20.934225 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: qos_port_network_policy.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.935161 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.935677 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension qos-port-network-policy not supported by any of loaded plugins
Jun 03 08:22:20.936000 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: qos_rule_type_details.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.936901 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.937413 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension qos-rule-type-details not supported by any of loaded plugins
Jun 03 08:22:20.937733 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: qos_rules_alias.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.938798 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.939309 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension qos-rules-alias not supported by any of loaded plugins
Jun 03 08:22:20.939633 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: quotasv2.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.940650 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.940976 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: quotas
Jun 03 08:22:20.941296 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: quotasv2_detail.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.942909 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.943251 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: quota_details
Jun 03 08:22:20.943581 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: rbac.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.944881 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.945412 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: rbac-policies
Jun 03 08:22:20.946397 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: rbac_address_group.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.947696 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.948222 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: rbac-address-group
Jun 03 08:22:20.948550 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: rbac_address_scope.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.949461 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.949979 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: rbac-address-scope
Jun 03 08:22:20.950303 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: rbac_security_groups.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.951228 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.951740 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: rbac-security-groups
Jun 03 08:22:20.952065 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: rbac_subnetpool.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.952971 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.953485 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: rbac-subnetpool
Jun 03 08:22:20.953808 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: revisionifmatch.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.954731 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.955248 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: revision-if-match
Jun 03 08:22:20.955572 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: revisions.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.962419 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.962985 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: standard-attr-revisions
Jun 03 08:22:20.963312 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: router_availability_zone.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.963977 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.964487 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: router_availability_zone
Jun 03 08:22:20.964807 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: routerservicetype.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.965699 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.966209 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension router-service-type not supported by any of loaded plugins
Jun 03 08:22:20.966570 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.967468 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.967983 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: security-groups-normalized-cidr
Jun 03 08:22:20.968308 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: security_groups_port_filtering.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.969201 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.969711 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: port-security-groups-filtering
Jun 03 08:22:20.970034 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: security_groups_remote_address_group.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.971020 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.971528 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: security-groups-remote-address-group
Jun 03 08:22:20.971850 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: securitygroup.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.983396 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.983926 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: security-group
Jun 03 08:22:20.987463 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: segment.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.987463 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.987463 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension segment not supported by any of loaded plugins
Jun 03 08:22:20.987463 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.987937 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.988446 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins
Jun 03 08:22:20.988771 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: servicetype.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.989860 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.990378 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: service-type
Jun 03 08:22:20.990742 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: sorting.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.991709 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.992039 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: sorting
Jun 03 08:22:20.992363 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: standard_attr_segment.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.993841 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.994436 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension standard-attr-segment not supported by any of loaded plugins
Jun 03 08:22:20.994789 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: standardattrdescription.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.995434 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.995937 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: standard-attr-description
Jun 03 08:22:20.996259 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: stateful_security_group.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.997150 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:20.997660 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: stateful-security-group
Jun 03 08:22:20.997979 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: stdattrs_common.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.998569 dv-cinder-787262-5-iscsi neutron-server[92216]: WARNING neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py
Jun 03 08:22:20.998950 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:20.999923 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:21.000437 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins
Jun 03 08:22:21.000757 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: subnet_onboard.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:21.001802 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:21.002318 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: subnet_onboard
Jun 03 08:22:21.002671 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: subnet_segmentid_writable.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:21.003584 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:21.004088 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension subnet-segmentid-writable not supported by any of loaded plugins
Jun 03 08:22:21.004401 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: subnet_service_types.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:21.005308 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:21.005818 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: subnet-service-types
Jun 03 08:22:21.006137 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: subnetallocation.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:21.007230 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:21.007747 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: subnet_allocation
Jun 03 08:22:21.008068 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:21.008774 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:21.009281 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: subnetpool-prefix-ops
Jun 03 08:22:21.009599 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:21.010534 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:21.011050 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins
Jun 03 08:22:21.011370 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: tagging.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:21.012427 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:21.012940 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: standard-attr-tag
Jun 03 08:22:21.013263 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: timestamp.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:21.014452 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:21.015003 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loaded extension: standard-attr-timestamp
Jun 03 08:22:21.015330 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: trunk.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:21.016342 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:21.016858 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension trunk not supported by any of loaded plugins
Jun 03 08:22:21.017181 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: trunk_details.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:21.018075 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:21.018616 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension trunk-details not supported by any of loaded plugins
Jun 03 08:22:21.018943 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: uplink_status_propagation.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:21.019845 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:21.020434 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension uplink-status-propagation not supported by any of loaded plugins
Jun 03 08:22:21.020758 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Loading extension file: vlantransparent.py {{(pid=92216) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 03 08:22:21.021419 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=92216) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 03 08:22:21.021925 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extension vlan-transparent not supported by any of loaded plugins
Jun 03 08:22:21.024907 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Creating instance of TrackedResource for resource:network
Jun 03 08:22:21.025714 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Creating instance of TrackedResource for resource:subnet
Jun 03 08:22:21.026523 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Creating instance of TrackedResource for resource:subnetpool
Jun 03 08:22:21.027121 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Creating instance of TrackedResource for resource:port
Jun 03 08:22:21.028370 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.v2.resource_helper [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92216) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 03 08:22:21.028811 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.v2.resource_helper [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Service FLAVORS assigned prefix:  {{(pid=92216) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 03 08:22:21.029430 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.v2.resource_helper [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92216) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 03 08:22:21.029856 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.v2.resource_helper [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92216) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 03 08:22:21.030183 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Creating instance of TrackedResource for resource:router
Jun 03 08:22:21.030852 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Creating instance of TrackedResource for resource:floatingip
Jun 03 08:22:21.031568 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.v2.resource_helper [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Service METERING assigned prefix: /metering {{(pid=92216) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 03 08:22:21.032988 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fae87da99d0>> rbac-policy before_create 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:21.033358 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fae87da99d0>> rbac-policy before_update 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:21.033707 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fae87da99d0>> rbac-policy before_delete 55550000 {{(pid=92216) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:22:21.034853 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Creating instance of CountableResource for resource:rbac_policy
Jun 03 08:22:21.035299 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Creating instance of TrackedResource for resource:security_group
Jun 03 08:22:21.035964 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Creating instance of TrackedResource for resource:security_group_rule
Jun 03 08:22:21.036694 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.v2.resource_helper [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Service CORE assigned prefix:  {{(pid=92216) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 03 08:22:21.037021 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Creating instance of TrackedResource for resource:subnetpool
Jun 03 08:22:21.037353 dv-cinder-787262-5-iscsi neutron-server[92216]: WARNING neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] subnetpool is already registered
Jun 03 08:22:21.037959 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.v2.resource_helper [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Service CORE assigned prefix:  {{(pid=92216) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 03 08:22:21.038283 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Creating instance of TrackedResource for resource:subnetpool
Jun 03 08:22:21.038635 dv-cinder-787262-5-iscsi neutron-server[92216]: WARNING neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] subnetpool is already registered
Jun 03 08:22:21.041855 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.v2.resource_helper [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92216) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 03 08:22:21.042280 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.v2.resource_helper [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Service FLAVORS assigned prefix:  {{(pid=92216) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 03 08:22:21.042895 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.v2.resource_helper [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92216) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 03 08:22:21.043315 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.v2.resource_helper [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92216) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 03 08:22:21.043643 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Creating instance of TrackedResource for resource:router
Jun 03 08:22:21.043969 dv-cinder-787262-5-iscsi neutron-server[92216]: WARNING neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] router is already registered
Jun 03 08:22:21.044558 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Creating instance of TrackedResource for resource:floatingip
Jun 03 08:22:21.044883 dv-cinder-787262-5-iscsi neutron-server[92216]: WARNING neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] floatingip is already registered
Jun 03 08:22:21.045503 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.v2.resource_helper [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Service METERING assigned prefix: /metering {{(pid=92216) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 03 08:22:21.046158 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Creating instance of CountableResource for resource:rbac_policy
Jun 03 08:22:21.046483 dv-cinder-787262-5-iscsi neutron-server[92216]: WARNING neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] rbac_policy is already registered
Jun 03 08:22:21.047094 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Creating instance of TrackedResource for resource:security_group
Jun 03 08:22:21.047387 dv-cinder-787262-5-iscsi neutron-server[92216]: WARNING neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] security_group is already registered
Jun 03 08:22:21.047961 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Creating instance of TrackedResource for resource:security_group_rule
Jun 03 08:22:21.048285 dv-cinder-787262-5-iscsi neutron-server[92216]: WARNING neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] security_group_rule is already registered
Jun 03 08:22:21.048943 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.v2.resource_helper [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Service CORE assigned prefix:  {{(pid=92216) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 03 08:22:21.049267 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Creating instance of TrackedResource for resource:subnetpool
Jun 03 08:22:21.053457 dv-cinder-787262-5-iscsi neutron-server[92216]: WARNING neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] subnetpool is already registered
Jun 03 08:22:21.053457 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.v2.resource_helper [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Service CORE assigned prefix:  {{(pid=92216) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 03 08:22:21.053457 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Creating instance of TrackedResource for resource:subnetpool
Jun 03 08:22:21.053457 dv-cinder-787262-5-iscsi neutron-server[92216]: WARNING neutron.quota.resource_registry [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] subnetpool is already registered
Jun 03 08:22:21.053457 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: extensions {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.053457 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: address-groups {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.054480 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: address-scopes {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.056762 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: agents {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.057931 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: auto-allocated-topology {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.059212 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: availability_zones {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.060519 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: dhcp-networks {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.061925 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: dhcp-agents {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.063387 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: routers {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.065193 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: flavors {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.066346 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: service_profiles {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.067581 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: next_providers {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.069093 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: service_profiles {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.070993 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: floatingip-pools {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.072355 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: routers {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.074202 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: floatingips {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.075410 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: l3-routers {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.076791 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: l3-agents {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.078185 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: metering-labels {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.079572 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: metering-label-rules {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.080851 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: network-ip-availabilities {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.082101 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: bindings {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.083858 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: quotas {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.085284 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: quotas {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.087392 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: rbac-policies {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.089657 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: security-groups {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.091006 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: security-group-rules {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.092239 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: service-providers {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.093446 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: subnetpools {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.205696 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: subnetpools {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.207093 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: tags {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.208805 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: tags {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.210656 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: tags {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.213130 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: tags {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.214937 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: tags {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.216806 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: tags {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.218482 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: tags {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.220389 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: tags {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.222133 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: tags {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.224129 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron.api.extensions [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Extended resource: tags {{(pid=92216) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 03 08:22:21.230853 dv-cinder-787262-5-iscsi neutron-server[92216]: WARNING keystonemiddleware.auth_token [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True.
Jun 03 08:22:21.235556 dv-cinder-787262-5-iscsi neutron-server[92216]: WARNING keystonemiddleware.auth_token [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Jun 03 08:22:21.243882 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_concurrency.lockutils [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Acquired lock "singleton_lock" {{(pid=92216) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}}
Jun 03 08:22:21.244365 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_concurrency.lockutils [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Releasing lock "singleton_lock" {{(pid=92216) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}}
Jun 03 08:22:21.244998 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO oslo_service.service [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Starting 2 workers
Jun 03 08:22:21.249671 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Started child 92323 {{(pid=92216) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 03 08:22:21.253934 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Started child 92324 {{(pid=92216) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 03 08:22:21.254875 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:21.255573 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO neutron.service [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Neutron service started, listening on 0.0.0.0:9696
Jun 03 08:22:21.256165 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Notify callbacks [] for process, before_spawn {{(pid=92216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:21.256323 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [-] (92323) wsgi starting up on http://0.0.0.0:9696
Jun 03 08:22:21.258289 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:21.258933 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO oslo_service.service [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Starting 1 workers
Jun 03 08:22:21.259889 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [-] (92324) wsgi starting up on http://0.0.0.0:9696
Jun 03 08:22:21.263632 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Started child 92325 {{(pid=92216) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 03 08:22:21.264137 dv-cinder-787262-5-iscsi neutron-server[92216]: INFO oslo_service.service [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Starting 1 workers
Jun 03 08:22:21.267209 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.service [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] calling RpcWorker wait() {{(pid=92325) _wait /opt/stack/neutron/neutron/service.py:128}}
Jun 03 08:22:21.267736 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.service [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] returning from RpcWorker wait() {{(pid=92325) _wait /opt/stack/neutron/neutron/service.py:135}}
Jun 03 08:22:21.268476 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Started child 92326 {{(pid=92216) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 03 08:22:21.269050 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:21.269218 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG neutron_lib.callbacks.manager [None req-33e5f2f4-9698-4dcb-a9b9-d0ea0f5013ea None None] Notify callbacks [] for process, after_spawn {{(pid=92216) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:21.269598 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:22:21.271183 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=92216) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
Jun 03 08:22:21.271405 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jun 03 08:22:21.271588 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jun 03 08:22:21.271801 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jun 03 08:22:21.272151 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jun 03 08:22:21.272311 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jun 03 08:22:21.272839 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.273120 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.273209 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:21.273646 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.273646 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.274437 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.274611 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:22:21.275056 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.275313 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.275563 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.275834 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.276084 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.276255 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.276419 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.276670 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.276899 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.277184 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.277458 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.277700 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.277927 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.278096 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.278351 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.278638 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.278862 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.279132 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] debug                          = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.279379 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.279846 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.280070 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.280314 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.280532 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.280806 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.281030 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.281301 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.281531 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.281742 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.281991 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.282256 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.282517 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.282764 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.282975 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.283215 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.283444 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.283915 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] host                           = dv-cinder-787262-5-iscsi {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.284162 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.284402 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.284626 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.284867 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.285121 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.285353 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.285616 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.285946 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.286187 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.286412 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.286701 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.286956 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.287190 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.287433 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.287597 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.288163 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.288163 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.288394 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.288522 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.288646 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.288819 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.289063 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.289226 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.289532 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.290321 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.290559 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.290777 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.291022 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.291234 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.291509 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.291736 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.291948 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.292171 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.292381 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.292606 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.292867 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.293052 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.293264 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.293503 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.293715 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.293934 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.294157 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.294396 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.294647 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.294918 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.295156 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.295418 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.295660 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.295901 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.296128 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.296351 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.296656 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.296835 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.297062 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.297301 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.297539 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.297749 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.297973 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.298331 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.298938 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.298938 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.299187 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.299316 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.299510 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.299718 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.299926 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.300134 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.300342 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.300572 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.300988 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.301536 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.301883 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.302698 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.302698 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.303111 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.303111 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.303396 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.303529 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.303684 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.304006 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.304256 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.304541 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.304788 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.305088 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.305403 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.305663 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.305938 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.306161 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.306412 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.306667 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.306906 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.310589 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.310589 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.310589 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.11/identity {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.310988 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 44194) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:22:21.311123 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.311123 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.311123 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.311123 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.311123 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.311123 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.311123 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.311123 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.312119 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.312119 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.312119 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.312119 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.312119 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.312119 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.312119 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.312119 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.312119 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.313058 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.313058 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.313058 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.313058 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.313058 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.313058 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.313650 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.313820 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.314144 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.314368 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.314604 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.314819 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.315036 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.315267 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.315484 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.315694 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.319455 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.319455 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.319455 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.319455 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.319455 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.319455 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.319455 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.319455 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.319455 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.320404 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.320404 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.320404 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.320404 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.320404 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.320404 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.320404 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.320404 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.320404 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.321047 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.321047 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.321047 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.321047 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.321047 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.321331 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.321396 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.321644 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.321896 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.322219 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.322465 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.322735 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.322975 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.323252 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.323485 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.323887 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [-] 10.222.0.11 "GET / HTTP/1.1" status: 200  len: 253 time: 0.0139427
Jun 03 08:22:21.324144 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.324572 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.324794 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.325012 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.325280 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.325541 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.325756 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.325984 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.326219 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.326526 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.327391 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.327391 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.327391 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.327583 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.327649 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.327884 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.328135 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.328364 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.328614 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.328844 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.329136 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.330462 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.330777 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.331312 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.331589 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.331869 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.332184 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.332451 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.332813 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.333677 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.333677 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.333677 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.333901 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.334141 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.334280 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.334696 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.334982 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.336011 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.336749 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.336987 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.337212 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.337771 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.338026 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.338266 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.338517 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.338769 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.339040 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.339293 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.339575 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.339830 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.340089 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.340330 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.340570 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.11/identity {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.340785 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.341011 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.341240 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.341448 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.341690 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.341899 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.342136 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.342755 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.342755 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.343025 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.343025 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.343273 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.343472 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.344432 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.344432 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.344432 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.344432 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.344934 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.344934 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.344934 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.345276 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.345401 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.346371 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.346371 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.346371 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.346371 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.346870 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.346870 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.347081 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.347251 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.347499 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.348076 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.348076 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.348340 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.348468 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.348599 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.348807 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.349699 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.349699 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.349699 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.349699 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.350412 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.350412 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.350412 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.350857 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.351021 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.351168 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.351373 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.351587 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.351824 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.353712 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.353712 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.353712 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.353712 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.353712 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.354400 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.354400 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.354400 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.354400 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.354989 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.354989 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.355253 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.355406 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.355553 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.356352 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.356352 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.356352 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.356890 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.356890 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.356890 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.357288 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.357288 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.357563 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.357702 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.357849 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.358020 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.361503 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.361503 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.361503 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.361503 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.361503 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.361503 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.361503 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.361503 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.361503 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.362766 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.362766 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.362766 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.362766 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.362766 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.362766 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.362766 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.362766 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.363638 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.363638 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.363789 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.364079 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.364228 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.364433 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.364671 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.364928 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.365850 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.365850 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.365850 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.366202 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.366315 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.366597 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:500:549'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.366856 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.367066 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.367351 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.367744 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.368011 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.368260 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.368755 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.368755 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.368955 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.369186 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.369415 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.369644 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.369861 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.370113 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.370338 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.371377 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.371778 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.372148 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.372371 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.372628 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.372858 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.373097 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.373312 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.373459 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jun 03 08:22:21.374041 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=92216) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
Jun 03 08:22:21.374202 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jun 03 08:22:21.374345 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jun 03 08:22:21.374523 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jun 03 08:22:21.374714 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jun 03 08:22:21.374826 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jun 03 08:22:21.375036 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.375208 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.375358 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.375502 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.375645 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.375818 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.375976 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.376130 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.376283 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.376745 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.376745 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.376745 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.376968 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.377038 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.377155 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.377465 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.377620 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.377777 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.377938 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.378093 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.378248 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.378403 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.378583 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] debug                          = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.378740 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.378940 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.379103 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.379351 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.379475 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.379712 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.379875 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.380030 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.380184 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.380339 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.380494 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.380648 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.380801 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.380956 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.381096 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.381253 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.381407 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.381560 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] host                           = dv-cinder-787262-5-iscsi {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.381715 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.381870 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.382022 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.382175 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.382328 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.382481 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.382658 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.382812 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.382966 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.383145 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.383420 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.383702 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.383789 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.383914 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.384202 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.384364 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.384519 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.385751 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.385751 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.385751 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.385751 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.385751 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.386278 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.386278 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.386278 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.386278 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.386707 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.386707 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.386903 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.386903 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.387097 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.387185 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.387333 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.387490 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.387643 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.387797 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.387951 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.388105 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.388258 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.388885 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.388885 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.388885 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.388885 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.389165 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.389165 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.389283 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.389420 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.389593 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.389741 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.389885 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.390148 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.390148 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.390424 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.390424 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.390725 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.390725 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.390990 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.391223 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.391223 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.391510 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.391510 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.391774 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.391774 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.392048 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.392048 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.392317 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.392317 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.393373 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.393373 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 03 08:22:21.393373 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.393373 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.393373 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.393373 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.393373 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.393841 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.393841 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.393841 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.394071 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.394071 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.394216 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.395049 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.396786 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.396786 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.396786 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.396786 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.397331 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.397331 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.397331 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.397331 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.397788 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.397788 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.397788 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.398197 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.398197 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.11/identity {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.398197 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.398517 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.398517 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.398723 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.399374 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.399540 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.399802 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.400009 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.400165 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.400495 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.400791 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.401128 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.402051 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.402051 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.402051 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.402051 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.402051 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.402777 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.402777 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.402777 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.402777 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.402777 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.403139 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.403139 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.403284 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.403391 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.403549 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.403706 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.403863 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.404020 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.404176 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.404334 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.404491 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.404648 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.404805 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.404962 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.405132 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.405289 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.405446 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.405608 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.406544 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.406544 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.406544 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.406544 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.406544 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.406544 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.407219 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.407219 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.407219 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.407219 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.408351 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.408351 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.408351 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.408351 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.408351 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.408351 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.408351 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.408351 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.409203 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.409203 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.409203 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.409203 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.409203 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.409203 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.409886 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.409886 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.409886 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.409886 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.409886 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.410358 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.410358 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.410358 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.410809 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.410809 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.411134 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.411134 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.411386 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.411386 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.411620 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.411620 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.411850 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.411971 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.412077 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.412204 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.412361 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.412517 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.413099 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.413099 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.413099 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.413465 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.413465 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.413465 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.413821 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.413821 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.414024 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.414024 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.414218 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.414329 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.414594 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.414820 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.415025 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.415230 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.415405 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.415580 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.415743 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.415901 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.416059 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.416241 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.416399 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.416556 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.416715 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.416873 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.417030 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.417188 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.417344 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.417502 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.417659 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.417817 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.417975 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.11/identity {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.418132 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.418354 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.418553 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.418675 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.418781 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.418884 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.419045 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.419204 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.419362 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.419519 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.419677 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.419835 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.419992 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.420149 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.420305 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.420462 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.420619 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.420776 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.420933 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.421143 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.421269 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.421391 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.421513 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.421666 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.421821 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.421981 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.422138 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.422295 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.422454 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.422648 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.422806 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.422965 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.423835 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.423835 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.423835 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.423835 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.423835 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.423835 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.424446 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.424446 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.424446 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.424446 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.424823 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.424823 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.425031 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.425031 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.425240 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.425344 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.425588 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.425836 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.426000 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.426158 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.426316 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.426472 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.427439 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.427594 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.427761 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.427907 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.428070 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.428216 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.428445 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.428605 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.428746 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.429121 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.429280 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.429591 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.429745 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.430111 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.430704 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.431022 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.431214 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.431365 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.431508 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.431650 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.431817 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.431964 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.432114 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.432281 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.432439 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.432596 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.432753 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.432910 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.433078 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.433245 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.433384 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.433684 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.433852 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.434005 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.434164 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.434322 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.434486 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.434671 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.434837 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.434982 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.435147 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.435308 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.436263 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.436263 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.436263 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.436263 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.436263 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.436263 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.436646 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.436646 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.436764 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.436829 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.437081 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:500:549'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.437175 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.437311 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.437451 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.437681 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.437775 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.437914 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.438066 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.438223 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.438381 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.438650 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.438781 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.438942 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.439100 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.439257 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.439434 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.439571 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.439728 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.439885 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.440043 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.441007 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.441007 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.441007 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.441007 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 03 08:22:21.441007 dv-cinder-787262-5-iscsi neutron-server[92216]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=92216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jun 03 08:22:21.450518 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:22:32.663510 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe0f2444-dbb0-4080-a4c9-5f55845d0ba9 None None] get_active_networks_info from dv-cinder-787262-5-iscsi {{(pid=92325) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}}
Jun 03 08:22:32.746124 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe0f2444-dbb0-4080-a4c9-5f55845d0ba9 None None] No non-hosted networks {{(pid=92325) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}}
Jun 03 08:22:32.758593 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.agentschedulers_db [None req-fe0f2444-dbb0-4080-a4c9-5f55845d0ba9 None None] DHCP Agent not found on host dv-cinder-787262-5-iscsi {{(pid=92325) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}}
Jun 03 08:22:33.019643 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-45a08395-1513-4aea-8bef-bdc5dc56e3a6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534'] for agent, after_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:34.818376 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534'] for agent, after_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:34.820294 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:34.820810 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:34.821869 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:34.822341 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:34.822849 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:34.825176 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:34.825176 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:34.825176 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:34.825176 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:34.825176 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:34.825556 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:34.826036 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:34.826613 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7fae871700d0>, 'Open vSwitch agent', 'dv-cinder-787262-5-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:22:34.835621 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7fae871bd3a0>,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-787262-5-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:22:35.215087 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4423b650-acec-4ad1-912a-61f743087107 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534'] for agent, after_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:35.244167 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-9716884a-f94d-442d-a7eb-3227d3fc5a17 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:36.208137 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534'] for agent, after_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:37.626423 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.db.l3_hamode_db [None req-782c8d2c-06b4-4739-bd57-b53033b01896 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1
Jun 03 08:22:37.715700 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-782c8d2c-06b4-4739-bd57-b53033b01896 None None] Routers set() bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:22:37.716090 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-782c8d2c-06b4-4739-bd57-b53033b01896 None None] Router IDs set() for agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}}
Jun 03 08:22:37.973649 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534'] for agent, after_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:39.452221 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 44298) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:22:40.055562 dv-cinder-787262-5-iscsi neutron-server[92324]: WARNING oslo_policy.policy [None req-7096c42a-4a19-4f96-99a3-780204408deb admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 03 08:22:40.056166 dv-cinder-787262-5-iscsi neutron-server[92324]: WARNING oslo_policy.policy [None req-7096c42a-4a19-4f96-99a3-780204408deb admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 03 08:22:40.272146 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [None req-7096c42a-4a19-4f96-99a3-780204408deb admin admin] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=92324) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 03 08:22:40.273238 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-7096c42a-4a19-4f96-99a3-780204408deb admin admin] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.8200338
Jun 03 08:22:42.620743 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 44312) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:22:42.991139 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-4d666acb-d71f-4c3d-a244-52f1e31eede1 admin admin] Request body: {'subnetpool': {'prefixes': ['172.20.0.0/16'], 'default_prefixlen': 26, 'shared': True, 'name': 'shared-default-subnetpool-v4', 'is_default': True}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:22:43.091155 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.policy [None req-4d666acb-d71f-4c3d-a244-52f1e31eede1 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=92324) register_rules /opt/stack/neutron/neutron/policy.py:73}}
Jun 03 08:22:43.137357 dv-cinder-787262-5-iscsi neutron-server[92324]: WARNING oslo_policy.policy [None req-4d666acb-d71f-4c3d-a244-52f1e31eede1 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 03 08:22:43.137736 dv-cinder-787262-5-iscsi neutron-server[92324]: WARNING oslo_policy.policy [None req-4d666acb-d71f-4c3d-a244-52f1e31eede1 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 03 08:22:43.146290 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.quota [None req-4d666acb-d71f-4c3d-a244-52f1e31eede1 admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7fae877ca1c0>.
Jun 03 08:22:43.162167 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-4d666acb-d71f-4c3d-a244-52f1e31eede1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:22:43.304790 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-4d666acb-d71f-4c3d-a244-52f1e31eede1 admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8774227370918', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8774227371473', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8774227423423', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8774227420267', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8774227414766', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8774227404721', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-530427', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-747848', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-16469607', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-16269855'] for rbac-policy, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:43.515978 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-4d666acb-d71f-4c3d-a244-52f1e31eede1 admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:43.517053 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-4d666acb-d71f-4c3d-a244-52f1e31eede1 admin admin] 10.222.0.11 "POST /v2.0/subnetpools HTTP/1.1" status: 201  len: 739 time: 0.8952758
Jun 03 08:22:46.160168 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 44324) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:22:46.521064 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Request body: {'network': {'tenant_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'admin_state_up': True, 'project_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'name': 'private'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:22:46.526782 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:22:46.531295 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Usage tracker for resource:network and tenant:f6a03babd1d14e1d9d9d4a6dddc18883 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:22:46.535805 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:22:46.542016 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:22:46.727279 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Made reservation on behalf of f6a03babd1d14e1d9d9d4a6dddc18883 for: {'network': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:22:46.730115 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-676039'] for network, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:46.749166 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:46.763929 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:22:46.767663 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Usage tracker for resource:security_group_rule and tenant:f6a03babd1d14e1d9d9d4a6dddc18883 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:22:46.772603 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:22:46.781110 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:22:47.042626 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:47.150054 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:47.154615 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:22:47.174073 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] vlan segment allocate from pool success with {'vlan_id': 542, 'physical_network': 'physnet1'}  {{(pid=92324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 03 08:22:47.201067 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8774224358849', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:47.201673 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7fae886adc10> segment precommit_create {{(pid=92324) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
Jun 03 08:22:47.202166 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.segments_db [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Added segment 5c3a6529-0f15-4bb4-abb6-efa295e87d96 of type vlan for network daea5734-5913-4852-9397-976327c9a9a5
Jun 03 08:22:47.251233 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=08fc51fc-f01d-4342-b195-2628f4da6f37,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:22:47.267005 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:47.267362 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:47.267926 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:47.267926 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:47.267926 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:47.268804 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:47.268951 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:47.269265 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:47.269592 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:47.269909 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:47.270217 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:47.270543 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Tracked resource versions report:
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]: pushed versions:
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]: {   'AddressGroup': {'1.2'},
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:     'ConntrackHelper': {'1.0'},
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:     'Log': {'1.0'},
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:     'Network': {'1.1'},
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:     'Port': {'1.7'},
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:     'PortForwarding': {'1.2'},
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:     'QosPolicy': {'1.8'},
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:     'SecurityGroup': {'1.4'},
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:     'SecurityGroupRule': {'1.2'},
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:     'SubPort': {'1.0'},
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:     'Subnet': {'1.1'},
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:     'Trunk': {'1.1'}}
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]: consumer versions:
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]: {   DHCP agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:     L3 agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:     Metadata agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:     Metering agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:     Open vSwitch agent@dv-cinder-787262-5-iscsi: {   'AddressGroup': '1.2',
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:                                                      'ConntrackHelper': '1.0',
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:                                                      'Log': '1.0',
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:                                                      'Network': '1.1',
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:                                                      'Port': '1.7',
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:                                                      'PortForwarding': '1.2',
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:                                                      'QosPolicy': '1.8',
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:                                                      'SecurityGroup': '1.4',
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:                                                      'SecurityGroupRule': '1.2',
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:                                                      'SubPort': '1.0',
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:                                                      'Subnet': '1.1',
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:                                                      'Trunk': '1.1'}}
Jun 03 08:22:47.271577 dv-cinder-787262-5-iscsi neutron-server[92324]:  {{(pid=92324) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 03 08:22:47.320519 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:22:47.322123 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8774223827658'] for network, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:47.419029 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820'] for network, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:47.420718 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:22:47.421207 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:47.424569 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:22:47.528839 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Pushing event updated for resources: {'Network': ['ID=daea5734-5913-4852-9397-976327c9a9a5,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:22:47.531856 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:22:47.540599 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Network daea5734-5913-4852-9397-976327c9a9a5 details requested by agent ovs-agent-dv-cinder-787262-5-iscsi with host dv-cinder-787262-5-iscsi {{(pid=92325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 03 08:22:47.627080 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201  len: 849 time: 1.4524806
Jun 03 08:22:50.349995 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 44338) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:22:50.792742 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3af3c3f7-b9ff-4ff1-aa4c-9f9f659e0250 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:22:50.794097 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-3af3c3f7-b9ff-4ff1-aa4c-9f9f659e0250 admin admin] 10.222.0.11 "GET /v2.0/networks/daea5734-5913-4852-9397-976327c9a9a5 HTTP/1.1" status: 200  len: 825 time: 0.4431376
Jun 03 08:22:50.821399 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-0ed8557e-a11a-49c7-806e-9b0388c2f347 admin admin] 10.222.0.11 "GET /v2.0/subnetpools/7b7fca7c-bc40-4b96-8c01-a510aa308665 HTTP/1.1" status: 200  len: 734 time: 0.0219517
Jun 03 08:22:50.829665 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-bffaed80-597f-43b8-9f44-cc1e28a88440 admin admin] Request body: {'subnet': {'ip_version': 4, 'tenant_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'name': 'private-subnet', 'subnetpool_id': '7b7fca7c-bc40-4b96-8c01-a510aa308665', 'gateway_ip': '172.20.0.1', 'network_id': 'daea5734-5913-4852-9397-976327c9a9a5'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:22:50.833753 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-bffaed80-597f-43b8-9f44-cc1e28a88440 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:22:50.837493 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-bffaed80-597f-43b8-9f44-cc1e28a88440 admin admin] Usage tracker for resource:subnet and tenant:f6a03babd1d14e1d9d9d4a6dddc18883 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:22:50.840289 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-bffaed80-597f-43b8-9f44-cc1e28a88440 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:22:50.845783 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-bffaed80-597f-43b8-9f44-cc1e28a88440 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:22:50.996008 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bffaed80-597f-43b8-9f44-cc1e28a88440 admin admin] Made reservation on behalf of f6a03babd1d14e1d9d9d4a6dddc18883 for: {'subnet': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:22:50.998413 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-bffaed80-597f-43b8-9f44-cc1e28a88440 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:51.551800 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-bffaed80-597f-43b8-9f44-cc1e28a88440 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829'] for subnet, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:51.556904 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:22:51.636443 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bffaed80-597f-43b8-9f44-cc1e28a88440 admin admin] Checking segment: {'id': '5c3a6529-0f15-4bb4-abb6-efa295e87d96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': 'daea5734-5913-4852-9397-976327c9a9a5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:22:51.636799 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bffaed80-597f-43b8-9f44-cc1e28a88440 admin admin] Network hostable DHCP agents. Network: daea5734-5913-4852-9397-976327c9a9a5, hostable agents: ['07372699-02ac-4239-816f-84b3a5b0eff9'], hosted agents: [] {{(pid=92324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 03 08:22:51.640343 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bffaed80-597f-43b8-9f44-cc1e28a88440 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c450d61f-efe6-49cc-a4ad-7a9243893992,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:22:51.645866 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-bffaed80-597f-43b8-9f44-cc1e28a88440 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:22:51.744352 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bffaed80-597f-43b8-9f44-cc1e28a88440 admin admin] Network daea5734-5913-4852-9397-976327c9a9a5 is scheduled to be hosted by DHCP agent 07372699-02ac-4239-816f-84b3a5b0eff9 with binding_index 1 {{(pid=92324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 03 08:22:51.858918 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-bffaed80-597f-43b8-9f44-cc1e28a88440 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-5-iscsi, daea5734-5913-4852-9397-976327c9a9a5) {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:22:51.863576 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bffaed80-597f-43b8-9f44-cc1e28a88440 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:22:51.864236 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-bffaed80-597f-43b8-9f44-cc1e28a88440 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:51.872919 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb8971db-bee6-4555-882e-9be24a6b755a None None] Network daea5734-5913-4852-9397-976327c9a9a5 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:22:52.065099 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-bffaed80-597f-43b8-9f44-cc1e28a88440 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 854 time: 1.2385805
Jun 03 08:22:52.168443 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp3789a88e-0f76-536c-9507-4ab4ace56879-daea5734-5913-4852-9397-976327c9a9a5', 'network_id': 'daea5734-5913-4852-9397-976327c9a9a5', 'tenant_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'fixed_ips': [{'subnet_id': 'c450d61f-efe6-49cc-a4ad-7a9243893992'}]}} from dv-cinder-787262-5-iscsi. {{(pid=92325) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 03 08:22:52.169646 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:52.360583 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.db_base_plugin_common [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Allocated IP 172.20.0.2 (daea5734-5913-4852-9397-976327c9a9a5/c450d61f-efe6-49cc-a4ad-7a9243893992/b3d30033-c310-4303-b919-e1c393b3fb7d) {{(pid=92325) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:22:52.587245 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Notify callbacks [] for port, precommit_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:52.599435 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Transition to ACTIVE for port object b3d30033-c310-4303-b919-e1c393b3fb7d will not be triggered until provisioned by entity L2. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:22:52.618652 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Transition to ACTIVE for port object b3d30033-c310-4303-b919-e1c393b3fb7d will not be triggered until provisioned by entity DHCP. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:22:52.698770 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:52.703559 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:22:52.764222 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Network daea5734-5913-4852-9397-976327c9a9a5 is already hosted by enough agents. {{(pid=92325) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:22:52.766924 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.scheduler.base_scheduler [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Resources bound (agent type, host, resource id):  {{(pid=92325) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:22:52.774328 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Received port after_create {{(pid=92325) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:22:52.776463 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Pushing event updated for resources: {'Port': ['ID=b3d30033-c310-4303-b919-e1c393b3fb7d,revision_number=1']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:22:52.785261 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:52.785597 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:52.785923 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:52.786245 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:52.786579 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:52.786901 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:52.787212 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:52.787523 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:52.787849 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:52.788312 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:52.789280 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:52.790232 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Tracked resource versions report:
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]: pushed versions:
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]: {   'AddressGroup': {'1.2'},
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:     'ConntrackHelper': {'1.0'},
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:     'Log': {'1.0'},
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:     'Network': {'1.1'},
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:     'Port': {'1.7'},
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:     'PortForwarding': {'1.2'},
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:     'QosPolicy': {'1.8'},
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:     'SecurityGroup': {'1.4'},
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:     'SecurityGroupRule': {'1.2'},
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:     'SubPort': {'1.0'},
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:     'Subnet': {'1.1'},
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:     'Trunk': {'1.1'}}
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]: consumer versions:
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]: {   DHCP agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:     L3 agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:     Metadata agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:     Metering agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:     Open vSwitch agent@dv-cinder-787262-5-iscsi: {   'AddressGroup': '1.2',
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:                                                      'ConntrackHelper': '1.0',
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:                                                      'Log': '1.0',
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:                                                      'Network': '1.1',
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:                                                      'Port': '1.7',
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:                                                      'PortForwarding': '1.2',
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:                                                      'QosPolicy': '1.8',
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:                                                      'SecurityGroup': '1.4',
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:                                                      'SecurityGroupRule': '1.2',
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:                                                      'SubPort': '1.0',
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:                                                      'Subnet': '1.1',
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:                                                      'Trunk': '1.1'}}
Jun 03 08:22:52.791692 dv-cinder-787262-5-iscsi neutron-server[92325]:  {{(pid=92325) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 03 08:22:52.834386 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:22:52.894042 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Attempting to bind port b3d30033-c310-4303-b919-e1c393b3fb7d on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:22:52.894724 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Attempting to bind port b3d30033-c310-4303-b919-e1c393b3fb7d by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '5c3a6529-0f15-4bb4-abb6-efa295e87d96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': 'daea5734-5913-4852-9397-976327c9a9a5'}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:22:52.894814 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Attempting to bind port b3d30033-c310-4303-b919-e1c393b3fb7d on network daea5734-5913-4852-9397-976327c9a9a5 {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:22:52.901299 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 22, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:22:52.901703 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Checking segment: {'id': '5c3a6529-0f15-4bb4-abb6-efa295e87d96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': 'daea5734-5913-4852-9397-976327c9a9a5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:22:52.902162 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:52.908460 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Bound using segment: {'id': '5c3a6529-0f15-4bb4-abb6-efa295e87d96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': 'daea5734-5913-4852-9397-976327c9a9a5'} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:22:52.908460 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Bound port: b3d30033-c310-4303-b919-e1c393b3fb7d, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5c3a6529-0f15-4bb4-abb6-efa295e87d96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': 'daea5734-5913-4852-9397-976327c9a9a5'}}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:22:52.908460 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:52.993217 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] For port b3d30033-c310-4303-b919-e1c393b3fb7d, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:22:52.997042 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] For port b3d30033-c310-4303-b919-e1c393b3fb7d, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=b3d30033-c310-4303-b919-e1c393b3fb7d,segment=NetworkSegment(5c3a6529-0f15-4bb4-abb6-efa295e87d96),segment_id=5c3a6529-0f15-4bb4-abb6-efa295e87d96)] {{(pid=92325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:22:53.053365 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:53.057240 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:22:53.144160 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Pushing event updated for resources: {'Port': ['ID=b3d30033-c310-4303-b919-e1c393b3fb7d,revision_number=2']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:22:53.147275 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:22:54.488408 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 44346) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:22:54.885547 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [None req-b0752b5c-c08e-4b62-9fbb-164775e69255 admin admin] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=92324) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 03 08:22:54.886552 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-b0752b5c-c08e-4b62-9fbb-164775e69255 admin admin] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3970971
Jun 03 08:22:57.329378 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 44354) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:22:57.725047 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [None req-4ca85167-e9eb-4137-99eb-8657e832de35 admin admin] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=92324) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 03 08:22:57.726599 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-4ca85167-e9eb-4137-99eb-8657e832de35 admin admin] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3962579
Jun 03 08:22:58.693950 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1205dcc5-e236-41d9-a7ed-79ac033e6d48 None None] Network daea5734-5913-4852-9397-976327c9a9a5 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:22:58.924065 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-168b8e64-0d06-406a-acaa-36d784c9ee66 None None] Provisioning for port b3d30033-c310-4303-b919-e1c393b3fb7d completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:22:59.176489 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device b3d30033-c310-4303-b919-e1c393b3fb7d up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:22:59.344005 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port b3d30033-c310-4303-b919-e1c393b3fb7d completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:22:59.348991 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port b3d30033-c310-4303-b919-e1c393b3fb7d triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:22:59.349494 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:59.466352 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:59.498338 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port b3d30033-c310-4303-b919-e1c393b3fb7d, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=b3d30033-c310-4303-b919-e1c393b3fb7d,segment=NetworkSegment(5c3a6529-0f15-4bb4-abb6-efa295e87d96),segment_id=5c3a6529-0f15-4bb4-abb6-efa295e87d96)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:22:59.613184 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:22:59.615385 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:22:59.689328 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=b3d30033-c310-4303-b919-e1c393b3fb7d,revision_number=3']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:22:59.692754 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:23:00.391845 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 44368) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:23:00.739471 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-7e143491-b306-4fbc-a4ec-8893f3a0fd53 admin admin] Request body: {'router': {'name': 'router1', 'admin_state_up': True, 'tenant_id': 'f6a03babd1d14e1d9d9d4a6dddc18883'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:23:00.744214 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-7e143491-b306-4fbc-a4ec-8893f3a0fd53 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:23:00.747919 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-7e143491-b306-4fbc-a4ec-8893f3a0fd53 admin admin] Usage tracker for resource:router and tenant:f6a03babd1d14e1d9d9d4a6dddc18883 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:23:00.751130 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-7e143491-b306-4fbc-a4ec-8893f3a0fd53 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:23:00.757164 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-7e143491-b306-4fbc-a4ec-8893f3a0fd53 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:23:00.824280 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e143491-b306-4fbc-a4ec-8893f3a0fd53 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-16388154', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2397'] for router, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:00.825843 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e143491-b306-4fbc-a4ec-8893f3a0fd53 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-16389011', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-16327785', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-16383573', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2340'] for router, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:00.912417 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e143491-b306-4fbc-a4ec-8893f3a0fd53 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:01.099645 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e143491-b306-4fbc-a4ec-8893f3a0fd53 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-16388099', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-16327774'] for router, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:01.146605 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device b3d30033-c310-4303-b919-e1c393b3fb7d up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:23:01.213634 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port b3d30033-c310-4303-b919-e1c393b3fb7d triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:23:01.213917 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:01.234769 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e143491-b306-4fbc-a4ec-8893f3a0fd53 admin admin] Notify callbacks [] for router, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:01.235966 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-7e143491-b306-4fbc-a4ec-8893f3a0fd53 admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201  len: 709 time: 0.8431609
Jun 03 08:23:02.481541 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-025906eb-4722-4997-92ec-104ea2ec1af7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:03.590311 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 44376) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:23:03.974609 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [None req-58c6a06b-a115-49d4-8866-d230a4dbe4b0 admin admin] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=92324) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 03 08:23:03.976041 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-58c6a06b-a115-49d4-8866-d230a4dbe4b0 admin admin] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3845460
Jun 03 08:23:04.807105 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:05.235916 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-f5b66549-fe88-495f-88dd-f6e1ded54b63 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:06.131647 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:06.378925 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 44384) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:23:06.754208 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Request body: {'network': {'is_default': True, 'admin_state_up': True, 'name': 'public', 'provider:physical_network': 'physnet1', 'provider:network_type': 'flat', 'router:external': True}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:23:06.760022 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:23:06.764050 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Usage tracker for resource:network and tenant:eac1716175244d3bbd8b430dd3b0d5ff is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:23:06.766928 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:23:06.773729 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:23:06.886131 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Made reservation on behalf of eac1716175244d3bbd8b430dd3b0d5ff for: {'network': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:23:06.888980 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-676039'] for network, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:06.903125 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:06.917648 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:23:06.921486 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Usage tracker for resource:security_group_rule and tenant:eac1716175244d3bbd8b430dd3b0d5ff is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:23:06.924473 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:23:06.931042 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:23:07.017206 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:07.120341 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:07.124692 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:23:07.140070 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Reserving flat network on physical network physnet1 {{(pid=92324) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}}
Jun 03 08:23:07.163247 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9bf85d39-5d34-4d14-be4a-5eee47ac7487,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:23:07.166080 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:07.166412 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.segments_db [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Added segment 746be0df-b9f5-40e2-acc1-2d2d9b9e7d06 of type flat for network 684ef871-89aa-450d-ae0d-e232bfaf51fb
Jun 03 08:23:07.167604 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:23:07.198018 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8774223827658'] for network, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:07.309782 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820'] for network, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:07.311419 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:23:07.312109 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:07.316056 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:23:07.439333 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Pushing event updated for resources: {'Network': ['ID=684ef871-89aa-450d-ae0d-e232bfaf51fb,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:23:07.442303 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:23:07.452129 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb details requested by agent ovs-agent-dv-cinder-787262-5-iscsi with host dv-cinder-787262-5-iscsi {{(pid=92325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 03 08:23:07.520840 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 1.1409109
Jun 03 08:23:07.966843 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:09.910839 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 44402) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:23:10.173358 dv-cinder-787262-5-iscsi neutron-server[92323]: WARNING oslo_policy.policy [None req-820d8ad4-727a-41f5-82ba-273915cb6285 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 03 08:23:10.173950 dv-cinder-787262-5-iscsi neutron-server[92323]: WARNING oslo_policy.policy [None req-820d8ad4-727a-41f5-82ba-273915cb6285 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 03 08:23:10.572486 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.policy [None req-820d8ad4-727a-41f5-82ba-273915cb6285 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=92323) register_rules /opt/stack/neutron/neutron/policy.py:73}}
Jun 03 08:23:10.619310 dv-cinder-787262-5-iscsi neutron-server[92323]: WARNING oslo_policy.policy [None req-820d8ad4-727a-41f5-82ba-273915cb6285 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 03 08:23:10.619685 dv-cinder-787262-5-iscsi neutron-server[92323]: WARNING oslo_policy.policy [None req-820d8ad4-727a-41f5-82ba-273915cb6285 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 03 08:23:10.627895 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-820d8ad4-727a-41f5-82ba-273915cb6285 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:23:10.629740 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-820d8ad4-727a-41f5-82ba-273915cb6285 admin admin] 10.222.0.11 "GET /v2.0/subnets/c450d61f-efe6-49cc-a4ad-7a9243893992 HTTP/1.1" status: 200  len: 849 time: 0.7183526
Jun 03 08:23:10.810665 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-158ee72c-4d8c-4f49-a9e6-df3772a4f817 admin admin] 10.222.0.11 "GET /v2.0/routers/063f888f-d5cc-4fa9-9cf8-e89d461c96f4 HTTP/1.1" status: 200  len: 704 time: 0.1755743
Jun 03 08:23:11.315709 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:11.556278 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Allocated IP 172.20.0.1 (daea5734-5913-4852-9397-976327c9a9a5/c450d61f-efe6-49cc-a4ad-7a9243893992/af736e52-9912-4831-8ff7-ad7483d0377b) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:23:11.724272 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:11.742882 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Transition to ACTIVE for port object af736e52-9912-4831-8ff7-ad7483d0377b will not be triggered until provisioned by entity DHCP. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:23:11.899210 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:11.904083 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:23:11.964618 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Network daea5734-5913-4852-9397-976327c9a9a5 is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:23:11.967889 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:23:12.004789 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Pushing event updated for resources: {'Port': ['ID=af736e52-9912-4831-8ff7-ad7483d0377b,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:23:12.013495 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:12.013855 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:12.014192 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:12.014532 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:12.014858 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:12.015192 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:12.015506 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:12.016485 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:12.016485 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:12.016485 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:12.016750 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:12.017023 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Tracked resource versions report:
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]: pushed versions:
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]: {   'AddressGroup': {'1.2'},
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:     'ConntrackHelper': {'1.0'},
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:     'Log': {'1.0'},
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:     'Network': {'1.1'},
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:     'Port': {'1.7'},
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:     'PortForwarding': {'1.2'},
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:     'QosPolicy': {'1.8'},
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:     'SecurityGroup': {'1.4'},
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:     'SecurityGroupRule': {'1.2'},
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:     'SubPort': {'1.0'},
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:     'Subnet': {'1.1'},
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:     'Trunk': {'1.1'}}
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]: consumer versions:
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]: {   DHCP agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:     L3 agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:     Metadata agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:     Metering agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:     Open vSwitch agent@dv-cinder-787262-5-iscsi: {   'AddressGroup': '1.2',
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:                                                      'ConntrackHelper': '1.0',
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:                                                      'Log': '1.0',
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:                                                      'Network': '1.1',
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:                                                      'Port': '1.7',
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:                                                      'PortForwarding': '1.2',
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:                                                      'QosPolicy': '1.8',
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:                                                      'SecurityGroup': '1.4',
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:                                                      'SecurityGroupRule': '1.2',
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:                                                      'SubPort': '1.0',
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:                                                      'Subnet': '1.1',
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:                                                      'Trunk': '1.1'}}
Jun 03 08:23:12.018052 dv-cinder-787262-5-iscsi neutron-server[92323]:  {{(pid=92323) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 03 08:23:12.031327 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:23:12.031891 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-16328800'] for router_interface, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:12.173898 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.269s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:23:12.344178 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0b603e4d-5a05-4aa0-b045-740647f9c8ee None None] Provisioning for port af736e52-9912-4831-8ff7-ad7483d0377b completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:23:12.350718 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0b603e4d-5a05-4aa0-b045-740647f9c8ee None None] Provisioning complete for port af736e52-9912-4831-8ff7-ad7483d0377b triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:23:12.351243 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0b603e4d-5a05-4aa0-b045-740647f9c8ee None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:12.422151 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0b603e4d-5a05-4aa0-b045-740647f9c8ee None None] Port af736e52-9912-4831-8ff7-ad7483d0377b cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:23:12.435511 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:12.673989 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:12.749765 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:12.750925 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-16344774', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-16328707'] for router_interface, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:12.755132 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:23:12.861248 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Pushing event updated for resources: {'Port': ['ID=af736e52-9912-4831-8ff7-ad7483d0377b,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:23:12.864056 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:23:12.997322 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Network daea5734-5913-4852-9397-976327c9a9a5 is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:23:12.998466 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:23:13.246225 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-8c6363aa-e5f3-4727-9148-1bfe1e1f47df None None] Provisioning complete for port af736e52-9912-4831-8ff7-ad7483d0377b triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:23:13.246624 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-8c6363aa-e5f3-4727-9148-1bfe1e1f47df None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:13.263118 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Router 063f888f-d5cc-4fa9-9cf8-e89d461c96f4 is scheduled to L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 with binding_index 1 {{(pid=92323) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 03 08:23:13.322556 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-8c6363aa-e5f3-4727-9148-1bfe1e1f47df None None] Port af736e52-9912-4831-8ff7-ad7483d0377b cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:23:13.418102 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:23:13.427747 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] Sync routers for ids ['063f888f-d5cc-4fa9-9cf8-e89d461c96f4'] in dv-cinder-787262-5-iscsi {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:23:13.432054 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] 10.222.0.11 "PUT /v2.0/routers/063f888f-d5cc-4fa9-9cf8-e89d461c96f4/add_router_interface HTTP/1.1" status: 200  len: 508 time: 2.6159849
Jun 03 08:23:13.438527 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] Routers {'063f888f-d5cc-4fa9-9cf8-e89d461c96f4'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:23:13.439374 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae87a170a0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:23:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['063f888f-d5cc-4fa9-9cf8-e89d461c96f4'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:23:13.612772 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] Set router 063f888f-d5cc-4fa9-9cf8-e89d461c96f4 gateway port host: None {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:23:13.986268 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae87a170a0>, [{'id': '063f888f-d5cc-4fa9-9cf8-e89d461c96f4', 'name': 'router1', 'tenant_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:23:00Z', 'updated_at': '2021-06-03T08:23:12Z', 'revision_number': 2, 'project_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'gw_port_host': None, '_interfaces': [{'id': 'af736e52-9912-4831-8ff7-ad7483d0377b', 'name': '', 'network_id': 'daea5734-5913-4852-9397-976327c9a9a5', 'tenant_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'mac_address': 'fa:16:3e:61:f3:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '063f888f-d5cc-4fa9-9cf8-e89d461c96f4', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'c450d61f-efe6-49cc-a4ad-7a9243893992', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:23:11Z', 'updated_at': '2021-06-03T08:23:12Z', 'revision_number': 2, 'project_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'subnets': [{'id': 'c450d61f-efe6-49cc-a4ad-7a9243893992', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '7b7fca7c-bc40-4b96-8c01-a510aa308665'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:23:13.991883 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] Checking router: 063f888f-d5cc-4fa9-9cf8-e89d461c96f4 for host: dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:23:13.993458 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] Updating router 063f888f-d5cc-4fa9-9cf8-e89d461c96f4 port af736e52-9912-4831-8ff7-ad7483d0377b binding host dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 03 08:23:14.044609 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:14.440102 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] Notify callbacks [] for port, precommit_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:14.454630 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.provisioning_blocks [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] Transition to ACTIVE for port object af736e52-9912-4831-8ff7-ad7483d0377b will not be triggered until provisioned by entity L2. {{(pid=92326) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:23:14.549853 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:14.557090 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:23:14.729938 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f27ff107-f818-422b-927d-6aa69b1d0ad0 None None] Pushing event updated for resources: {'Port': ['ID=af736e52-9912-4831-8ff7-ad7483d0377b,revision_number=3']} {{(pid=92326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:23:14.776201 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27ff107-f818-422b-927d-6aa69b1d0ad0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:14.776545 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27ff107-f818-422b-927d-6aa69b1d0ad0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:14.776877 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27ff107-f818-422b-927d-6aa69b1d0ad0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:14.777202 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27ff107-f818-422b-927d-6aa69b1d0ad0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:14.777519 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27ff107-f818-422b-927d-6aa69b1d0ad0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:14.777834 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27ff107-f818-422b-927d-6aa69b1d0ad0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:14.778148 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27ff107-f818-422b-927d-6aa69b1d0ad0 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:14.778456 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27ff107-f818-422b-927d-6aa69b1d0ad0 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:14.778794 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27ff107-f818-422b-927d-6aa69b1d0ad0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:14.779101 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27ff107-f818-422b-927d-6aa69b1d0ad0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:14.779407 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27ff107-f818-422b-927d-6aa69b1d0ad0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:14.779710 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27ff107-f818-422b-927d-6aa69b1d0ad0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27ff107-f818-422b-927d-6aa69b1d0ad0 None None] Tracked resource versions report:
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]: pushed versions:
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]: {   'AddressGroup': {'1.2'},
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:     'ConntrackHelper': {'1.0'},
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:     'Log': {'1.0'},
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:     'Network': {'1.1'},
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:     'Port': {'1.7'},
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:     'PortForwarding': {'1.2'},
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:     'QosPolicy': {'1.8'},
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:     'SecurityGroup': {'1.4'},
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:     'SecurityGroupRule': {'1.2'},
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:     'SubPort': {'1.0'},
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:     'Subnet': {'1.1'},
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:     'Trunk': {'1.1'}}
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]: consumer versions:
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]: {   DHCP agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:     L3 agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:     Metadata agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:     Metering agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:     Open vSwitch agent@dv-cinder-787262-5-iscsi: {   'AddressGroup': '1.2',
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:                                                      'ConntrackHelper': '1.0',
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:                                                      'Log': '1.0',
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:                                                      'Network': '1.1',
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:                                                      'Port': '1.7',
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:                                                      'PortForwarding': '1.2',
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:                                                      'QosPolicy': '1.8',
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:                                                      'SecurityGroup': '1.4',
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:                                                      'SecurityGroupRule': '1.2',
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:                                                      'SubPort': '1.0',
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:                                                      'Subnet': '1.1',
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:                                                      'Trunk': '1.1'}}
Jun 03 08:23:14.780738 dv-cinder-787262-5-iscsi neutron-server[92326]:  {{(pid=92326) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 03 08:23:14.791794 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-f27ff107-f818-422b-927d-6aa69b1d0ad0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.235s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:23:14.798651 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] Attempting to bind port af736e52-9912-4831-8ff7-ad7483d0377b on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:23:14.802661 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] Attempting to bind port af736e52-9912-4831-8ff7-ad7483d0377b by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '5c3a6529-0f15-4bb4-abb6-efa295e87d96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': 'daea5734-5913-4852-9397-976327c9a9a5'}] {{(pid=92326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:23:14.802661 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] Attempting to bind port af736e52-9912-4831-8ff7-ad7483d0377b on network daea5734-5913-4852-9397-976327c9a9a5 {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:23:14.804878 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 23, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:23:14.805306 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] Checking segment: {'id': '5c3a6529-0f15-4bb4-abb6-efa295e87d96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': 'daea5734-5913-4852-9397-976327c9a9a5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92326) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:23:14.805727 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:14.806110 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] Bound using segment: {'id': '5c3a6529-0f15-4bb4-abb6-efa295e87d96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': 'daea5734-5913-4852-9397-976327c9a9a5'} {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:23:14.806615 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] Bound port: af736e52-9912-4831-8ff7-ad7483d0377b, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5c3a6529-0f15-4bb4-abb6-efa295e87d96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 542, 'network_id': 'daea5734-5913-4852-9397-976327c9a9a5'}}] {{(pid=92326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:23:14.806981 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:14.894344 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.db [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] For port af736e52-9912-4831-8ff7-ad7483d0377b, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92326) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:23:14.898873 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.db [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] For port af736e52-9912-4831-8ff7-ad7483d0377b, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=af736e52-9912-4831-8ff7-ad7483d0377b,segment=NetworkSegment(5c3a6529-0f15-4bb4-abb6-efa295e87d96),segment_id=5c3a6529-0f15-4bb4-abb6-efa295e87d96)] {{(pid=92326) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:23:14.996256 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:15.000350 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-f27ff107-f818-422b-927d-6aa69b1d0ad0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:23:15.089755 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f27ff107-f818-422b-927d-6aa69b1d0ad0 None None] Pushing event updated for resources: {'Port': ['ID=af736e52-9912-4831-8ff7-ad7483d0377b,revision_number=4']} {{(pid=92326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:23:15.092295 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] Routers {'063f888f-d5cc-4fa9-9cf8-e89d461c96f4'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:23:15.092874 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae87a170a0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:23:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['063f888f-d5cc-4fa9-9cf8-e89d461c96f4'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:23:15.143387 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-f27ff107-f818-422b-927d-6aa69b1d0ad0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:23:15.290056 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] Set router 063f888f-d5cc-4fa9-9cf8-e89d461c96f4 gateway port host: None {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:23:15.636677 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae87a170a0>, [{'id': '063f888f-d5cc-4fa9-9cf8-e89d461c96f4', 'name': 'router1', 'tenant_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:23:00Z', 'updated_at': '2021-06-03T08:23:12Z', 'revision_number': 2, 'project_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'gw_port_host': None, '_interfaces': [{'id': 'af736e52-9912-4831-8ff7-ad7483d0377b', 'name': '', 'network_id': 'daea5734-5913-4852-9397-976327c9a9a5', 'tenant_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'mac_address': 'fa:16:3e:61:f3:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '063f888f-d5cc-4fa9-9cf8-e89d461c96f4', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'c450d61f-efe6-49cc-a4ad-7a9243893992', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:23:11Z', 'updated_at': '2021-06-03T08:23:14Z', 'revision_number': 4, 'project_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'subnets': [{'id': 'c450d61f-efe6-49cc-a4ad-7a9243893992', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '7b7fca7c-bc40-4b96-8c01-a510aa308665'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:23:15.640942 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4825159-5133-41b9-b6f8-08224de7592e None None] The sync data for ids ['063f888f-d5cc-4fa9-9cf8-e89d461c96f4'] in dv-cinder-787262-5-iscsi is: [{'id': '063f888f-d5cc-4fa9-9cf8-e89d461c96f4', 'name': 'router1', 'tenant_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:23:00Z', 'updated_at': '2021-06-03T08:23:12Z', 'revision_number': 2, 'project_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'gw_port_host': None, '_interfaces': [{'id': 'af736e52-9912-4831-8ff7-ad7483d0377b', 'name': '', 'network_id': 'daea5734-5913-4852-9397-976327c9a9a5', 'tenant_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'mac_address': 'fa:16:3e:61:f3:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '063f888f-d5cc-4fa9-9cf8-e89d461c96f4', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'c450d61f-efe6-49cc-a4ad-7a9243893992', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:23:11Z', 'updated_at': '2021-06-03T08:23:14Z', 'revision_number': 4, 'project_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'subnets': [{'id': 'c450d61f-efe6-49cc-a4ad-7a9243893992', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '7b7fca7c-bc40-4b96-8c01-a510aa308665'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:23:15.786635 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 44436) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:23:15.952460 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edd18a29-83e8-43b8-b3b1-7161c6e9b8dc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:23:15.952918 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-edd18a29-83e8-43b8-b3b1-7161c6e9b8dc admin admin] Synchronizing usage tracker for tenant:eac1716175244d3bbd8b430dd3b0d5ff on resource:network {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:23:16.133186 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-edd18a29-83e8-43b8-b3b1-7161c6e9b8dc admin admin] Unset dirty status for tenant:eac1716175244d3bbd8b430dd3b0d5ff on resource:network {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:23:16.134376 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-edd18a29-83e8-43b8-b3b1-7161c6e9b8dc admin admin] 10.222.0.11 "GET /v2.0/networks/684ef871-89aa-450d-ae0d-e232bfaf51fb HTTP/1.1" status: 200  len: 842 time: 0.3467598
Jun 03 08:23:16.143890 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-e84c1207-2a16-4f4f-8421-46720d3e2bd3 admin admin] Request body: {'subnet': {'gateway_ip': '172.27.0.1', 'cidr': '172.27.0.0/24', 'enable_dhcp': False, 'ip_version': 4, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'name': 'public-subnet'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:23:16.154376 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-e84c1207-2a16-4f4f-8421-46720d3e2bd3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:23:16.154376 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-e84c1207-2a16-4f4f-8421-46720d3e2bd3 admin admin] Usage tracker for resource:subnet and tenant:eac1716175244d3bbd8b430dd3b0d5ff is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:23:16.156942 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-e84c1207-2a16-4f4f-8421-46720d3e2bd3 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:23:16.164733 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-e84c1207-2a16-4f4f-8421-46720d3e2bd3 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:23:16.252434 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e84c1207-2a16-4f4f-8421-46720d3e2bd3 admin admin] Made reservation on behalf of eac1716175244d3bbd8b430dd3b0d5ff for: {'subnet': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:23:16.254906 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e84c1207-2a16-4f4f-8421-46720d3e2bd3 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:16.763490 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.objects.ports [None req-e84c1207-2a16-4f4f-8421-46720d3e2bd3 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=92324) get_objects /opt/stack/neutron/neutron/objects/ports.py:443}}
Jun 03 08:23:16.763953 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e84c1207-2a16-4f4f-8421-46720d3e2bd3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829'] for subnet, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:16.768940 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:23:16.854281 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e84c1207-2a16-4f4f-8421-46720d3e2bd3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e7b58fba-1ed5-483b-b341-7736b2ffb853,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:23:16.861268 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e84c1207-2a16-4f4f-8421-46720d3e2bd3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:23:16.873800 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e84c1207-2a16-4f4f-8421-46720d3e2bd3 admin admin] Checking segment: {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:23:16.874283 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e84c1207-2a16-4f4f-8421-46720d3e2bd3 admin admin] Network hostable DHCP agents. Network: 684ef871-89aa-450d-ae0d-e232bfaf51fb, hostable agents: ['07372699-02ac-4239-816f-84b3a5b0eff9'], hosted agents: [] {{(pid=92324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 03 08:23:16.988603 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e84c1207-2a16-4f4f-8421-46720d3e2bd3 admin admin] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb is scheduled to be hosted by DHCP agent 07372699-02ac-4239-816f-84b3a5b0eff9 with binding_index 1 {{(pid=92324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 03 08:23:17.097128 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-e84c1207-2a16-4f4f-8421-46720d3e2bd3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-5-iscsi, 684ef871-89aa-450d-ae0d-e232bfaf51fb) {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:23:17.102757 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e84c1207-2a16-4f4f-8421-46720d3e2bd3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:23:17.103353 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e84c1207-2a16-4f4f-8421-46720d3e2bd3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:17.107653 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3993072b-52ba-46f2-a5e3-32262a87be22 None None] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:23:17.226242 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-e84c1207-2a16-4f4f-8421-46720d3e2bd3 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 821 time: 1.0847721
Jun 03 08:23:17.358652 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24be21d0-e210-456d-8b5c-de4f34b6c772 None None] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:23:19.187789 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device af736e52-9912-4831-8ff7-ad7483d0377b up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:23:19.327109 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port af736e52-9912-4831-8ff7-ad7483d0377b completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:23:19.332476 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port af736e52-9912-4831-8ff7-ad7483d0377b triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:23:19.332849 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:19.481417 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:19.526778 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port af736e52-9912-4831-8ff7-ad7483d0377b, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=af736e52-9912-4831-8ff7-ad7483d0377b,segment=NetworkSegment(5c3a6529-0f15-4bb4-abb6-efa295e87d96),segment_id=5c3a6529-0f15-4bb4-abb6-efa295e87d96)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:23:19.604864 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 44448) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:23:19.618471 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:19.621529 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:23:19.710966 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=af736e52-9912-4831-8ff7-ad7483d0377b,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:23:19.715175 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:23:19.830560 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-d3ce8e75-a4d5-4098-be96-1726c267ab62 admin admin] 10.222.0.11 "GET /v2.0/routers/063f888f-d5cc-4fa9-9cf8-e89d461c96f4 HTTP/1.1" status: 200  len: 710 time: 0.2241998
Jun 03 08:23:19.993679 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-102cd5a9-8d1f-4d03-b8c9-c05b9d069452 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:23:19.994961 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-102cd5a9-8d1f-4d03-b8c9-c05b9d069452 admin admin] 10.222.0.11 "GET /v2.0/networks/684ef871-89aa-450d-ae0d-e232bfaf51fb HTTP/1.1" status: 200  len: 886 time: 0.1582899
Jun 03 08:23:20.003765 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-9164aa4b-be2b-42b3-843e-fbf0cb6538af admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:23:20.462683 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9164aa4b-be2b-42b3-843e-fbf0cb6538af admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-16327803', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-16388116', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2358'] for router, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:20.959509 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9164aa4b-be2b-42b3-843e-fbf0cb6538af admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:21.017737 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9164aa4b-be2b-42b3-843e-fbf0cb6538af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:21.155831 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [None req-9164aa4b-be2b-42b3-843e-fbf0cb6538af admin admin] Allocated IP 172.27.0.225 (684ef871-89aa-450d-ae0d-e232bfaf51fb/e7b58fba-1ed5-483b-b341-7736b2ffb853/55f5e982-1d24-498d-9dc3-3c4c17d3ff7a) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:23:21.171838 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device af736e52-9912-4831-8ff7-ad7483d0377b up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:23:21.253295 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port af736e52-9912-4831-8ff7-ad7483d0377b triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:23:21.253656 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:21.304352 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9164aa4b-be2b-42b3-843e-fbf0cb6538af admin admin] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:21.411652 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9164aa4b-be2b-42b3-843e-fbf0cb6538af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:21.416371 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a4ab0e94-e302-49bd-823b-279e963c355c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:23:21.481658 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9164aa4b-be2b-42b3-843e-fbf0cb6538af admin admin] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:23:21.484416 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-9164aa4b-be2b-42b3-843e-fbf0cb6538af admin admin] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:23:21.487910 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9164aa4b-be2b-42b3-843e-fbf0cb6538af admin admin] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:23:21.542968 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9164aa4b-be2b-42b3-843e-fbf0cb6538af admin admin] Pushing event updated for resources: {'Port': ['ID=55f5e982-1d24-498d-9dc3-3c4c17d3ff7a,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:23:21.555184 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-9164aa4b-be2b-42b3-843e-fbf0cb6538af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:23:21.958815 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9164aa4b-be2b-42b3-843e-fbf0cb6538af admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:22.346036 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9164aa4b-be2b-42b3-843e-fbf0cb6538af admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-16327803', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-16388116', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2358'] for router, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:22.349964 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9164aa4b-be2b-42b3-843e-fbf0cb6538af admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-16327774', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-16327756', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-16327765', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-16388125'] for router, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:22.529145 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9164aa4b-be2b-42b3-843e-fbf0cb6538af admin admin] Router 063f888f-d5cc-4fa9-9cf8-e89d461c96f4 has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:23:22.712220 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9164aa4b-be2b-42b3-843e-fbf0cb6538af admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:23:22.720322 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9164aa4b-be2b-42b3-843e-fbf0cb6538af admin admin] Notify callbacks [] for router, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:22.721515 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-9164aa4b-be2b-42b3-843e-fbf0cb6538af admin admin] 10.222.0.11 "PUT /v2.0/routers/063f888f-d5cc-4fa9-9cf8-e89d461c96f4 HTTP/1.1" status: 200  len: 890 time: 2.7209904
Jun 03 08:23:22.722678 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] Sync routers for ids ['063f888f-d5cc-4fa9-9cf8-e89d461c96f4'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:23:22.734906 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] Routers {'063f888f-d5cc-4fa9-9cf8-e89d461c96f4'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:23:22.735589 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86efa280>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:23:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['063f888f-d5cc-4fa9-9cf8-e89d461c96f4'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:23:22.935793 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] Set router 063f888f-d5cc-4fa9-9cf8-e89d461c96f4 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:23:23.327484 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86efa280>, [{'id': '063f888f-d5cc-4fa9-9cf8-e89d461c96f4', 'name': 'router1', 'tenant_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.225'}], 'enable_snat': True}, 'gw_port_id': '55f5e982-1d24-498d-9dc3-3c4c17d3ff7a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:23:00Z', 'updated_at': '2021-06-03T08:23:21Z', 'revision_number': 4, 'project_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'gw_port': {'id': '55f5e982-1d24-498d-9dc3-3c4c17d3ff7a', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:76:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '063f888f-d5cc-4fa9-9cf8-e89d461c96f4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:23:21Z', 'updated_at': '2021-06-03T08:23:21Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': 'af736e52-9912-4831-8ff7-ad7483d0377b', 'name': '', 'network_id': 'daea5734-5913-4852-9397-976327c9a9a5', 'tenant_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'mac_address': 'fa:16:3e:61:f3:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '063f888f-d5cc-4fa9-9cf8-e89d461c96f4', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'c450d61f-efe6-49cc-a4ad-7a9243893992', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:23:11Z', 'updated_at': '2021-06-03T08:23:19Z', 'revision_number': 5, 'project_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'subnets': [{'id': 'c450d61f-efe6-49cc-a4ad-7a9243893992', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '7b7fca7c-bc40-4b96-8c01-a510aa308665'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:23:23.332477 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] Checking router: 063f888f-d5cc-4fa9-9cf8-e89d461c96f4 for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:23:23.332831 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] Updating router 063f888f-d5cc-4fa9-9cf8-e89d461c96f4 port 55f5e982-1d24-498d-9dc3-3c4c17d3ff7a binding host dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 03 08:23:23.395563 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:23.755417 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] Notify callbacks [] for port, precommit_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:23.766722 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] Transition to ACTIVE for port object 55f5e982-1d24-498d-9dc3-3c4c17d3ff7a will not be triggered until provisioned by entity L2. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:23:23.841055 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:23.845134 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:23:23.922219 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] Attempting to bind port 55f5e982-1d24-498d-9dc3-3c4c17d3ff7a on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:23:23.922619 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] Attempting to bind port 55f5e982-1d24-498d-9dc3-3c4c17d3ff7a by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:23:23.922985 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] Attempting to bind port 55f5e982-1d24-498d-9dc3-3c4c17d3ff7a on network 684ef871-89aa-450d-ae0d-e232bfaf51fb {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:23:23.926267 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b62912f7-df93-4d48-bf58-7f37b4469fb2 None None] Pushing event updated for resources: {'Port': ['ID=55f5e982-1d24-498d-9dc3-3c4c17d3ff7a,revision_number=2']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:23:23.931330 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-b62912f7-df93-4d48-bf58-7f37b4469fb2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:23:23.932074 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 23, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:23:23.932450 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] Checking segment: {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:23:23.932850 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:23.933231 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] Bound using segment: {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:23:23.933709 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] Bound port: 55f5e982-1d24-498d-9dc3-3c4c17d3ff7a, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:23:23.934065 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:24.012995 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] For port 55f5e982-1d24-498d-9dc3-3c4c17d3ff7a, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:23:24.016015 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] For port 55f5e982-1d24-498d-9dc3-3c4c17d3ff7a, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=55f5e982-1d24-498d-9dc3-3c4c17d3ff7a,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:23:24.121986 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:24.127367 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:23:24.197933 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] Routers {'063f888f-d5cc-4fa9-9cf8-e89d461c96f4'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:23:24.198566 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86efa280>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:23:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['063f888f-d5cc-4fa9-9cf8-e89d461c96f4'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:23:24.263375 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b62912f7-df93-4d48-bf58-7f37b4469fb2 None None] Pushing event updated for resources: {'Port': ['ID=55f5e982-1d24-498d-9dc3-3c4c17d3ff7a,revision_number=3']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:23:24.267708 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-b62912f7-df93-4d48-bf58-7f37b4469fb2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:23:24.326044 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 5 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:23:24.390531 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] Set router 063f888f-d5cc-4fa9-9cf8-e89d461c96f4 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:23:24.741393 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86efa280>, [{'id': '063f888f-d5cc-4fa9-9cf8-e89d461c96f4', 'name': 'router1', 'tenant_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.225'}], 'enable_snat': True}, 'gw_port_id': '55f5e982-1d24-498d-9dc3-3c4c17d3ff7a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:23:00Z', 'updated_at': '2021-06-03T08:23:21Z', 'revision_number': 4, 'project_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'gw_port': {'id': '55f5e982-1d24-498d-9dc3-3c4c17d3ff7a', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:76:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '063f888f-d5cc-4fa9-9cf8-e89d461c96f4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:23:21Z', 'updated_at': '2021-06-03T08:23:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': 'af736e52-9912-4831-8ff7-ad7483d0377b', 'name': '', 'network_id': 'daea5734-5913-4852-9397-976327c9a9a5', 'tenant_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'mac_address': 'fa:16:3e:61:f3:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '063f888f-d5cc-4fa9-9cf8-e89d461c96f4', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'c450d61f-efe6-49cc-a4ad-7a9243893992', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:23:11Z', 'updated_at': '2021-06-03T08:23:19Z', 'revision_number': 5, 'project_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'subnets': [{'id': 'c450d61f-efe6-49cc-a4ad-7a9243893992', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '7b7fca7c-bc40-4b96-8c01-a510aa308665'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:23:24.747451 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13ca7cb2-4f89-436c-ab63-b960ba5f3eb0 None None] The sync data for ids ['063f888f-d5cc-4fa9-9cf8-e89d461c96f4'] in dv-cinder-787262-5-iscsi is: [{'id': '063f888f-d5cc-4fa9-9cf8-e89d461c96f4', 'name': 'router1', 'tenant_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.225'}], 'enable_snat': True}, 'gw_port_id': '55f5e982-1d24-498d-9dc3-3c4c17d3ff7a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:23:00Z', 'updated_at': '2021-06-03T08:23:21Z', 'revision_number': 4, 'project_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'gw_port': {'id': '55f5e982-1d24-498d-9dc3-3c4c17d3ff7a', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:76:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '063f888f-d5cc-4fa9-9cf8-e89d461c96f4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:23:21Z', 'updated_at': '2021-06-03T08:23:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': 'af736e52-9912-4831-8ff7-ad7483d0377b', 'name': '', 'network_id': 'daea5734-5913-4852-9397-976327c9a9a5', 'tenant_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'mac_address': 'fa:16:3e:61:f3:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '063f888f-d5cc-4fa9-9cf8-e89d461c96f4', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'c450d61f-efe6-49cc-a4ad-7a9243893992', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:23:11Z', 'updated_at': '2021-06-03T08:23:19Z', 'revision_number': 5, 'project_id': 'f6a03babd1d14e1d9d9d4a6dddc18883', 'subnets': [{'id': 'c450d61f-efe6-49cc-a4ad-7a9243893992', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '7b7fca7c-bc40-4b96-8c01-a510aa308665'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:23:25.215305 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 55f5e982-1d24-498d-9dc3-3c4c17d3ff7a up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:23:25.222010 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 44456) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:23:25.341398 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-2563eb7d-957b-4da3-87e5-6428f26b94e9 admin admin] 10.222.0.11 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200  len: 411 time: 0.1181977
Jun 03 08:23:25.458555 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port 55f5e982-1d24-498d-9dc3-3c4c17d3ff7a completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:23:25.464503 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 55f5e982-1d24-498d-9dc3-3c4c17d3ff7a triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:23:25.464874 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:25.605775 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:25.622600 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port 55f5e982-1d24-498d-9dc3-3c4c17d3ff7a, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=55f5e982-1d24-498d-9dc3-3c4c17d3ff7a,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:23:25.680304 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:25.682433 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:23:25.755382 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=55f5e982-1d24-498d-9dc3-3c4c17d3ff7a,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:23:25.760059 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:23:27.206913 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 55f5e982-1d24-498d-9dc3-3c4c17d3ff7a up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:23:27.307244 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 55f5e982-1d24-498d-9dc3-3c4c17d3ff7a triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:23:27.307778 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:32.519690 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-43a6ccdc-4f76-414b-9cd8-2def96943b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:34.806637 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:35.281256 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-18c571ef-a6d2-43dc-90a8-f3d665a2acfd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:36.132736 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:23:37.937996 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:24:01.327600 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 5 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:24:02.554919 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-f233ab62-dc94-48fc-8449-bf025ac79cf3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:24:04.827747 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:24:05.246034 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-3e1c61e5-a60e-4a24-a04e-eae90f6f5c0a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:24:06.314973 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:24:07.948515 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:24:32.514527 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-7cde8c40-d14f-442e-824c-b2ce2bc5f449 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:24:34.792440 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:24:35.269164 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-42a53d41-000b-4e4b-86f8-96bd2e22c2fe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:24:36.165637 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:24:37.993814 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:24:38.327579 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 5 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:25:02.500468 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-75327bfa-53a0-48e2-ae95-e4ca1a11326b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:04.359133 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 45024) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:25:04.433082 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.pecan_wsgi.hooks.translation [None req-c755b5cd-8ce6-40d0-8ccc-344b140ecf0a admin admin] GET failed (client error): The resource could not be found.
Jun 03 08:25:04.434334 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-c755b5cd-8ce6-40d0-8ccc-344b140ecf0a admin admin] 10.222.0.11 "GET /v2.0/networks/private HTTP/1.1" status: 404  len: 315 time: 0.0739768
Jun 03 08:25:04.578034 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f87b890-d86e-4093-9ea9-ebc678f45c9e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:25:04.579502 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-3f87b890-d86e-4093-9ea9-ebc678f45c9e admin admin] 10.222.0.11 "GET /v2.0/networks?name=private HTTP/1.1" status: 200  len: 872 time: 0.1412838
Jun 03 08:25:04.839546 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:05.317589 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-8f9744d2-7fde-4879-a279-45e353b7cb5c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:06.160303 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:06.723761 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 45034) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:25:06.864959 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e91c144d-cfb0-4ba3-bc1d-364994b0eb1f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:25:06.865538 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-e91c144d-cfb0-4ba3-bc1d-364994b0eb1f admin admin] Synchronizing usage tracker for tenant:eac1716175244d3bbd8b430dd3b0d5ff on resource:subnet {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:25:07.003178 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-e91c144d-cfb0-4ba3-bc1d-364994b0eb1f admin admin] Unset dirty status for tenant:eac1716175244d3bbd8b430dd3b0d5ff on resource:subnet {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:25:07.004280 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-e91c144d-cfb0-4ba3-bc1d-364994b0eb1f admin admin] 10.222.0.11 "GET /v2.0/subnets/c450d61f-efe6-49cc-a4ad-7a9243893992 HTTP/1.1" status: 200  len: 849 time: 0.2795463
Jun 03 08:25:07.013394 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-3dc76132-0b4a-454d-96f1-00896dc04d69 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:25:07.135413 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-3dc76132-0b4a-454d-96f1-00896dc04d69 admin admin] Notify callbacks [] for subnet, before_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:07.394214 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-3dc76132-0b4a-454d-96f1-00896dc04d69 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8774224329530'] for subnet, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:07.398133 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-bffaed80-597f-43b8-9f44-cc1e28a88440 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:25:07.438647 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3dc76132-0b4a-454d-96f1-00896dc04d69 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:25:07.440147 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-3dc76132-0b4a-454d-96f1-00896dc04d69 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:07.442136 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-3dc76132-0b4a-454d-96f1-00896dc04d69 admin admin] 10.222.0.11 "PUT /v2.0/subnets/c450d61f-efe6-49cc-a4ad-7a9243893992 HTTP/1.1" status: 200  len: 868 time: 0.4320540
Jun 03 08:25:07.459571 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f5a9b634-0d1e-40bb-9b06-f1913ae14bf9 None None] Network daea5734-5913-4852-9397-976327c9a9a5 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:25:07.475451 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dc76132-0b4a-454d-96f1-00896dc04d69 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c450d61f-efe6-49cc-a4ad-7a9243893992,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:25:07.483139 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc76132-0b4a-454d-96f1-00896dc04d69 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:07.483491 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc76132-0b4a-454d-96f1-00896dc04d69 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:07.483834 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc76132-0b4a-454d-96f1-00896dc04d69 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:07.484162 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc76132-0b4a-454d-96f1-00896dc04d69 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:07.484489 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc76132-0b4a-454d-96f1-00896dc04d69 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:07.484853 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc76132-0b4a-454d-96f1-00896dc04d69 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:07.485309 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc76132-0b4a-454d-96f1-00896dc04d69 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:07.485642 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc76132-0b4a-454d-96f1-00896dc04d69 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:07.485974 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc76132-0b4a-454d-96f1-00896dc04d69 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:07.486766 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc76132-0b4a-454d-96f1-00896dc04d69 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:07.487216 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc76132-0b4a-454d-96f1-00896dc04d69 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:07.487544 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3dc76132-0b4a-454d-96f1-00896dc04d69 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:07.491130 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-3dc76132-0b4a-454d-96f1-00896dc04d69 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:25:07.902847 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-308fda91-ace0-49ec-b50d-cb7b4893a92b None None] Provisioning complete for port b3d30033-c310-4303-b919-e1c393b3fb7d triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:25:07.903227 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-308fda91-ace0-49ec-b50d-cb7b4893a92b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:07.939552 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:08.033366 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-308fda91-ace0-49ec-b50d-cb7b4893a92b None None] Provisioning complete for port af736e52-9912-4831-8ff7-ad7483d0377b triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:25:08.033738 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-308fda91-ace0-49ec-b50d-cb7b4893a92b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:09.583379 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 45042) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:25:09.760880 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b94f372-df2a-4c18-9edb-2c6e69477ffb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:25:09.761280 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b94f372-df2a-4c18-9edb-2c6e69477ffb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:25:09.762875 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-8b94f372-df2a-4c18-9edb-2c6e69477ffb admin admin] 10.222.0.11 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.1785643
Jun 03 08:25:11.907368 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 45052) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:25:12.084492 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47c54514-fc30-4666-a9d9-f819f788e8f2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:25:12.084878 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47c54514-fc30-4666-a9d9-f819f788e8f2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:25:12.086393 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-47c54514-fc30-4666-a9d9-f819f788e8f2 admin admin] 10.222.0.11 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.1775384
Jun 03 08:25:14.240739 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 45060) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:25:14.411290 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cfbefa7f-04c5-45e0-a332-a8df3a235699 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:25:14.412566 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-cfbefa7f-04c5-45e0-a332-a8df3a235699 admin admin] 10.222.0.11 "GET /v2.0/networks/684ef871-89aa-450d-ae0d-e232bfaf51fb HTTP/1.1" status: 200  len: 886 time: 0.1708579
Jun 03 08:25:15.326900 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 5 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:25:16.627413 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 45068) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:25:16.803576 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b89e9bfe-e014-475e-b314-0597e992be8f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:25:16.804917 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-b89e9bfe-e014-475e-b314-0597e992be8f admin admin] 10.222.0.11 "GET /v2.0/networks/daea5734-5913-4852-9397-976327c9a9a5 HTTP/1.1" status: 200  len: 869 time: 0.1764882
Jun 03 08:25:18.975096 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 45076) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:25:19.093382 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40f3e291-e32a-47e5-8442-ba80ac64bea0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:25:19.093846 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40f3e291-e32a-47e5-8442-ba80ac64bea0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:25:19.096528 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-40f3e291-e32a-47e5-8442-ba80ac64bea0 admin admin] 10.222.0.11 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1204829
Jun 03 08:25:21.204943 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 45084) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:25:21.314371 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6a15ddb9-b0fd-463e-af8c-61021f2d04fc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:25:21.314896 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6a15ddb9-b0fd-463e-af8c-61021f2d04fc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:25:21.316670 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-6a15ddb9-b0fd-463e-af8c-61021f2d04fc admin admin] 10.222.0.11 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1106913
Jun 03 08:25:23.443999 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 45092) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:25:23.546894 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6401d57b-f74a-423f-a223-54aabd26b205 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:25:23.548767 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-6401d57b-f74a-423f-a223-54aabd26b205 admin admin] 10.222.0.11 "GET /v2.0/subnets/c450d61f-efe6-49cc-a4ad-7a9243893992 HTTP/1.1" status: 200  len: 868 time: 0.1037807
Jun 03 08:25:25.714816 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 45100) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:25:25.815690 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f332e3fb-3f58-4619-90de-6575cf2729e5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:25:25.817004 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-f332e3fb-3f58-4619-90de-6575cf2729e5 admin admin] 10.222.0.11 "GET /v2.0/subnets/e7b58fba-1ed5-483b-b341-7736b2ffb853 HTTP/1.1" status: 200  len: 816 time: 0.1012657
Jun 03 08:25:32.604724 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-46feb3a6-c381-4aa5-994e-ad927a07fba3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:34.775903 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:35.259715 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-65839185-533b-484a-9f85-14aca9a89c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:36.153550 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:38.193133 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:49.312418 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 45144) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:25:49.361316 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [None req-2c10fee0-e84b-4606-8545-5eba5f6febb5 admin admin] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=92324) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 03 08:25:49.367413 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-2c10fee0-e84b-4606-8545-5eba5f6febb5 admin admin] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0487633
Jun 03 08:25:51.579856 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 45152) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:25:51.646600 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.pecan_wsgi.hooks.translation [None req-1d3b22dd-1f84-407f-8509-8870409a6107 admin admin] GET failed (client error): The resource could not be found.
Jun 03 08:25:51.647841 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-1d3b22dd-1f84-407f-8509-8870409a6107 admin admin] 10.222.0.11 "GET /v2.0/networks/public HTTP/1.1" status: 404  len: 314 time: 0.0670295
Jun 03 08:25:51.782386 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90cf4cf4-8648-491e-be44-355e56fe857c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:25:51.783854 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-90cf4cf4-8648-491e-be44-355e56fe857c admin admin] 10.222.0.11 "GET /v2.0/networks?name=public HTTP/1.1" status: 200  len: 889 time: 0.1322277
Jun 03 08:25:52.325391 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 5 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:25:53.977479 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 45160) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:25:54.024423 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Request body: {'network': {'shared': True, 'admin_state_up': True, 'name': 'shared'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:25:54.025577 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.quota [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7fae85e421c0>.
Jun 03 08:25:54.032821 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:25:54.043524 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:25:54.127619 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Made reservation on behalf of eac1716175244d3bbd8b430dd3b0d5ff for: {'network': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:25:54.132193 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-676039'] for network, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:54.224179 dv-cinder-787262-5-iscsi neutron-server[92323]: WARNING neutron.services.revisions.revision_plugin [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Could not find related network for resource <neutron.db.rbac_db_models.NetworkRBAC[object at 7fae85c9f700] {project_id='eac1716175244d3bbd8b430dd3b0d5ff', id='e31aa26a-0867-4489-b3d0-f82288ac814e', target_tenant='*', action='access_as_shared', object_id='ab8445d9-ca0f-4f8d-a3a6-879278f29bef'}> to bump revision.
Jun 03 08:25:54.239024 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] vlan segment allocate from pool success with {'vlan_id': 520, 'physical_network': 'physnet1'}  {{(pid=92323) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 03 08:25:54.249318 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8774224358849', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:54.249912 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7fae886adc10> segment precommit_create {{(pid=92323) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
Jun 03 08:25:54.250448 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.db.segments_db [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Added segment 3ec38b89-b78f-4968-8e7e-3fd7750417e4 of type vlan for network ab8445d9-ca0f-4f8d-a3a6-879278f29bef
Jun 03 08:25:54.318432 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8774223827658'] for network, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:54.592909 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820'] for network, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:54.594227 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:25:54.594870 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:54.599429 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:25:54.743021 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Pushing event updated for resources: {'Network': ['ID=ab8445d9-ca0f-4f8d-a3a6-879278f29bef,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:25:54.750453 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:54.750836 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:54.751147 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:54.751472 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:54.752937 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:54.753258 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:54.753576 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:54.753890 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:54.754219 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:54.754561 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:54.754873 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:54.755181 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:54.759007 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:25:54.770809 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Network ab8445d9-ca0f-4f8d-a3a6-879278f29bef details requested by agent ovs-agent-dv-cinder-787262-5-iscsi with host dv-cinder-787262-5-iscsi {{(pid=92325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 03 08:25:54.822235 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 0.8436773
Jun 03 08:25:56.946805 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 45168) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:25:57.012453 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.pecan_wsgi.hooks.translation [None req-973bb2a2-03bf-4dbc-9d29-af37860db217 admin admin] GET failed (client error): The resource could not be found.
Jun 03 08:25:57.013006 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-973bb2a2-03bf-4dbc-9d29-af37860db217 admin admin] Synchronizing usage tracker for tenant:eac1716175244d3bbd8b430dd3b0d5ff on resource:network {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:25:57.084242 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-973bb2a2-03bf-4dbc-9d29-af37860db217 admin admin] Unset dirty status for tenant:eac1716175244d3bbd8b430dd3b0d5ff on resource:network {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:25:57.085422 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-973bb2a2-03bf-4dbc-9d29-af37860db217 admin admin] 10.222.0.11 "GET /v2.0/networks/shared HTTP/1.1" status: 404  len: 314 time: 0.1376657
Jun 03 08:25:57.194845 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae091b13-c6bf-43a6-a98d-91cfd83045c0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:25:57.196299 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-ae091b13-c6bf-43a6-a98d-91cfd83045c0 admin admin] 10.222.0.11 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200  len: 826 time: 0.1068029
Jun 03 08:25:57.207292 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-39764d03-77a8-4bd1-b500-91a86b42395f admin admin] Request body: {'subnet': {'cidr': '192.168.233.0/24', 'ip_version': 4, 'description': 'shared-subnet', 'name': 'shared-subnet', 'network_id': 'ab8445d9-ca0f-4f8d-a3a6-879278f29bef'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:25:57.211841 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-39764d03-77a8-4bd1-b500-91a86b42395f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:25:57.222171 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-39764d03-77a8-4bd1-b500-91a86b42395f admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:25:57.281989 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-39764d03-77a8-4bd1-b500-91a86b42395f admin admin] Made reservation on behalf of eac1716175244d3bbd8b430dd3b0d5ff for: {'subnet': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:25:57.284382 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-39764d03-77a8-4bd1-b500-91a86b42395f admin admin] Notify callbacks [] for subnet, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:57.733783 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-39764d03-77a8-4bd1-b500-91a86b42395f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829'] for subnet, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:57.738856 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:25:57.806340 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39764d03-77a8-4bd1-b500-91a86b42395f admin admin] Pushing event updated for resources: {'Subnet': ['ID=88f9612e-eb31-4bd0-847f-97b1f6d84cd0,revision_number=0']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:25:57.813202 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-39764d03-77a8-4bd1-b500-91a86b42395f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:25:57.815933 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39764d03-77a8-4bd1-b500-91a86b42395f admin admin] Checking segment: {'id': '3ec38b89-b78f-4968-8e7e-3fd7750417e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 520, 'network_id': 'ab8445d9-ca0f-4f8d-a3a6-879278f29bef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:25:57.816294 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-39764d03-77a8-4bd1-b500-91a86b42395f admin admin] Network hostable DHCP agents. Network: ab8445d9-ca0f-4f8d-a3a6-879278f29bef, hostable agents: ['07372699-02ac-4239-816f-84b3a5b0eff9'], hosted agents: [] {{(pid=92323) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 03 08:25:57.893099 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-39764d03-77a8-4bd1-b500-91a86b42395f admin admin] Network ab8445d9-ca0f-4f8d-a3a6-879278f29bef is scheduled to be hosted by DHCP agent 07372699-02ac-4239-816f-84b3a5b0eff9 with binding_index 1 {{(pid=92323) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 03 08:25:57.973219 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-39764d03-77a8-4bd1-b500-91a86b42395f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-5-iscsi, ab8445d9-ca0f-4f8d-a3a6-879278f29bef) {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:25:57.977334 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39764d03-77a8-4bd1-b500-91a86b42395f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:25:57.977961 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-39764d03-77a8-4bd1-b500-91a86b42395f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:57.983990 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cfd5814b-f863-42b5-89fb-69c8a5f62cf5 None None] Network ab8445d9-ca0f-4f8d-a3a6-879278f29bef requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:25:58.048751 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-39764d03-77a8-4bd1-b500-91a86b42395f admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.8449039
Jun 03 08:25:58.212387 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp3789a88e-0f76-536c-9507-4ab4ace56879-ab8445d9-ca0f-4f8d-a3a6-879278f29bef', 'network_id': 'ab8445d9-ca0f-4f8d-a3a6-879278f29bef', 'tenant_id': 'eac1716175244d3bbd8b430dd3b0d5ff', 'fixed_ips': [{'subnet_id': '88f9612e-eb31-4bd0-847f-97b1f6d84cd0'}]}} from dv-cinder-787262-5-iscsi. {{(pid=92325) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 03 08:25:58.213256 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:58.437608 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.db_base_plugin_common [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Allocated IP 192.168.233.2 (ab8445d9-ca0f-4f8d-a3a6-879278f29bef/88f9612e-eb31-4bd0-847f-97b1f6d84cd0/b92d1bab-aeb9-4109-876d-ef6acc3ce005) {{(pid=92325) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:25:58.702278 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Notify callbacks [] for port, precommit_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:58.713198 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Transition to ACTIVE for port object b92d1bab-aeb9-4109-876d-ef6acc3ce005 will not be triggered until provisioned by entity L2. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:25:58.731347 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Transition to ACTIVE for port object b92d1bab-aeb9-4109-876d-ef6acc3ce005 will not be triggered until provisioned by entity DHCP. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:25:58.782232 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:58.787840 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-b62912f7-df93-4d48-bf58-7f37b4469fb2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:25:58.852125 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Network ab8445d9-ca0f-4f8d-a3a6-879278f29bef is already hosted by enough agents. {{(pid=92325) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:25:58.855294 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.scheduler.base_scheduler [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Resources bound (agent type, host, resource id):  {{(pid=92325) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:25:58.859831 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Received port after_create {{(pid=92325) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:25:58.899463 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Pushing event updated for resources: {'Port': ['ID=b92d1bab-aeb9-4109-876d-ef6acc3ce005,revision_number=1']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:25:58.942798 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:58.943158 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:58.943467 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:58.943798 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:58.944117 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:58.944432 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:58.944745 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:58.945058 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:58.945386 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:58.945712 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:58.946013 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:58.946318 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:25:58.954777 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:25:58.970514 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Attempting to bind port b92d1bab-aeb9-4109-876d-ef6acc3ce005 on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:25:58.970890 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Attempting to bind port b92d1bab-aeb9-4109-876d-ef6acc3ce005 by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '3ec38b89-b78f-4968-8e7e-3fd7750417e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 520, 'network_id': 'ab8445d9-ca0f-4f8d-a3a6-879278f29bef'}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:25:58.971247 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Attempting to bind port b92d1bab-aeb9-4109-876d-ef6acc3ce005 on network ab8445d9-ca0f-4f8d-a3a6-879278f29bef {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:25:58.976709 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 25, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:25:58.977081 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Checking segment: {'id': '3ec38b89-b78f-4968-8e7e-3fd7750417e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 520, 'network_id': 'ab8445d9-ca0f-4f8d-a3a6-879278f29bef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:25:58.977472 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:58.977854 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Bound using segment: {'id': '3ec38b89-b78f-4968-8e7e-3fd7750417e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 520, 'network_id': 'ab8445d9-ca0f-4f8d-a3a6-879278f29bef'} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:25:58.978311 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Bound port: b92d1bab-aeb9-4109-876d-ef6acc3ce005, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3ec38b89-b78f-4968-8e7e-3fd7750417e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 520, 'network_id': 'ab8445d9-ca0f-4f8d-a3a6-879278f29bef'}}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:25:58.978699 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:59.065562 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] For port b92d1bab-aeb9-4109-876d-ef6acc3ce005, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:25:59.068623 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] For port b92d1bab-aeb9-4109-876d-ef6acc3ce005, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=b92d1bab-aeb9-4109-876d-ef6acc3ce005,segment=NetworkSegment(3ec38b89-b78f-4968-8e7e-3fd7750417e4),segment_id=3ec38b89-b78f-4968-8e7e-3fd7750417e4)] {{(pid=92325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:25:59.147879 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:25:59.152004 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:25:59.231639 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Pushing event updated for resources: {'Port': ['ID=b92d1bab-aeb9-4109-876d-ef6acc3ce005,revision_number=2']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:25:59.239359 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:26:00.040571 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d94cf64-09a0-41eb-98f0-ca1605b6ff31 None None] Network ab8445d9-ca0f-4f8d-a3a6-879278f29bef requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:26:00.288101 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-a7293bd9-3df8-4f65-b051-b18d3a2cf74e None None] Provisioning for port b92d1bab-aeb9-4109-876d-ef6acc3ce005 completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:26:01.321226 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device b92d1bab-aeb9-4109-876d-ef6acc3ce005 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:26:01.518603 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port b92d1bab-aeb9-4109-876d-ef6acc3ce005 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:26:01.518603 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port b92d1bab-aeb9-4109-876d-ef6acc3ce005 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:26:01.518603 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:26:01.636128 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:26:01.670419 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port b92d1bab-aeb9-4109-876d-ef6acc3ce005, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=b92d1bab-aeb9-4109-876d-ef6acc3ce005,segment=NetworkSegment(3ec38b89-b78f-4968-8e7e-3fd7750417e4),segment_id=3ec38b89-b78f-4968-8e7e-3fd7750417e4)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:26:01.739224 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:26:01.742508 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-4179d9f0-290d-4fd9-b6c4-f6ced25207b8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:26:01.807705 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=b92d1bab-aeb9-4109-876d-ef6acc3ce005,revision_number=3']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:26:01.810891 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:26:02.513040 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-a2164b6e-35a5-44c0-b9a3-8bbd025e140f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:26:03.302552 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device b92d1bab-aeb9-4109-876d-ef6acc3ce005 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:26:03.376209 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port b92d1bab-aeb9-4109-876d-ef6acc3ce005 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:26:03.376634 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:26:04.815707 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:26:05.276397 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-e9cd6061-5dc1-466a-b4bf-bfe5c4b75323 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:26:06.175468 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:26:07.946900 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:26:29.324975 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 5 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:26:32.494933 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-d7fec190-42f5-4aee-a42e-fa56debecd4f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:26:34.837682 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:26:35.229516 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-691efc79-b854-4e70-8c0d-4660166b43a3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:26:36.172553 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:26:37.946586 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:27:02.500791 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-a7d32a0b-5606-4e7b-a7f9-9c29a49b3847 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:27:04.772478 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:27:05.232303 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-ba754eba-1905-45ee-b682-c2907e08d511 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:27:06.169592 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:27:06.322876 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 5 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:27:07.937801 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:27:16.385622 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 45222) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:27:16.392885 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [None req-05149d62-e470-44aa-99ad-430fb08de91c tempest-verify_tempest_config-1019607725 tempest-verify_tempest_config-1019607725-project] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=92324) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 03 08:27:16.393839 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-05149d62-e470-44aa-99ad-430fb08de91c tempest-verify_tempest_config-1019607725 tempest-verify_tempest_config-1019607725-project] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13635 time: 0.0072396
Jun 03 08:27:17.013939 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 45240) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:27:17.143344 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:27:17.159382 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:27:17.163295 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Usage tracker for resource:security_group_rule and tenant:cf2052fd46324dcfb44d66704f49f5f9 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:27:17.166031 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:27:17.172551 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:27:17.253153 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:27:17.346259 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:27:17.353949 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:27:17.397762 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Synchronizing usage tracker for tenant:eac1716175244d3bbd8b430dd3b0d5ff on resource:security_group {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:27:17.400031 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2a45a09e-6699-4ea3-9966-ed8cf5851d88,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:27:17.409690 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:27:17.410056 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:27:17.410410 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:27:17.410767 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:27:17.411111 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:27:17.411450 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:27:17.411775 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:27:17.412094 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:27:17.412424 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:27:17.412742 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:27:17.413052 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:27:17.413361 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:27:17.418363 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:27:17.534765 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Unset dirty status for tenant:eac1716175244d3bbd8b430dd3b0d5ff on resource:security_group {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:27:17.536317 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=cf2052fd46324dcfb44d66704f49f5f9&name=default HTTP/1.1" status: 200  len: 2975 time: 0.5212221
Jun 03 08:27:17.539239 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 45244) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:27:17.599489 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-19524a0b-e832-4b5c-a5d9-07a7977e85a0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:27:17.623949 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-19524a0b-e832-4b5c-a5d9-07a7977e85a0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:27:17.803302 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-19524a0b-e832-4b5c-a5d9-07a7977e85a0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:27:17.807239 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:27:17.820418 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19524a0b-e832-4b5c-a5d9-07a7977e85a0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2a45a09e-6699-4ea3-9966-ed8cf5851d88,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:27:17.826478 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-19524a0b-e832-4b5c-a5d9-07a7977e85a0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:27:17.826898 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-19524a0b-e832-4b5c-a5d9-07a7977e85a0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:27:17.828380 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-19524a0b-e832-4b5c-a5d9-07a7977e85a0 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/2a45a09e-6699-4ea3-9966-ed8cf5851d88 HTTP/1.1" status: 204  len: 168 time: 0.2881365
Jun 03 08:27:32.545810 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-d427aff1-2fe5-4c19-a1c3-aacf503bda55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:27:34.814617 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:27:35.237104 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-aeabcf3c-f287-4323-bd8b-7be37b75500a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:27:36.161465 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:27:37.954441 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:27:43.321846 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 5 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:28:02.494265 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-edc290e1-7503-4229-8381-3ae51291d560 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:28:04.808905 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:28:05.278065 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-acda59c0-44c8-44a3-9e46-d3d601b5746a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:28:06.159567 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:28:07.957031 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:28:20.320877 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 5 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:28:32.493614 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5bfed758-4441-47e9-a3c6-a6951aa43abf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:28:34.822185 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:28:35.227610 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-63f99e21-d622-4ba1-896c-e7189d626666 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:28:36.210792 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:28:37.999116 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:28:56.007572 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534'] for agent, after_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:28:57.320002 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:29:00.286361 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 45296) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:29:00.397736 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-fc3d18f1-19f0-4f37-8649-f806fcdc769e admin admin] 10.222.0.11 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.1102684
Jun 03 08:29:02.501776 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-69035d06-9316-46b1-9be1-e8fcf975e51d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:29:02.530664 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 45306) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:29:02.586796 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-03b1bb15-d197-4740-a8cf-ce4905c968ce admin admin] 10.222.0.11 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.0550473
Jun 03 08:29:04.819222 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:29:05.236445 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5ad9fb22-23b4-4628-921e-f188adba12b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:29:06.187617 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:29:07.962378 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:29:26.038652 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:29:32.487535 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-a0081751-19ea-428c-8db6-b0d2da4c3fca None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:29:34.320319 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:29:34.811085 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:29:35.232802 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-32ada1ae-dd6e-4b0e-bcc7-5f610aa9dd85 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:29:36.192636 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:29:37.957972 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:29:56.030315 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:02.492771 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-95763322-9626-4a10-9d91-0dd0ec694829 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:04.809613 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:05.232608 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-f5a1aee3-4f82-48b5-98b2-428758c7a1d0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:06.169127 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:07.972675 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:11.319890 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:30:26.201633 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:32.506232 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-51346a8a-9c90-4079-a0a6-69bcbe0f704e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:33.733686 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 45524) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:33.927761 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 45538) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:33.929069 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 45540) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:34.236021 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-2136845645-network', 'tenant_id': '7bac6d994f4d49b292bc39fac07c0311'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:30:34.241142 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:30:34.245727 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Usage tracker for resource:network and tenant:7bac6d994f4d49b292bc39fac07c0311 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:30:34.249125 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:30:34.254916 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:30:34.420569 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Made reservation on behalf of 7bac6d994f4d49b292bc39fac07c0311 for: {'network': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:30:34.420569 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-676039'] for network, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:34.438781 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1651877068-network', 'tenant_id': '52d59e3293254fcc85972c62e654f494'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:30:34.441900 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:34.453865 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:30:34.462487 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:30:34.469364 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Usage tracker for resource:security_group_rule and tenant:7bac6d994f4d49b292bc39fac07c0311 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:30:34.469604 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:30:34.474406 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-network', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:30:34.476390 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:30:34.481694 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:30:34.491563 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Usage tracker for resource:network and tenant:36c42f532cd14f19811ffbee3a39a208 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:30:34.496298 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:30:34.500423 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Usage tracker for resource:network and tenant:52d59e3293254fcc85972c62e654f494 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:30:34.502623 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:30:34.503540 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:30:34.510025 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:30:34.598555 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:34.620595 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Made reservation on behalf of 36c42f532cd14f19811ffbee3a39a208 for: {'network': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:30:34.622922 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-676039'] for network, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:34.635346 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 45556) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:34.636067 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:34.655862 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:30:34.659940 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Usage tracker for resource:security_group_rule and tenant:36c42f532cd14f19811ffbee3a39a208 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:30:34.663182 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:30:34.670500 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:30:34.761547 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:34.762830 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Made reservation on behalf of 52d59e3293254fcc85972c62e654f494 for: {'network': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:30:34.765277 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-676039'] for network, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:34.778292 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:34.792255 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:30:34.795918 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Usage tracker for resource:security_group_rule and tenant:52d59e3293254fcc85972c62e654f494 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:30:34.798637 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:30:34.804247 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:30:34.814335 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:34.818245 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:34.836477 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] vlan segment allocate from pool success with {'vlan_id': 511, 'physical_network': 'physnet1'}  {{(pid=92324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 03 08:30:34.859554 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:34.859965 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.segments_db [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Added segment 9923ac74-9556-45ec-9044-43728d2a8ec3 of type vlan for network f9db9a2a-942b-4a98-97ed-1896cb9158b4
Jun 03 08:30:34.865237 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1cbd5897-0041-4a4c-992f-10fc14864e4c,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:34.877268 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:34.877619 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:34.877950 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:34.878271 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:34.878689 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:34.879005 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:34.879320 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:34.879635 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:34.879945 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:34.880254 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:34.880563 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:34.880870 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Tracked resource versions report:
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]: pushed versions:
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]: {   'AddressGroup': {'1.2'},
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:     'ConntrackHelper': {'1.0'},
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:     'Log': {'1.0'},
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:     'Network': {'1.1'},
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:     'Port': {'1.7'},
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:     'PortForwarding': {'1.2'},
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:     'QosPolicy': {'1.8'},
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:     'SecurityGroup': {'1.4'},
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:     'SecurityGroupRule': {'1.2'},
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:     'SubPort': {'1.0'},
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:     'Subnet': {'1.1'},
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:     'Trunk': {'1.1'}}
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]: consumer versions:
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]: {   DHCP agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:     HyperV agent@hv-cinder-78726: {},
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:     L3 agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:     Metadata agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:     Metering agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:     Open vSwitch agent@dv-cinder-787262-5-iscsi: {   'AddressGroup': '1.2',
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:                                                      'ConntrackHelper': '1.0',
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:                                                      'Log': '1.0',
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:                                                      'Network': '1.1',
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:                                                      'Port': '1.7',
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:                                                      'PortForwarding': '1.2',
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:                                                      'QosPolicy': '1.8',
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:                                                      'SecurityGroup': '1.4',
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:                                                      'SecurityGroupRule': '1.2',
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:                                                      'SubPort': '1.0',
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:                                                      'Subnet': '1.1',
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:                                                      'Trunk': '1.1'}}
Jun 03 08:30:34.881832 dv-cinder-787262-5-iscsi neutron-server[92324]:  {{(pid=92324) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 03 08:30:34.885034 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:34.889267 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:34.909730 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8774223827658'] for network, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:34.933426 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:34.937893 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:34.983434 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6dd0ffd9-5529-4e6f-8d41-4ebabade9056,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:34.994129 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:34.994524 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:34.995518 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:34.996223 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:34.996719 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:34.997610 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:34.997959 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:34.998292 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Tracked resource versions report:
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]: pushed versions:
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]: {   'AddressGroup': {'1.2'},
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:     'ConntrackHelper': {'1.0'},
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:     'Log': {'1.0'},
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:     'Network': {'1.1'},
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:     'Port': {'1.7'},
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:     'PortForwarding': {'1.2'},
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:     'QosPolicy': {'1.8'},
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:     'SecurityGroup': {'1.4'},
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:     'SecurityGroupRule': {'1.2'},
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:     'SubPort': {'1.0'},
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:     'Subnet': {'1.1'},
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:     'Trunk': {'1.1'}}
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]: consumer versions:
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]: {   DHCP agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:     HyperV agent@hv-cinder-78726: {},
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:     L3 agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:     Metadata agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:     Metering agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:     Open vSwitch agent@dv-cinder-787262-5-iscsi: {   'AddressGroup': '1.2',
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:                                                      'ConntrackHelper': '1.0',
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:                                                      'Log': '1.0',
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:                                                      'Network': '1.1',
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:                                                      'Port': '1.7',
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:                                                      'PortForwarding': '1.2',
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:                                                      'QosPolicy': '1.8',
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:                                                      'SecurityGroup': '1.4',
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:                                                      'SecurityGroupRule': '1.2',
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:                                                      'SubPort': '1.0',
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:                                                      'Subnet': '1.1',
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:                                                      'Trunk': '1.1'}}
Jun 03 08:30:35.002699 dv-cinder-787262-5-iscsi neutron-server[92323]:  {{(pid=92323) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 03 08:30:35.005144 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] vlan segment allocate from pool success with {'vlan_id': 526, 'physical_network': 'physnet1'}  {{(pid=92323) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 03 08:30:35.014752 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.015030 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.db.segments_db [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Added segment 377c6f4a-d9be-4dae-86db-35230d8009c9 of type vlan for network 958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba
Jun 03 08:30:35.043427 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8774223827658'] for network, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.063813 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:35.064876 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820'] for network, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.068597 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:30:35.069439 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.075686 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.076884 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9ac71af4-db99-40d1-9162-d278cdbf662f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:35.119785 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1767133114-network', 'tenant_id': '755371c3d9de4747a47ba62e4d101829'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:30:35.153009 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820'] for network, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.155728 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:30:35.157076 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.180137 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:35.198599 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.200492 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Pushing event updated for resources: {'Network': ['ID=f9db9a2a-942b-4a98-97ed-1896cb9158b4,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:35.209856 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:30:35.211097 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:35.211650 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-19524a0b-e832-4b5c-a5d9-07a7977e85a0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:35.213818 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Network f9db9a2a-942b-4a98-97ed-1896cb9158b4 details requested by agent ovs-agent-dv-cinder-787262-5-iscsi with host dv-cinder-787262-5-iscsi {{(pid=92325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 03 08:30:35.220969 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Usage tracker for resource:network and tenant:755371c3d9de4747a47ba62e4d101829 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:30:35.226178 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:30:35.246634 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:30:35.247087 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-14800526-8730-42c1-a0f6-1cedadd3ea58 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.277730 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] vlan segment allocate from pool success with {'vlan_id': 544, 'physical_network': 'physnet1'}  {{(pid=92324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 03 08:30:35.288115 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=12cbc694-d459-4366-b758-44d0f16106cd,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:35.303158 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:35.309493 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.309688 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.segments_db [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Added segment 5a5b66b5-9e55-4a2d-87ec-5d31f3999401 of type vlan for network 70332c9d-d098-4fc3-97a8-2773d2d72e48
Jun 03 08:30:35.326619 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201  len: 888 time: 1.5885136
Jun 03 08:30:35.329090 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 45574) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:35.340345 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8774223827658'] for network, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.343226 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-db11737a-5dbc-4e47-9aed-39662ed0d3b4 admin admin] Request body: {'subnet': {'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-2136845645-subnet', 'tenant_id': '7bac6d994f4d49b292bc39fac07c0311', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:30:35.350103 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Pushing event updated for resources: {'Network': ['ID=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:35.353068 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:35.357887 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201  len: 890 time: 1.4269533
Jun 03 08:30:35.368111 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-db11737a-5dbc-4e47-9aed-39662ed0d3b4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:30:35.368111 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-db11737a-5dbc-4e47-9aed-39662ed0d3b4 admin admin] Usage tracker for resource:subnet and tenant:7bac6d994f4d49b292bc39fac07c0311 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:30:35.368111 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-db11737a-5dbc-4e47-9aed-39662ed0d3b4 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:30:35.373400 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 45582) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:35.376524 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Network 958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba details requested by agent ovs-agent-dv-cinder-787262-5-iscsi with host dv-cinder-787262-5-iscsi {{(pid=92325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 03 08:30:35.380159 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Made reservation on behalf of 755371c3d9de4747a47ba62e4d101829 for: {'network': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:30:35.381739 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-f2386a22-481a-4b8b-83d7-dc19d7078074 admin admin] Request body: {'subnet': {'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-subnet', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:30:35.382533 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-676039'] for network, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.387963 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-db11737a-5dbc-4e47-9aed-39662ed0d3b4 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:30:35.390743 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-f2386a22-481a-4b8b-83d7-dc19d7078074 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:30:35.404152 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.405968 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-f2386a22-481a-4b8b-83d7-dc19d7078074 admin admin] Usage tracker for resource:subnet and tenant:36c42f532cd14f19811ffbee3a39a208 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:30:35.411486 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-f2386a22-481a-4b8b-83d7-dc19d7078074 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:30:35.420381 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-f2386a22-481a-4b8b-83d7-dc19d7078074 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:30:35.426253 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:30:35.430474 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Usage tracker for resource:security_group_rule and tenant:755371c3d9de4747a47ba62e4d101829 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:30:35.434571 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:30:35.441854 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:30:35.532476 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820'] for network, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.532830 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-db11737a-5dbc-4e47-9aed-39662ed0d3b4 admin admin] Made reservation on behalf of 7bac6d994f4d49b292bc39fac07c0311 for: {'subnet': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:30:35.534297 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.535666 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-db11737a-5dbc-4e47-9aed-39662ed0d3b4 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.542261 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:30:35.542261 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.542261 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:35.549317 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f2386a22-481a-4b8b-83d7-dc19d7078074 admin admin] Made reservation on behalf of 36c42f532cd14f19811ffbee3a39a208 for: {'subnet': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:30:35.551896 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f2386a22-481a-4b8b-83d7-dc19d7078074 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.645740 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Pushing event updated for resources: {'Network': ['ID=70332c9d-d098-4fc3-97a8-2773d2d72e48,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:35.648321 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:35.656619 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Network 70332c9d-d098-4fc3-97a8-2773d2d72e48 details requested by agent ovs-agent-dv-cinder-787262-5-iscsi with host dv-cinder-787262-5-iscsi {{(pid=92325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 03 08:30:35.687185 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.696631 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f1a02abc-4266-4118-9e95-4e01872f9117 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:35.750527 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201  len: 885 time: 1.8216197
Jun 03 08:30:35.755653 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 45598) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:35.767656 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-fca6b0e1-a55b-4688-9af8-524d8ccd892a admin admin] Request body: {'subnet': {'network_id': '70332c9d-d098-4fc3-97a8-2773d2d72e48', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1651877068-subnet', 'tenant_id': '52d59e3293254fcc85972c62e654f494', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:30:35.777098 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-fca6b0e1-a55b-4688-9af8-524d8ccd892a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:30:35.782737 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-fca6b0e1-a55b-4688-9af8-524d8ccd892a admin admin] Usage tracker for resource:subnet and tenant:52d59e3293254fcc85972c62e654f494 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:30:35.787108 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-fca6b0e1-a55b-4688-9af8-524d8ccd892a admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:30:35.803834 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] vlan segment allocate from pool success with {'vlan_id': 531, 'physical_network': 'physnet1'}  {{(pid=92324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 03 08:30:35.821486 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.821486 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.segments_db [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Added segment 56366949-8cc8-4cf3-b3eb-d458d3515059 of type vlan for network 020eaa43-2d59-46e1-8aec-0a688069f72b
Jun 03 08:30:35.846320 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8774223827658'] for network, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.877165 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-fca6b0e1-a55b-4688-9af8-524d8ccd892a admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:30:35.897159 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=70c51560-c72c-46c4-a284-e38445caed1a,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:35.900214 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.204s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:35.975043 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820'] for network, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.977226 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:30:35.978144 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:35.983807 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:36.061941 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fca6b0e1-a55b-4688-9af8-524d8ccd892a admin admin] Made reservation on behalf of 52d59e3293254fcc85972c62e654f494 for: {'subnet': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:30:36.065131 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-fca6b0e1-a55b-4688-9af8-524d8ccd892a admin admin] Notify callbacks [] for subnet, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:36.254843 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:36.383411 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Pushing event updated for resources: {'Network': ['ID=020eaa43-2d59-46e1-8aec-0a688069f72b,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:36.387837 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.404s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:36.394368 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Network 020eaa43-2d59-46e1-8aec-0a688069f72b details requested by agent ovs-agent-dv-cinder-787262-5-iscsi with host dv-cinder-787262-5-iscsi {{(pid=92325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 03 08:30:36.475077 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 1.8383605
Jun 03 08:30:36.490303 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 45624) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:36.496726 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-1921c93a-8713-41b7-8764-939b30bad98e admin admin] Request body: {'subnet': {'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1767133114-subnet', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:30:36.502486 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-1921c93a-8713-41b7-8764-939b30bad98e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:30:36.507228 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-1921c93a-8713-41b7-8764-939b30bad98e admin admin] Usage tracker for resource:subnet and tenant:755371c3d9de4747a47ba62e4d101829 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:30:36.512932 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-1921c93a-8713-41b7-8764-939b30bad98e admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:30:36.520061 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-1921c93a-8713-41b7-8764-939b30bad98e admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:30:36.755247 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1921c93a-8713-41b7-8764-939b30bad98e admin admin] Made reservation on behalf of 755371c3d9de4747a47ba62e4d101829 for: {'subnet': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:30:36.776859 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1921c93a-8713-41b7-8764-939b30bad98e admin admin] Notify callbacks [] for subnet, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:36.828535 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-db11737a-5dbc-4e47-9aed-39662ed0d3b4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829'] for subnet, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:36.837215 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-39764d03-77a8-4bd1-b500-91a86b42395f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:36.873051 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f2386a22-481a-4b8b-83d7-dc19d7078074 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829'] for subnet, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:36.937946 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db11737a-5dbc-4e47-9aed-39662ed0d3b4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5f3b55e2-964f-4ce8-9d71-3ac11dc6ebf1,revision_number=0']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:36.950379 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-db11737a-5dbc-4e47-9aed-39662ed0d3b4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:36.952622 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.062s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:36.988748 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db11737a-5dbc-4e47-9aed-39662ed0d3b4 admin admin] Checking segment: {'id': '9923ac74-9556-45ec-9044-43728d2a8ec3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:30:36.989189 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db11737a-5dbc-4e47-9aed-39662ed0d3b4 admin admin] Network hostable DHCP agents. Network: f9db9a2a-942b-4a98-97ed-1896cb9158b4, hostable agents: ['07372699-02ac-4239-816f-84b3a5b0eff9'], hosted agents: [] {{(pid=92323) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 03 08:30:37.033506 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f2386a22-481a-4b8b-83d7-dc19d7078074 admin admin] Checking segment: {'id': '377c6f4a-d9be-4dae-86db-35230d8009c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:30:37.033924 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f2386a22-481a-4b8b-83d7-dc19d7078074 admin admin] Network hostable DHCP agents. Network: 958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba, hostable agents: ['07372699-02ac-4239-816f-84b3a5b0eff9'], hosted agents: [] {{(pid=92323) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 03 08:30:37.059678 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2386a22-481a-4b8b-83d7-dc19d7078074 admin admin] Pushing event updated for resources: {'Subnet': ['ID=cff67a13-bc33-4d3e-a796-5829103ca25c,revision_number=0']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:37.063081 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f2386a22-481a-4b8b-83d7-dc19d7078074 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:37.126670 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db11737a-5dbc-4e47-9aed-39662ed0d3b4 admin admin] Network f9db9a2a-942b-4a98-97ed-1896cb9158b4 is scheduled to be hosted by DHCP agent 07372699-02ac-4239-816f-84b3a5b0eff9 with binding_index 1 {{(pid=92323) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 03 08:30:37.162731 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f2386a22-481a-4b8b-83d7-dc19d7078074 admin admin] Network 958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba is scheduled to be hosted by DHCP agent 07372699-02ac-4239-816f-84b3a5b0eff9 with binding_index 1 {{(pid=92323) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 03 08:30:37.193133 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-fca6b0e1-a55b-4688-9af8-524d8ccd892a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829'] for subnet, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:37.200293 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e84c1207-2a16-4f4f-8421-46720d3e2bd3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:37.248809 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-db11737a-5dbc-4e47-9aed-39662ed0d3b4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-5-iscsi, f9db9a2a-942b-4a98-97ed-1896cb9158b4) {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:30:37.250768 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-f2386a22-481a-4b8b-83d7-dc19d7078074 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-5-iscsi, 958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba) {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:30:37.255374 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db11737a-5dbc-4e47-9aed-39662ed0d3b4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:30:37.256299 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-db11737a-5dbc-4e47-9aed-39662ed0d3b4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:37.280996 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f2386a22-481a-4b8b-83d7-dc19d7078074 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:30:37.281720 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f2386a22-481a-4b8b-83d7-dc19d7078074 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:37.285731 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f8e64c8-21e7-446e-8e2c-6ac58cb3b86f None None] Network f9db9a2a-942b-4a98-97ed-1896cb9158b4 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:30:37.314996 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-240075c3-53ca-4912-b0a4-35a2cf2b72c2 None None] Network 958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:30:37.336172 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fca6b0e1-a55b-4688-9af8-524d8ccd892a admin admin] Pushing event updated for resources: {'Subnet': ['ID=3c41763f-e17d-4df7-96ea-31656322a752,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:37.343979 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-fca6b0e1-a55b-4688-9af8-524d8ccd892a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:37.353164 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fca6b0e1-a55b-4688-9af8-524d8ccd892a admin admin] Checking segment: {'id': '5a5b66b5-9e55-4a2d-87ec-5d31f3999401', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '70332c9d-d098-4fc3-97a8-2773d2d72e48'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:30:37.353520 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fca6b0e1-a55b-4688-9af8-524d8ccd892a admin admin] Network hostable DHCP agents. Network: 70332c9d-d098-4fc3-97a8-2773d2d72e48, hostable agents: ['07372699-02ac-4239-816f-84b3a5b0eff9'], hosted agents: [] {{(pid=92324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 03 08:30:37.375734 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-db11737a-5dbc-4e47-9aed-39662ed0d3b4 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 852 time: 2.0375707
Jun 03 08:30:37.390428 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-f2386a22-481a-4b8b-83d7-dc19d7078074 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 853 time: 2.0157349
Jun 03 08:30:37.393326 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 45658) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:37.397824 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-router', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:30:37.403416 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:30:37.407723 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Usage tracker for resource:router and tenant:36c42f532cd14f19811ffbee3a39a208 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:30:37.411500 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:30:37.418266 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:30:37.473428 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1921c93a-8713-41b7-8764-939b30bad98e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829'] for subnet, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:37.478333 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:37.492243 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-16388154', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2397'] for router, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:37.494135 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-16389011', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-16327785', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-16383573', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2340'] for router, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:37.513835 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fca6b0e1-a55b-4688-9af8-524d8ccd892a admin admin] Network 70332c9d-d098-4fc3-97a8-2773d2d72e48 is scheduled to be hosted by DHCP agent 07372699-02ac-4239-816f-84b3a5b0eff9 with binding_index 1 {{(pid=92324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 03 08:30:37.529653 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:37.563496 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1921c93a-8713-41b7-8764-939b30bad98e admin admin] Pushing event updated for resources: {'Subnet': ['ID=5baf74c9-e686-40a5-b52f-f01da3bd1af9,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:37.567439 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-1921c93a-8713-41b7-8764-939b30bad98e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:37.583151 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1921c93a-8713-41b7-8764-939b30bad98e admin admin] Checking segment: {'id': '56366949-8cc8-4cf3-b3eb-d458d3515059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 531, 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:30:37.583503 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1921c93a-8713-41b7-8764-939b30bad98e admin admin] Network hostable DHCP agents. Network: 020eaa43-2d59-46e1-8aec-0a688069f72b, hostable agents: ['07372699-02ac-4239-816f-84b3a5b0eff9'], hosted agents: [] {{(pid=92324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 03 08:30:37.612724 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-fca6b0e1-a55b-4688-9af8-524d8ccd892a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-5-iscsi, 70332c9d-d098-4fc3-97a8-2773d2d72e48) {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:30:37.633343 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fca6b0e1-a55b-4688-9af8-524d8ccd892a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:30:37.637204 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-fca6b0e1-a55b-4688-9af8-524d8ccd892a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:37.681249 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3570b1f1-6451-4f3b-bf53-183f61ee1ae3 None None] Network 70332c9d-d098-4fc3-97a8-2773d2d72e48 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:30:37.735119 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1921c93a-8713-41b7-8764-939b30bad98e admin admin] Network 020eaa43-2d59-46e1-8aec-0a688069f72b is scheduled to be hosted by DHCP agent 07372699-02ac-4239-816f-84b3a5b0eff9 with binding_index 1 {{(pid=92324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 03 08:30:37.742170 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-1921c93a-8713-41b7-8764-939b30bad98e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-5-iscsi, 020eaa43-2d59-46e1-8aec-0a688069f72b) {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:30:37.747010 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1921c93a-8713-41b7-8764-939b30bad98e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:30:37.747489 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1921c93a-8713-41b7-8764-939b30bad98e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:37.776708 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-fca6b0e1-a55b-4688-9af8-524d8ccd892a admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 849 time: 2.0180509
Jun 03 08:30:37.801124 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c64cee29-86d2-41de-b0bb-449863718162 None None] Network 020eaa43-2d59-46e1-8aec-0a688069f72b requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:30:37.858815 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-1921c93a-8713-41b7-8764-939b30bad98e admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 847 time: 1.3674569
Jun 03 08:30:37.861418 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 45684) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:37.866220 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1767133114-router', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:30:37.873958 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:30:37.877418 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Usage tracker for resource:router and tenant:755371c3d9de4747a47ba62e4d101829 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:30:37.880390 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:30:37.890738 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:30:37.910571 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4724322b-8254-4f65-9c99-5aa57a19bef3 None None] Network f9db9a2a-942b-4a98-97ed-1896cb9158b4 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:30:37.930386 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 45694) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:37.933426 dv-cinder-787262-5-iscsi neutron-server[92324]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
Jun 03 08:30:38.018660 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-16388154', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2397'] for router, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:38.019912 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-16389011', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-16327785', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-16383573', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2340'] for router, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:38.118770 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:38.165256 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-1c4ce9f0-9f4b-4c23-9b76-22d9a76a8e42 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:30:38.166089 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-1c4ce9f0-9f4b-4c23-9b76-22d9a76a8e42 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Synchronizing usage tracker for tenant:7bac6d994f4d49b292bc39fac07c0311 on resource:network {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:30:38.237127 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-16327803', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-16388116', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2358'] for router, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:38.269783 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp3789a88e-0f76-536c-9507-4ab4ace56879-958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'fixed_ips': [{'subnet_id': 'cff67a13-bc33-4d3e-a796-5829103ca25c'}]}} from dv-cinder-787262-5-iscsi. {{(pid=92325) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 03 08:30:38.270674 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:38.330902 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-1c4ce9f0-9f4b-4c23-9b76-22d9a76a8e42 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Unset dirty status for tenant:7bac6d994f4d49b292bc39fac07c0311 on resource:network {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:30:38.354998 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-1c4ce9f0-9f4b-4c23-9b76-22d9a76a8e42 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/networks?id=f9db9a2a-942b-4a98-97ed-1896cb9158b4 HTTP/1.1" status: 200  len: 815 time: 0.4226108
Jun 03 08:30:38.359339 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:38.409535 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f59f6bf5-0357-407a-8afb-ca3b1d1c0808 None None] Network 70332c9d-d098-4fc3-97a8-2773d2d72e48 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:30:38.414443 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-4e864471-9e2a-45d8-9a4d-5ff554125b7a tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/quotas/7bac6d994f4d49b292bc39fac07c0311 HTTP/1.1" status: 200  len: 375 time: 0.0573590
Jun 03 08:30:38.604898 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 45730) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:38.611419 dv-cinder-787262-5-iscsi neutron-server[92323]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
Jun 03 08:30:38.627206 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-49f52ace-0599-46fc-881b-a09a93fc6c1a tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=7bac6d994f4d49b292bc39fac07c0311&fields=id HTTP/1.1" status: 200  len: 210 time: 0.2116997
Jun 03 08:30:38.855577 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-16327803', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-16388116', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2358'] for router, precommit_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:38.899748 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-a197b1c0-0d04-48aa-b906-946f6df84b9f service neutron] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=92324) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 03 08:30:38.907848 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-a197b1c0-0d04-48aa-b906-946f6df84b9f service neutron] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0810070
Jun 03 08:30:38.952572 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8423321-8a21-48cb-980d-4762935f20fb req-dd07e893-3fa2-473b-b8f9-fdd98dad0b29 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:30:38.959382 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c8423321-8a21-48cb-980d-4762935f20fb req-dd07e893-3fa2-473b-b8f9-fdd98dad0b29 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/networks?id=70332c9d-d098-4fc3-97a8-2773d2d72e48 HTTP/1.1" status: 200  len: 812 time: 0.3518434
Jun 03 08:30:38.993940 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:39.020191 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.db_base_plugin_common [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Allocated IP 172.20.0.2 (958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba/cff67a13-bc33-4d3e-a796-5829103ca25c/b978875c-3e77-480c-9a07-17ea1232f6ab) {{(pid=92325) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:30:39.023801 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp3789a88e-0f76-536c-9507-4ab4ace56879-020eaa43-2d59-46e1-8aec-0a688069f72b', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'fixed_ips': [{'subnet_id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9'}]}} from dv-cinder-787262-5-iscsi. {{(pid=92325) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 03 08:30:39.024677 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:39.062020 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c8423321-8a21-48cb-980d-4762935f20fb req-70b1ed8d-54ac-4fa0-ae72-7da302f47271 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/quotas/52d59e3293254fcc85972c62e654f494 HTTP/1.1" status: 200  len: 375 time: 0.1014304
Jun 03 08:30:39.122601 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:39.173587 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-e02b8555-751b-435d-9416-d6232736d5f8 service neutron] 10.222.0.11 "GET /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2647986
Jun 03 08:30:39.211779 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c8423321-8a21-48cb-980d-4762935f20fb req-042f6500-af5d-4190-be32-a6ff5f442377 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=52d59e3293254fcc85972c62e654f494&fields=id HTTP/1.1" status: 200  len: 210 time: 0.1418347
Jun 03 08:30:39.466120 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Allocated IP 172.27.0.93 (684ef871-89aa-450d-ae0d-e232bfaf51fb/e7b58fba-1ed5-483b-b341-7736b2ffb853/3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:30:39.491499 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-829f89ff-32eb-496e-9737-49525056ea91 service neutron] 10.222.0.11 "GET /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3096395
Jun 03 08:30:39.505655 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [req-c8423321-8a21-48cb-980d-4762935f20fb req-718feaa5-fe07-489b-b524-382b87fe02dc service neutron] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=92323) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 03 08:30:39.513376 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c8423321-8a21-48cb-980d-4762935f20fb req-718feaa5-fe07-489b-b524-382b87fe02dc service neutron] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0885105
Jun 03 08:30:39.548981 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.db_base_plugin_common [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Allocated IP 172.20.0.2 (020eaa43-2d59-46e1-8aec-0a688069f72b/5baf74c9-e686-40a5-b52f-f01da3bd1af9/4e183c7e-d68a-4fcc-8844-a9cadeac12f4) {{(pid=92325) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:30:39.644985 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Notify callbacks [] for port, precommit_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:39.670909 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:39.706109 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:39.708361 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Transition to ACTIVE for port object b978875c-3e77-480c-9a07-17ea1232f6ab will not be triggered until provisioned by entity L2. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:30:39.752859 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Transition to ACTIVE for port object b978875c-3e77-480c-9a07-17ea1232f6ab will not be triggered until provisioned by entity DHCP. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:30:39.797518 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c8423321-8a21-48cb-980d-4762935f20fb req-09bed73e-9614-424a-bd44-277e2ff5e6cf service neutron] 10.222.0.11 "GET /v2.0/networks/70332c9d-d098-4fc3-97a8-2773d2d72e48?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2831297
Jun 03 08:30:39.808730 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:39.888589 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:39.907864 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:39.994154 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Network 958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba is already hosted by enough agents. {{(pid=92325) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:30:39.997693 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Notify callbacks [] for port, precommit_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:40.002387 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.scheduler.base_scheduler [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Resources bound (agent type, host, resource id):  {{(pid=92325) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:30:40.018370 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c8423321-8a21-48cb-980d-4762935f20fb req-8f01ee67-4737-409b-86c6-787bfaeb9482 service neutron] 10.222.0.11 "GET /v2.0/networks/70332c9d-d098-4fc3-97a8-2773d2d72e48?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1620195
Jun 03 08:30:40.018370 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:40.019458 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Received port after_create {{(pid=92325) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:30:40.020154 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Pushing event updated for resources: {'Port': ['ID=b978875c-3e77-480c-9a07-17ea1232f6ab,revision_number=1']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:40.020873 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:40.061688 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-40ccab4d-389e-411c-9779-0091006bb6a0 req-86da1fd5-3c0f-4320-8390-b6ab2f6ecea2 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 210 time: 0.1409783
Jun 03 08:30:40.090249 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:40.090249 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:40.090249 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:40.090249 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:40.090249 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:40.090249 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:40.090249 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:40.090249 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:40.091227 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:40.091320 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:40.091762 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:40.092321 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Tracked resource versions report:
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]: pushed versions:
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]: {   'AddressGroup': {'1.2'},
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:     'ConntrackHelper': {'1.0'},
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:     'Log': {'1.0'},
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:     'Network': {'1.1'},
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:     'Port': {'1.7'},
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:     'PortForwarding': {'1.2'},
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:     'QosPolicy': {'1.8'},
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:     'SecurityGroup': {'1.4'},
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:     'SecurityGroupRule': {'1.2'},
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:     'SubPort': {'1.0'},
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:     'Subnet': {'1.1'},
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:     'Trunk': {'1.1'}}
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]: consumer versions:
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]: {   DHCP agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:     HyperV agent@hv-cinder-78726: {},
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:     L3 agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:     Metadata agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:     Metering agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:     Open vSwitch agent@dv-cinder-787262-5-iscsi: {   'AddressGroup': '1.2',
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:                                                      'ConntrackHelper': '1.0',
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:                                                      'Log': '1.0',
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:                                                      'Network': '1.1',
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:                                                      'Port': '1.7',
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:                                                      'PortForwarding': '1.2',
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:                                                      'QosPolicy': '1.8',
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:                                                      'SecurityGroup': '1.4',
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:                                                      'SecurityGroupRule': '1.2',
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:                                                      'SubPort': '1.0',
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:                                                      'Subnet': '1.1',
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:                                                      'Trunk': '1.1'}}
Jun 03 08:30:40.094281 dv-cinder-787262-5-iscsi neutron-server[92325]:  {{(pid=92325) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 03 08:30:40.103208 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Pushing event updated for resources: {'Port': ['ID=3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:40.110895 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:30:40.111886 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:40.116680 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:30:40.121081 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:30:40.131629 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.224s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:40.135036 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Transition to ACTIVE for port object 4e183c7e-d68a-4fcc-8844-a9cadeac12f4 will not be triggered until provisioned by entity L2. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:30:40.161568 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.db_base_plugin_common [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Allocated IP 172.27.0.241 (684ef871-89aa-450d-ae0d-e232bfaf51fb/e7b58fba-1ed5-483b-b341-7736b2ffb853/25fe9a61-dbff-4283-b107-964710e6f4ad) {{(pid=92324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:30:40.250533 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Attempting to bind port b978875c-3e77-480c-9a07-17ea1232f6ab on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:30:40.250892 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Attempting to bind port b978875c-3e77-480c-9a07-17ea1232f6ab by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '377c6f4a-d9be-4dae-86db-35230d8009c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba'}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:30:40.251255 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Attempting to bind port b978875c-3e77-480c-9a07-17ea1232f6ab on network 958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:30:40.260582 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 30, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:30:40.261507 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Checking segment: {'id': '377c6f4a-d9be-4dae-86db-35230d8009c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:30:40.262065 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:40.262542 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Bound using segment: {'id': '377c6f4a-d9be-4dae-86db-35230d8009c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba'} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:30:40.271925 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Bound port: b978875c-3e77-480c-9a07-17ea1232f6ab, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '377c6f4a-d9be-4dae-86db-35230d8009c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba'}}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:30:40.271925 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:40.283939 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Transition to ACTIVE for port object 4e183c7e-d68a-4fcc-8844-a9cadeac12f4 will not be triggered until provisioned by entity DHCP. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:30:40.372654 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] For port b978875c-3e77-480c-9a07-17ea1232f6ab, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:30:40.377666 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] For port b978875c-3e77-480c-9a07-17ea1232f6ab, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=b978875c-3e77-480c-9a07-17ea1232f6ab,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:30:40.380536 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:40.392902 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:40.454453 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:40.486853 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Notify callbacks [] for port, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:40.488814 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Network 020eaa43-2d59-46e1-8aec-0a688069f72b is already hosted by enough agents. {{(pid=92325) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:30:40.492264 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.scheduler.base_scheduler [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Resources bound (agent type, host, resource id):  {{(pid=92325) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:30:40.498941 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Received port after_create {{(pid=92325) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:30:40.684715 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Pushing event updated for resources: {'Port': ['ID=4e183c7e-d68a-4fcc-8844-a9cadeac12f4,revision_number=1']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:40.692440 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.302s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:40.693116 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.204s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:40.710583 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:40.732077 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:40.738878 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Attempting to bind port 4e183c7e-d68a-4fcc-8844-a9cadeac12f4 on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:30:40.739365 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Attempting to bind port 4e183c7e-d68a-4fcc-8844-a9cadeac12f4 by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '56366949-8cc8-4cf3-b3eb-d458d3515059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 531, 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b'}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:30:40.739825 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Attempting to bind port 4e183c7e-d68a-4fcc-8844-a9cadeac12f4 on network 020eaa43-2d59-46e1-8aec-0a688069f72b {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:30:40.763154 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 30, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:30:40.763748 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Checking segment: {'id': '56366949-8cc8-4cf3-b3eb-d458d3515059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 531, 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:30:40.776613 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:40.777327 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Bound using segment: {'id': '56366949-8cc8-4cf3-b3eb-d458d3515059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 531, 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b'} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:30:40.779917 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Bound port: 4e183c7e-d68a-4fcc-8844-a9cadeac12f4, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56366949-8cc8-4cf3-b3eb-d458d3515059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 531, 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b'}}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:30:40.780393 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:40.845311 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:30:40.848375 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:30:40.853150 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Received port after_create {{(pid=92324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:30:40.917962 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-bcc82049-1765-480c-ba9d-69fa1986944a req-2c519285-4df1-4b04-96fe-47d305a3bf6e tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 210 time: 0.1619384
Jun 03 08:30:40.935844 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Pushing event updated for resources: {'Port': ['ID=b978875c-3e77-480c-9a07-17ea1232f6ab,revision_number=2']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:40.947281 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.254s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:40.958235 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Pushing event updated for resources: {'Port': ['ID=25fe9a61-dbff-4283-b107-964710e6f4ad,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:40.972461 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:41.004234 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] For port 4e183c7e-d68a-4fcc-8844-a9cadeac12f4, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:30:41.009040 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] For port 4e183c7e-d68a-4fcc-8844-a9cadeac12f4, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=4e183c7e-d68a-4fcc-8844-a9cadeac12f4,segment=NetworkSegment(56366949-8cc8-4cf3-b3eb-d458d3515059),segment_id=56366949-8cc8-4cf3-b3eb-d458d3515059)] {{(pid=92325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:30:41.050119 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.318s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:41.089020 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:41.103670 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:41.214039 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-4f44e28e-4838-4c96-a210-5edaa03bfa65 req-779185d8-e6b0-48dd-a170-0a0fcc20c91c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 210 time: 0.0560837
Jun 03 08:30:41.229666 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Pushing event updated for resources: {'Port': ['ID=4e183c7e-d68a-4fcc-8844-a9cadeac12f4,revision_number=2']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:41.233160 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:41.749811 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 4e183c7e-d68a-4fcc-8844-a9cadeac12f4 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:30:42.001586 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:42.148593 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-16388099', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-16327774'] for router, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:42.173650 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port 4e183c7e-d68a-4fcc-8844-a9cadeac12f4 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:30:42.180225 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device b978875c-3e77-480c-9a07-17ea1232f6ab up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:30:42.502682 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2b789641-04a8-4a9c-8053-7d263029b1af req-fdcdd357-8118-43b2-b596-f8da5a8f4e9b tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 210 time: 0.2883728
Jun 03 08:30:42.531165 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port b978875c-3e77-480c-9a07-17ea1232f6ab completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:30:42.708534 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-504b5c2f-f33a-476d-a294-e7580b8038e5 None None] Network 958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:30:42.720615 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d6db0dab-afca-415b-a2ce-5be6abfef74b req-2d37de29-d081-46fb-9715-83f4783052df tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 210 time: 0.3539813
Jun 03 08:30:42.952742 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-9f4c1b82-d779-497b-89d7-fb246ab60fa1 None None] Provisioning for port b978875c-3e77-480c-9a07-17ea1232f6ab completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:30:42.981946 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-9f4c1b82-d779-497b-89d7-fb246ab60fa1 None None] Provisioning complete for port b978875c-3e77-480c-9a07-17ea1232f6ab triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:30:42.982329 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-9f4c1b82-d779-497b-89d7-fb246ab60fa1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:42.997990 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Router cb358121-3d7d-46b4-8e93-e40d5a92215c is scheduled to L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 with binding_index 1 {{(pid=92323) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 03 08:30:43.013218 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c44e6bb5-14d4-4dc5-84c5-3d4ef899701f None None] Network 020eaa43-2d59-46e1-8aec-0a688069f72b requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:30:43.122622 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-16388099', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-16327774'] for router, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:43.379095 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:30:43.391178 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] Sync routers for ids ['cb358121-3d7d-46b4-8e93-e40d5a92215c'] in dv-cinder-787262-5-iscsi {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:30:43.411402 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] Routers {'cb358121-3d7d-46b4-8e93-e40d5a92215c'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:30:43.412051 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86f4fca0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:30:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['cb358121-3d7d-46b4-8e93-e40d5a92215c'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:30:43.573243 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Notify callbacks [] for router, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:43.577904 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201  len: 928 time: 6.1826110
Jun 03 08:30:43.581071 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 45906) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:43.616642 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-9f4c1b82-d779-497b-89d7-fb246ab60fa1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:43.805846 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-9f4c1b82-d779-497b-89d7-fb246ab60fa1 None None] For port b978875c-3e77-480c-9a07-17ea1232f6ab, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=b978875c-3e77-480c-9a07-17ea1232f6ab,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:30:43.888264 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-9f4c1b82-d779-497b-89d7-fb246ab60fa1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:43.901685 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-cce2a5f9-bff7-421a-92de-bb82cce1fab8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:44.102939 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2c74df23-5a56-4b89-998d-60f919a5f9a5 req-9b5dc27d-9e79-44f2-ba29-80ae53afa4c3 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 210 time: 0.2152228
Jun 03 08:30:44.264848 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f4c1b82-d779-497b-89d7-fb246ab60fa1 None None] Pushing event updated for resources: {'Port': ['ID=b978875c-3e77-480c-9a07-17ea1232f6ab,revision_number=3']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:44.268347 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] Set router cb358121-3d7d-46b4-8e93-e40d5a92215c gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:30:44.271046 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-9f4c1b82-d779-497b-89d7-fb246ab60fa1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.376s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:44.303530 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Router a4b01ad1-d952-4deb-88df-6930ad4824db is scheduled to L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 with binding_index 1 {{(pid=92324) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 03 08:30:44.332369 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-4c1261a5-a635-4e39-b01c-d2d9510e2470 None None] Provisioning for port 4e183c7e-d68a-4fcc-8844-a9cadeac12f4 completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:30:44.339596 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-4c1261a5-a635-4e39-b01c-d2d9510e2470 None None] Provisioning complete for port 4e183c7e-d68a-4fcc-8844-a9cadeac12f4 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:30:44.343699 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4c1261a5-a635-4e39-b01c-d2d9510e2470 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:44.560686 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4c1261a5-a635-4e39-b01c-d2d9510e2470 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:44.638681 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-4c1261a5-a635-4e39-b01c-d2d9510e2470 None None] For port 4e183c7e-d68a-4fcc-8844-a9cadeac12f4, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=4e183c7e-d68a-4fcc-8844-a9cadeac12f4,segment=NetworkSegment(56366949-8cc8-4cf3-b3eb-d458d3515059),segment_id=56366949-8cc8-4cf3-b3eb-d458d3515059)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:30:44.724659 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-824b38d2-5d3f-48b6-a07b-31bb60981430 req-e80f4bb6-9381-4331-9032-42e8962273d9 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 210 time: 0.1644197
Jun 03 08:30:44.729547 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4c1261a5-a635-4e39-b01c-d2d9510e2470 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:44.732277 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:44.848271 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86f4fca0>, [{'id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-router', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:37Z', 'updated_at': '2021-06-03T08:30:40Z', 'revision_number': 3, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'gw_port': {'id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:11:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:39Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:30:44.855769 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] Checking router: cb358121-3d7d-46b4-8e93-e40d5a92215c for host: dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:30:44.856126 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] Updating router cb358121-3d7d-46b4-8e93-e40d5a92215c port 3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b binding host dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 03 08:30:44.875444 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c1261a5-a635-4e39-b01c-d2d9510e2470 None None] Pushing event updated for resources: {'Port': ['ID=4e183c7e-d68a-4fcc-8844-a9cadeac12f4,revision_number=3']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:44.880086 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-4c1261a5-a635-4e39-b01c-d2d9510e2470 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:44.881568 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-49ff9002-2124-45f4-83da-b9e85ae26990 None None] Provisioning complete for port 4e183c7e-d68a-4fcc-8844-a9cadeac12f4 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:30:44.882142 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-49ff9002-2124-45f4-83da-b9e85ae26990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:45.050722 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:45.132190 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:30:45.137097 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.55', 49862) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:45.146380 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] Sync routers for ids ['a4b01ad1-d952-4deb-88df-6930ad4824db'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:30:45.160770 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-49ff9002-2124-45f4-83da-b9e85ae26990 None None] Provisioning complete for port b978875c-3e77-480c-9a07-17ea1232f6ab triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:30:45.161892 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-49ff9002-2124-45f4-83da-b9e85ae26990 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:45.244437 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] Routers {'a4b01ad1-d952-4deb-88df-6930ad4824db'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:30:45.246402 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae870dea30>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:30:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['a4b01ad1-d952-4deb-88df-6930ad4824db'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:30:45.427398 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Notify callbacks [] for router, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:45.428607 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201  len: 923 time: 7.5660925
Jun 03 08:30:45.431777 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 45946) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:45.597906 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7c54dd1c-1e03-4032-9649-b2e8f58863b1 req-76ad1155-152f-4f13-8658-af198b4461e9 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 210 time: 0.1471894
Jun 03 08:30:45.695448 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-3ae0fa5b-91de-4e45-bd14-7a6a4a0f6bcc tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:30:45.723277 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-3ae0fa5b-91de-4e45-bd14-7a6a4a0f6bcc tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.55 "GET /v2.0/networks?id=f9db9a2a-942b-4a98-97ed-1896cb9158b4 HTTP/1.1" status: 200  len: 815 time: 0.5572965
Jun 03 08:30:45.914896 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 4e183c7e-d68a-4fcc-8844-a9cadeac12f4 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:30:45.982156 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] Notify callbacks [] for port, precommit_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:45.985203 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:46.013317 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.provisioning_blocks [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] Transition to ACTIVE for port object 3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b will not be triggered until provisioned by entity L2. {{(pid=92326) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:30:46.074932 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] Set router a4b01ad1-d952-4deb-88df-6930ad4824db gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:30:46.092740 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:46.111193 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-f27ff107-f818-422b-927d-6aa69b1d0ad0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:46.191741 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-dc5e9c67-cfe6-4df6-841c-8b053d667bb9 req-1ee7bd9e-bae4-4adc-ace5-f7dedaf0d965 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 210 time: 0.1013365
Jun 03 08:30:46.259545 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] Attempting to bind port 3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:30:46.261205 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] Attempting to bind port 3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}] {{(pid=92326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:30:46.261837 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] Attempting to bind port 3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b on network 684ef871-89aa-450d-ae0d-e232bfaf51fb {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:30:46.272869 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 4e183c7e-d68a-4fcc-8844-a9cadeac12f4 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:30:46.273251 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:46.285122 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24cb7957-ac10-4253-ac02-b993427cf35d None None] Pushing event updated for resources: {'Port': ['ID=3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b,revision_number=2']} {{(pid=92326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:46.299987 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 30, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:30:46.302375 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] Checking segment: {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92326) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:30:46.305075 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:46.305594 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] Bound using segment: {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'} {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:30:46.310071 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] Bound port: 3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}}] {{(pid=92326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:30:46.310071 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:46.357227 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cb7957-ac10-4253-ac02-b993427cf35d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:46.359367 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cb7957-ac10-4253-ac02-b993427cf35d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:46.359367 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cb7957-ac10-4253-ac02-b993427cf35d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:46.359367 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cb7957-ac10-4253-ac02-b993427cf35d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:46.359367 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cb7957-ac10-4253-ac02-b993427cf35d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:46.359763 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cb7957-ac10-4253-ac02-b993427cf35d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:46.360170 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cb7957-ac10-4253-ac02-b993427cf35d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:46.360594 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cb7957-ac10-4253-ac02-b993427cf35d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:46.361157 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cb7957-ac10-4253-ac02-b993427cf35d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:46.361596 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cb7957-ac10-4253-ac02-b993427cf35d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:46.362018 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cb7957-ac10-4253-ac02-b993427cf35d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:46.362484 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cb7957-ac10-4253-ac02-b993427cf35d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24cb7957-ac10-4253-ac02-b993427cf35d None None] Tracked resource versions report:
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]: pushed versions:
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]: {   'AddressGroup': {'1.2'},
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:     'ConntrackHelper': {'1.0'},
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:     'Log': {'1.0'},
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:     'Network': {'1.1'},
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:     'Port': {'1.7'},
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:     'PortForwarding': {'1.2'},
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:     'QosPolicy': {'1.8'},
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:     'SecurityGroup': {'1.4'},
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:     'SecurityGroupRule': {'1.2'},
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:     'SubPort': {'1.0'},
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:     'Subnet': {'1.1'},
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:     'Trunk': {'1.1'}}
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]: consumer versions:
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]: {   DHCP agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:     HyperV agent@hv-cinder-78726: {},
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:     L3 agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:     Metadata agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:     Metering agent@dv-cinder-787262-5-iscsi: {},
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:     Open vSwitch agent@dv-cinder-787262-5-iscsi: {   'AddressGroup': '1.2',
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:                                                      'ConntrackHelper': '1.0',
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:                                                      'Log': '1.0',
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:                                                      'Network': '1.1',
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:                                                      'Port': '1.7',
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:                                                      'PortForwarding': '1.2',
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:                                                      'QosPolicy': '1.8',
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:                                                      'SecurityGroup': '1.4',
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:                                                      'SecurityGroupRule': '1.2',
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:                                                      'SubPort': '1.0',
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:                                                      'Subnet': '1.1',
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:                                                      'Trunk': '1.1'}}
Jun 03 08:30:46.364445 dv-cinder-787262-5-iscsi neutron-server[92326]:  {{(pid=92326) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 03 08:30:46.380098 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-24cb7957-ac10-4253-ac02-b993427cf35d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.278s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:46.439949 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.db [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] For port 3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92326) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:30:46.446083 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.db [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] For port 3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92326) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:30:46.570947 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:46.604620 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:46.723770 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device b978875c-3e77-480c-9a07-17ea1232f6ab up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:30:46.832992 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] Routers {'cb358121-3d7d-46b4-8e93-e40d5a92215c'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:30:46.844487 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86f4fca0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:30:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['cb358121-3d7d-46b4-8e93-e40d5a92215c'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:30:46.873382 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 45992) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:46.917660 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.db_base_plugin_common [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Allocated IP 172.20.0.1 (958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba/cff67a13-bc33-4d3e-a796-5829103ca25c/5d9c4d5c-7c2e-4911-823a-3a3242707096) {{(pid=92324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:30:46.990140 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24cb7957-ac10-4253-ac02-b993427cf35d None None] Pushing event updated for resources: {'Port': ['ID=3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b,revision_number=3']} {{(pid=92326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:46.993183 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae870dea30>, [{'id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'name': 'tempest-AttachVolumeTestJSON-1767133114-router', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241'}], 'enable_snat': True}, 'gw_port_id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:38Z', 'updated_at': '2021-06-03T08:30:41Z', 'revision_number': 3, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'gw_port': {'id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:65:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:40Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:30:47.002612 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-24cb7957-ac10-4253-ac02-b993427cf35d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.397s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:47.005091 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] Checking router: a4b01ad1-d952-4deb-88df-6930ad4824db for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:30:47.005619 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] Updating router a4b01ad1-d952-4deb-88df-6930ad4824db port 25fe9a61-dbff-4283-b107-964710e6f4ad binding host dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 03 08:30:47.086211 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4f0a519a-5538-4912-8a3e-9ef453e2e9aa req-7e7fcdf3-b9a8-490d-aaf0-8dc0060a4e06 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 210 time: 0.1623464
Jun 03 08:30:47.096839 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:47.164631 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port b978875c-3e77-480c-9a07-17ea1232f6ab triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:30:47.164631 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:47.187662 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] Set router cb358121-3d7d-46b4-8e93-e40d5a92215c gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:30:47.244348 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-53b7a4f3-bae2-4ef6-a563-286a0e7548d7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:47.286319 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-53b7a4f3-bae2-4ef6-a563-286a0e7548d7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:30:47.305337 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-53b7a4f3-bae2-4ef6-a563-286a0e7548d7 admin admin] Usage tracker for resource:security_group_rule and tenant:4dba6f315e6e4a2fb3d5876580d16f76 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:30:47.314536 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-53b7a4f3-bae2-4ef6-a563-286a0e7548d7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:30:47.354671 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-53b7a4f3-bae2-4ef6-a563-286a0e7548d7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:30:47.434083 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Notify callbacks [] for port, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:47.532387 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c33724bf-023e-43b4-82f0-2d31f3d0a0fe req-cc59e49a-3049-4b2e-9b30-ad69a2867411 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 210 time: 0.0661249
Jun 03 08:30:47.548276 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.provisioning_blocks [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Transition to ACTIVE for port object 5d9c4d5c-7c2e-4911-823a-3a3242707096 will not be triggered until provisioned by entity DHCP. {{(pid=92324) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:30:47.558450 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-53b7a4f3-bae2-4ef6-a563-286a0e7548d7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:47.672167 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-53b7a4f3-bae2-4ef6-a563-286a0e7548d7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:47.686521 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:47.786284 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-53b7a4f3-bae2-4ef6-a563-286a0e7548d7 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=4dba6f315e6e4a2fb3d5876580d16f76&name=default HTTP/1.1" status: 200  len: 2975 time: 0.9041398
Jun 03 08:30:47.786530 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86f4fca0>, [{'id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-router', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:37Z', 'updated_at': '2021-06-03T08:30:40Z', 'revision_number': 3, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'gw_port': {'id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:11:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:30:47.787003 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 46010) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:47.792061 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84e1aa19-3fb5-4b06-a49f-8db4c83f4e3d None None] The sync data for ids ['cb358121-3d7d-46b4-8e93-e40d5a92215c'] in dv-cinder-787262-5-iscsi is: [{'id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-router', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:37Z', 'updated_at': '2021-06-03T08:30:40Z', 'revision_number': 3, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'gw_port': {'id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:11:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}] {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:30:47.806365 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53b7a4f3-bae2-4ef6-a563-286a0e7548d7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5afc8fc0-28da-4db3-878a-8fab51f1575f,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:47.811843 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 46012) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:47.817053 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-53b7a4f3-bae2-4ef6-a563-286a0e7548d7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:47.829543 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:47.859017 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:47.875168 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-d76f5036-bdf1-4ad5-b662-1e7aaa8d9c5f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:47.881188 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] Notify callbacks [] for port, precommit_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:47.898982 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4b395f4e-9a04-4a34-8205-b0de698492ad admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:47.915589 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] Transition to ACTIVE for port object 25fe9a61-dbff-4283-b107-964710e6f4ad will not be triggered until provisioned by entity L2. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:30:47.946162 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4b395f4e-9a04-4a34-8205-b0de698492ad admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:47.995706 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Network 958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:30:48.000851 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:30:48.012901 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:48.025193 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Received port after_create {{(pid=92324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:30:48.025193 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-16328800'] for router_interface, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:48.025449 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:48.053335 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2253eb7f-4326-4162-8aa7-ec58231a0886 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:48.087586 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-2253eb7f-4326-4162-8aa7-ec58231a0886 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:30:48.093455 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-2253eb7f-4326-4162-8aa7-ec58231a0886 admin admin] Usage tracker for resource:security_group_rule and tenant:9c5602b7a908440bb48eb5b8f9940199 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:30:48.098060 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-2253eb7f-4326-4162-8aa7-ec58231a0886 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:30:48.106809 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-2253eb7f-4326-4162-8aa7-ec58231a0886 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:30:48.111638 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] Attempting to bind port 25fe9a61-dbff-4283-b107-964710e6f4ad on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:30:48.112334 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] Attempting to bind port 25fe9a61-dbff-4283-b107-964710e6f4ad by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:30:48.115065 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] Attempting to bind port 25fe9a61-dbff-4283-b107-964710e6f4ad on network 684ef871-89aa-450d-ae0d-e232bfaf51fb {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:30:48.146090 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 30, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:30:48.147487 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] Checking segment: {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:30:48.147936 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:48.148544 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] Bound using segment: {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:30:48.150232 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] Bound port: 25fe9a61-dbff-4283-b107-964710e6f4ad, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:30:48.150232 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:48.199647 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4b395f4e-9a04-4a34-8205-b0de698492ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:48.256629 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-53b7a4f3-bae2-4ef6-a563-286a0e7548d7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:48.285808 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-119b0e3b-c1f0-4a3e-9378-641c9e350d2a None None] Pushing event updated for resources: {'Port': ['ID=25fe9a61-dbff-4283-b107-964710e6f4ad,revision_number=2']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:48.301530 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b395f4e-9a04-4a34-8205-b0de698492ad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5afc8fc0-28da-4db3-878a-8fab51f1575f,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:48.315303 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-119b0e3b-c1f0-4a3e-9378-641c9e350d2a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.294s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:48.331198 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:30:48.452591 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4b395f4e-9a04-4a34-8205-b0de698492ad admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:48.457614 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-4b395f4e-9a04-4a34-8205-b0de698492ad admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/5afc8fc0-28da-4db3-878a-8fab51f1575f HTTP/1.1" status: 204  len: 168 time: 0.6676459
Jun 03 08:30:48.461348 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-db86759f-8e61-48c4-a7f1-6f4818b591c6 req-cda93cf6-dc8f-4259-8e46-56ec7996c1dc tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 210 time: 0.1606970
Jun 03 08:30:48.464289 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-4b395f4e-9a04-4a34-8205-b0de698492ad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:48.469987 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-a41e1ac9-0d2b-4e8c-972e-9d665abbd4c7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Request body: {'port': {'device_id': '0a3d1adc-5874-4a88-8aee-893097ee9077', 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4', 'admin_state_up': True, 'tenant_id': '7bac6d994f4d49b292bc39fac07c0311'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:30:48.527185 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] For port 25fe9a61-dbff-4283-b107-964710e6f4ad, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:30:48.549358 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] For port 25fe9a61-dbff-4283-b107-964710e6f4ad, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=25fe9a61-dbff-4283-b107-964710e6f4ad,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:30:48.563687 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Pushing event updated for resources: {'Port': ['ID=5d9c4d5c-7c2e-4911-823a-3a3242707096,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:48.571642 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.701s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:48.638007 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:48.650196 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:48.731500 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.db_base_plugin_common [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Allocated IP 172.20.0.1 (020eaa43-2d59-46e1-8aec-0a688069f72b/5baf74c9-e686-40a5-b52f-f01da3bd1af9/09aff824-d423-4557-8913-463e6f53d3e5) {{(pid=92324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:30:48.847405 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-a41e1ac9-0d2b-4e8c-972e-9d665abbd4c7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:30:48.861036 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-119b0e3b-c1f0-4a3e-9378-641c9e350d2a None None] Pushing event updated for resources: {'Port': ['ID=25fe9a61-dbff-4283-b107-964710e6f4ad,revision_number=3']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:48.866994 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-215fdeba-2d33-4d17-a179-11647d886d4c None None] Provisioning for port 5d9c4d5c-7c2e-4911-823a-3a3242707096 completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:30:48.875657 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-a41e1ac9-0d2b-4e8c-972e-9d665abbd4c7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Usage tracker for resource:port and tenant:7bac6d994f4d49b292bc39fac07c0311 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:30:48.879359 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-119b0e3b-c1f0-4a3e-9378-641c9e350d2a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.229s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:48.883103 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-a41e1ac9-0d2b-4e8c-972e-9d665abbd4c7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:30:48.892830 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] Routers {'a4b01ad1-d952-4deb-88df-6930ad4824db'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:30:48.893749 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae870dea30>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:30:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['a4b01ad1-d952-4deb-88df-6930ad4824db'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:30:48.901188 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-a41e1ac9-0d2b-4e8c-972e-9d665abbd4c7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:30:48.995524 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2253eb7f-4326-4162-8aa7-ec58231a0886 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:49.045598 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.55', 49870) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:49.054425 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-215fdeba-2d33-4d17-a179-11647d886d4c None None] Provisioning complete for port 5d9c4d5c-7c2e-4911-823a-3a3242707096 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:30:49.056272 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-215fdeba-2d33-4d17-a179-11647d886d4c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:49.069257 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-afc22330-334e-4c7f-bbbc-44a59dea0328 req-4acb0636-c7c4-45b6-b4b3-7a7c65896cc9 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 210 time: 0.0788100
Jun 03 08:30:49.115276 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-a41e1ac9-0d2b-4e8c-972e-9d665abbd4c7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Made reservation on behalf of 7bac6d994f4d49b292bc39fac07c0311 for: {'port': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:30:49.123291 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-a41e1ac9-0d2b-4e8c-972e-9d665abbd4c7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:49.186108 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2253eb7f-4326-4162-8aa7-ec58231a0886 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:49.204026 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:49.304528 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:49.328401 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.provisioning_blocks [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Transition to ACTIVE for port object 09aff824-d423-4557-8913-463e6f53d3e5 will not be triggered until provisioned by entity DHCP. {{(pid=92324) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:30:49.332283 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:49.396339 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-215fdeba-2d33-4d17-a179-11647d886d4c None None] Port 5d9c4d5c-7c2e-4911-823a-3a3242707096 cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:30:49.436352 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] Set router a4b01ad1-d952-4deb-88df-6930ad4824db gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:30:49.455856 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 46052) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:49.457873 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-2253eb7f-4326-4162-8aa7-ec58231a0886 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=9c5602b7a908440bb48eb5b8f9940199&name=default HTTP/1.1" status: 200  len: 2975 time: 1.6448174
Jun 03 08:30:49.607949 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:49.981110 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2253eb7f-4326-4162-8aa7-ec58231a0886 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f8099d0b-0d20-4758-8e5c-242001a5ed37,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:49.981110 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8423321-8a21-48cb-980d-4762935f20fb req-80d3f429-f2b5-4a12-8268-ff623878b240 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:30:49.984983 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:49.992905 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c8423321-8a21-48cb-980d-4762935f20fb req-80d3f429-f2b5-4a12-8268-ff623878b240 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.55 "GET /v2.0/networks?id=70332c9d-d098-4fc3-97a8-2773d2d72e48 HTTP/1.1" status: 200  len: 812 time: 0.6135521
Jun 03 08:30:49.992905 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-2253eb7f-4326-4162-8aa7-ec58231a0886 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.357s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:49.992905 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-c8423321-8a21-48cb-980d-4762935f20fb req-b2e08be7-d9d4-4cf9-8033-cfa9a81cf8b2 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Request body: {'port': {'device_id': 'de45acc4-ab6b-4eea-9e74-150c5641eb59', 'network_id': '70332c9d-d098-4fc3-97a8-2773d2d72e48', 'admin_state_up': True, 'tenant_id': '52d59e3293254fcc85972c62e654f494'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:30:49.993779 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:30:49.994915 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 46066) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:50.050052 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a79a0304-261f-4d16-b382-793f46687b81 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:50.300503 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port 3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:30:50.308260 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a7f092f0-aebd-4c23-9f93-7e9ab36f7362 req-3f873e74-a6b7-47a3-a0aa-0c05024fb776 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 210 time: 0.5436482
Jun 03 08:30:50.320422 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:30:50.320992 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:50.327935 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Network 020eaa43-2d59-46e1-8aec-0a688069f72b is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:30:50.338929 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:30:50.414346 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Received port after_create {{(pid=92324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:30:50.415157 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-16328800'] for router_interface, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:50.418885 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cb30f695-3ced-4394-b684-02bb061147f6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:50.441378 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Pushing event updated for resources: {'Port': ['ID=09aff824-d423-4557-8913-463e6f53d3e5,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:50.528400 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Notify callbacks [] for port, precommit_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:50.543743 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.884s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:50.553673 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-cb30f695-3ced-4394-b684-02bb061147f6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:30:50.558874 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a79a0304-261f-4d16-b382-793f46687b81 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:50.575097 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-cb30f695-3ced-4394-b684-02bb061147f6 admin admin] Usage tracker for resource:security_group_rule and tenant:1932a4c5f5dc4bd5bac08799be0b33c9 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:30:50.581706 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-cb30f695-3ced-4394-b684-02bb061147f6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:30:50.604832 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-cb30f695-3ced-4394-b684-02bb061147f6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:30:50.669173 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae870dea30>, [{'id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'name': 'tempest-AttachVolumeTestJSON-1767133114-router', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241'}], 'enable_snat': True}, 'gw_port_id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:38Z', 'updated_at': '2021-06-03T08:30:41Z', 'revision_number': 3, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'gw_port': {'id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:65:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:30:50.677310 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f027f09-5d50-4530-a3a7-acc0d7e23d50 None None] The sync data for ids ['a4b01ad1-d952-4deb-88df-6930ad4824db'] in dv-cinder-787262-5-iscsi is: [{'id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'name': 'tempest-AttachVolumeTestJSON-1767133114-router', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241'}], 'enable_snat': True}, 'gw_port_id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:38Z', 'updated_at': '2021-06-03T08:30:41Z', 'revision_number': 3, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'gw_port': {'id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:65:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:30:50.693810 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:50.739730 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-a41e1ac9-0d2b-4e8c-972e-9d665abbd4c7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Allocated IP 172.20.0.13 (f9db9a2a-942b-4a98-97ed-1896cb9158b4/5f3b55e2-964f-4ce8-9d71-3ac11dc6ebf1/24826ba2-ee17-4774-b5ca-2cd1675f325a) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:30:50.741911 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:50.742741 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port 3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:30:50.758032 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-16344774', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-16328707'] for router_interface, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:50.792269 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b66c5d00-9aa9-4af9-8003-13af08e034e4 req-75cac908-a9c9-458b-8c42-4d86824e2770 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 210 time: 0.1151214
Jun 03 08:30:50.812331 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:50.842157 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:50.848549 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-119b0e3b-c1f0-4a3e-9378-641c9e350d2a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:50.881100 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-c8423321-8a21-48cb-980d-4762935f20fb req-b2e08be7-d9d4-4cf9-8033-cfa9a81cf8b2 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:30:50.896577 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-c8423321-8a21-48cb-980d-4762935f20fb req-b2e08be7-d9d4-4cf9-8033-cfa9a81cf8b2 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Usage tracker for resource:port and tenant:52d59e3293254fcc85972c62e654f494 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:30:50.912492 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-c8423321-8a21-48cb-980d-4762935f20fb req-b2e08be7-d9d4-4cf9-8033-cfa9a81cf8b2 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:30:50.923114 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-c8423321-8a21-48cb-980d-4762935f20fb req-b2e08be7-d9d4-4cf9-8033-cfa9a81cf8b2 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:30:50.981786 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Pushing event updated for resources: {'Port': ['ID=5d9c4d5c-7c2e-4911-823a-3a3242707096,revision_number=2']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:51.004371 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:51.065828 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:51.075163 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.225s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:51.091494 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c8423321-8a21-48cb-980d-4762935f20fb req-b2e08be7-d9d4-4cf9-8033-cfa9a81cf8b2 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Made reservation on behalf of 52d59e3293254fcc85972c62e654f494 for: {'port': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:30:51.100716 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-c8423321-8a21-48cb-980d-4762935f20fb req-b2e08be7-d9d4-4cf9-8033-cfa9a81cf8b2 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:51.144362 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a79a0304-261f-4d16-b382-793f46687b81 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:51.169768 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:51.178557 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-2f801e12-9933-4d70-8095-19b4165c5970 None None] Provisioning for port 09aff824-d423-4557-8913-463e6f53d3e5 completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:30:51.184985 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-2f801e12-9933-4d70-8095-19b4165c5970 None None] Provisioning complete for port 09aff824-d423-4557-8913-463e6f53d3e5 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:30:51.185914 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-2f801e12-9933-4d70-8095-19b4165c5970 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:51.308763 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-2f801e12-9933-4d70-8095-19b4165c5970 None None] Port 09aff824-d423-4557-8913-463e6f53d3e5 cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:30:51.349341 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a79a0304-261f-4d16-b382-793f46687b81 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f8099d0b-0d20-4758-8e5c-242001a5ed37,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:51.373256 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-a79a0304-261f-4d16-b382-793f46687b81 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.204s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:51.474219 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Network 958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:30:51.581601 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:30:51.787699 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a79a0304-261f-4d16-b382-793f46687b81 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:51.788888 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-a79a0304-261f-4d16-b382-793f46687b81 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/f8099d0b-0d20-4758-8e5c-242001a5ed37 HTTP/1.1" status: 204  len: 168 time: 2.3319407
Jun 03 08:30:51.791087 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cb30f695-3ced-4394-b684-02bb061147f6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:51.854880 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:30:52.094046 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cb30f695-3ced-4394-b684-02bb061147f6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:52.121250 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:52.142758 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:30:52.142758 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:52.242640 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f6ee2dcd-23b8-462b-abf7-1ac27beddde1 req-abe6f725-9c8d-4801-a4a3-797e6a56d200 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 210 time: 0.3678286
Jun 03 08:30:52.244922 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:52.493852 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-010cca78-70a8-40bc-a846-833ba41bf831 None None] Provisioning complete for port 5d9c4d5c-7c2e-4911-823a-3a3242707096 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:30:52.495657 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-010cca78-70a8-40bc-a846-833ba41bf831 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:52.532919 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-a41e1ac9-0d2b-4e8c-972e-9d665abbd4c7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:52.578181 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [req-c8423321-8a21-48cb-980d-4762935f20fb req-b2e08be7-d9d4-4cf9-8033-cfa9a81cf8b2 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Allocated IP 172.20.0.5 (70332c9d-d098-4fc3-97a8-2773d2d72e48/3c41763f-e17d-4df7-96ea-31656322a752/764aa3d0-d145-4744-9cb1-e9bdd5654748) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:30:52.783903 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 25fe9a61-dbff-4283-b107-964710e6f4ad up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:30:52.912014 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-010cca78-70a8-40bc-a846-833ba41bf831 None None] Port 5d9c4d5c-7c2e-4911-823a-3a3242707096 cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:30:52.985095 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-70d072ba-ea5c-4dc5-8bd3-484b6d4bfce5 req-d6123d67-2b55-4e09-89a8-87169700ec29 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 210 time: 0.7912798
Jun 03 08:30:53.026059 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb30f695-3ced-4394-b684-02bb061147f6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=705e1cd7-3552-4526-9417-0ea948a4facc,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:53.039082 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-cb30f695-3ced-4394-b684-02bb061147f6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.797s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:53.048301 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-cb30f695-3ced-4394-b684-02bb061147f6 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=1932a4c5f5dc4bd5bac08799be0b33c9&name=default HTTP/1.1" status: 200  len: 2975 time: 3.1034977
Jun 03 08:30:53.051946 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 46116) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:53.084244 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port 25fe9a61-dbff-4283-b107-964710e6f4ad completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:30:53.092485 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 25fe9a61-dbff-4283-b107-964710e6f4ad triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:30:53.092872 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:53.114073 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Router cb358121-3d7d-46b4-8e93-e40d5a92215c has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:30:53.360072 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-a41e1ac9-0d2b-4e8c-972e-9d665abbd4c7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:53.502666 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-8a6f5028-8da1-4ca0-b294-effc06e1fb18 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.002s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:53.511263 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:53.578065 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port 25fe9a61-dbff-4283-b107-964710e6f4ad, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=25fe9a61-dbff-4283-b107-964710e6f4ad,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:30:53.667147 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:53.669708 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-119b0e3b-c1f0-4a3e-9378-641c9e350d2a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:53.815359 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a41e1ac9-0d2b-4e8c-972e-9d665abbd4c7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Pushing event updated for resources: {'Port': ['ID=24826ba2-ee17-4774-b5ca-2cd1675f325a,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:53.919797 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=25fe9a61-dbff-4283-b107-964710e6f4ad,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:53.924955 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.255s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:53.975734 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a41e1ac9-0d2b-4e8c-972e-9d665abbd4c7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.472s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:54.042335 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f3c297ad-3271-4477-9063-8c26cca98f88 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:54.052902 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-a41e1ac9-0d2b-4e8c-972e-9d665abbd4c7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Network f9db9a2a-942b-4a98-97ed-1896cb9158b4 is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:30:54.066234 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-40e799ee-bc02-4da7-ab08-5cae1024126f req-bb9b7876-f0b8-4d7c-a345-ff1d7e06abf7 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 210 time: 0.2890844
Jun 03 08:30:54.077462 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-a41e1ac9-0d2b-4e8c-972e-9d665abbd4c7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:30:54.098924 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-a41e1ac9-0d2b-4e8c-972e-9d665abbd4c7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:30:54.116275 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-a41e1ac9-0d2b-4e8c-972e-9d665abbd4c7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:30:54.117136 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-a41e1ac9-0d2b-4e8c-972e-9d665abbd4c7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:54.160971 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-c8423321-8a21-48cb-980d-4762935f20fb req-b2e08be7-d9d4-4cf9-8033-cfa9a81cf8b2 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:54.229595 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f3c297ad-3271-4477-9063-8c26cca98f88 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:54.287088 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-a41e1ac9-0d2b-4e8c-972e-9d665abbd4c7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.55 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 5.8123856
Jun 03 08:30:54.295530 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-bccbb05a-8fbc-4c40-9662-ac79115f964b tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=92323) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 03 08:30:54.296869 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-bccbb05a-8fbc-4c40-9662-ac79115f964b tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.55 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0079217
Jun 03 08:30:54.366358 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:30:54.379559 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] 10.222.0.11 "PUT /v2.0/routers/cb358121-3d7d-46b4-8e93-e40d5a92215c/add_router_interface HTTP/1.1" status: 200  len: 503 time: 10.7999852
Jun 03 08:30:54.409651 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] Sync routers for ids ['cb358121-3d7d-46b4-8e93-e40d5a92215c'] in dv-cinder-787262-5-iscsi {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:30:54.418237 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:54.446754 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44923e34-ecdb-4f58-a5ef-751452fc58ea req-f9eb9cc3-fd46-459f-8d73-5f179cfafc20 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:30:54.455148 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-44923e34-ecdb-4f58-a5ef-751452fc58ea req-f9eb9cc3-fd46-459f-8d73-5f179cfafc20 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 932 time: 0.2282124
Jun 03 08:30:54.456334 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] Routers {'cb358121-3d7d-46b4-8e93-e40d5a92215c'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:30:54.457121 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86c6fe20>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:30:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['cb358121-3d7d-46b4-8e93-e40d5a92215c'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:30:54.475699 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-c8423321-8a21-48cb-980d-4762935f20fb req-b2e08be7-d9d4-4cf9-8033-cfa9a81cf8b2 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:54.488767 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:54.541789 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:54.589708 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-16344774', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-16328707'] for router_interface, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:54.604052 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:54.787900 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2e08be7-d9d4-4cf9-8033-cfa9a81cf8b2 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Pushing event updated for resources: {'Port': ['ID=764aa3d0-d145-4744-9cb1-e9bdd5654748,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:54.795853 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f3c297ad-3271-4477-9063-8c26cca98f88 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:54.802047 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b2e08be7-d9d4-4cf9-8033-cfa9a81cf8b2 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.318s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:54.820267 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:54.840307 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c8423321-8a21-48cb-980d-4762935f20fb req-b2e08be7-d9d4-4cf9-8033-cfa9a81cf8b2 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Network 70332c9d-d098-4fc3-97a8-2773d2d72e48 is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:30:54.842393 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3c297ad-3271-4477-9063-8c26cca98f88 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=705e1cd7-3552-4526-9417-0ea948a4facc,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:54.846551 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [req-c8423321-8a21-48cb-980d-4762935f20fb req-b2e08be7-d9d4-4cf9-8033-cfa9a81cf8b2 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:30:54.851195 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f3c297ad-3271-4477-9063-8c26cca98f88 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:54.872823 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-c8423321-8a21-48cb-980d-4762935f20fb req-b2e08be7-d9d4-4cf9-8033-cfa9a81cf8b2 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:30:54.892844 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8423321-8a21-48cb-980d-4762935f20fb req-b2e08be7-d9d4-4cf9-8033-cfa9a81cf8b2 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:30:54.895376 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-c8423321-8a21-48cb-980d-4762935f20fb req-b2e08be7-d9d4-4cf9-8033-cfa9a81cf8b2 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:54.944801 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f3c297ad-3271-4477-9063-8c26cca98f88 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:54.954072 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-f3c297ad-3271-4477-9063-8c26cca98f88 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/705e1cd7-3552-4526-9417-0ea948a4facc HTTP/1.1" status: 204  len: 168 time: 1.8805068
Jun 03 08:30:54.986103 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-44923e34-ecdb-4f58-a5ef-751452fc58ea req-1bf188da-6958-4cd2-a92f-5835b050ee1b tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Synchronizing usage tracker for tenant:7bac6d994f4d49b292bc39fac07c0311 on resource:security_group {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:30:54.993882 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Request body: {'port': {'device_id': '0a3d1adc-5874-4a88-8aee-893097ee9077', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:30:55.133100 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c8423321-8a21-48cb-980d-4762935f20fb req-b2e08be7-d9d4-4cf9-8033-cfa9a81cf8b2 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.55 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 5.4545517
Jun 03 08:30:55.187291 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-c8423321-8a21-48cb-980d-4762935f20fb req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Request body: {'port': {'device_id': 'de45acc4-ab6b-4eea-9e74-150c5641eb59', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:30:55.214939 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] Set router cb358121-3d7d-46b4-8e93-e40d5a92215c gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:30:55.305254 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Pushing event updated for resources: {'Port': ['ID=09aff824-d423-4557-8913-463e6f53d3e5,revision_number=2']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:55.379555 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.771s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:55.391387 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:55.546731 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-44923e34-ecdb-4f58-a5ef-751452fc58ea req-1bf188da-6958-4cd2-a92f-5835b050ee1b tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Unset dirty status for tenant:7bac6d994f4d49b292bc39fac07c0311 on resource:security_group {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:30:55.558592 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-44923e34-ecdb-4f58-a5ef-751452fc58ea req-1bf188da-6958-4cd2-a92f-5835b050ee1b tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 1.1021857
Jun 03 08:30:55.604583 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Network 020eaa43-2d59-46e1-8aec-0a688069f72b is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:30:55.608461 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:30:55.673174 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-c8423321-8a21-48cb-980d-4762935f20fb req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:55.898168 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 25fe9a61-dbff-4283-b107-964710e6f4ad up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:30:56.236750 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86c6fe20>, [{'id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-router', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:37Z', 'updated_at': '2021-06-03T08:30:48Z', 'revision_number': 4, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'gw_port': {'id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:11:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '5d9c4d5c-7c2e-4911-823a-3a3242707096', 'name': '', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'mac_address': 'fa:16:3e:0c:7e:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_interface', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:46Z', 'updated_at': '2021-06-03T08:30:49Z', 'revision_number': 2, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'subnets': [{'id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:30:56.252989 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] Checking router: cb358121-3d7d-46b4-8e93-e40d5a92215c for host: dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:30:56.253348 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] Updating router cb358121-3d7d-46b4-8e93-e40d5a92215c port 5d9c4d5c-7c2e-4911-823a-3a3242707096 binding host dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 03 08:30:56.388179 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-22baf81d-01f2-47ad-b8a1-552d1c920bea None None] Provisioning complete for port 09aff824-d423-4557-8913-463e6f53d3e5 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:30:56.393925 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-22baf81d-01f2-47ad-b8a1-552d1c920bea None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:56.401537 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:56.500111 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-708041bd-f649-4ef0-a837-637449430be6 req-c8577cd6-956d-4a07-b0c0-3e4169cc6a2d tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:30:56.527943 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-708041bd-f649-4ef0-a837-637449430be6 req-c8577cd6-956d-4a07-b0c0-3e4169cc6a2d tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 931 time: 0.3770173
Jun 03 08:30:56.533930 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:56.537641 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 25fe9a61-dbff-4283-b107-964710e6f4ad triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:30:56.544837 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:56.600585 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Router a4b01ad1-d952-4deb-88df-6930ad4824db has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:30:56.710626 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-22baf81d-01f2-47ad-b8a1-552d1c920bea None None] Port 09aff824-d423-4557-8913-463e6f53d3e5 cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:30:56.937625 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-708041bd-f649-4ef0-a837-637449430be6 req-fc9044e0-8915-40e3-b91d-2c335cabf2ef tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Synchronizing usage tracker for tenant:52d59e3293254fcc85972c62e654f494 on resource:security_group {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:30:57.238531 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-708041bd-f649-4ef0-a837-637449430be6 req-fc9044e0-8915-40e3-b91d-2c335cabf2ef tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Unset dirty status for tenant:52d59e3293254fcc85972c62e654f494 on resource:security_group {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:30:57.239704 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-708041bd-f649-4ef0-a837-637449430be6 req-fc9044e0-8915-40e3-b91d-2c335cabf2ef tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/security-groups?id=12cbc694-d459-4366-b758-44d0f16106cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.7109869
Jun 03 08:30:57.347895 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [req-c8423321-8a21-48cb-980d-4762935f20fb req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 764aa3d0-d145-4744-9cb1-e9bdd5654748 {{(pid=92323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:30:57.365382 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:30:57.371444 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] 10.222.0.11 "PUT /v2.0/routers/a4b01ad1-d952-4deb-88df-6930ad4824db/add_router_interface HTTP/1.1" status: 200  len: 503 time: 11.9384639
Jun 03 08:30:57.382739 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] Sync routers for ids ['a4b01ad1-d952-4deb-88df-6930ad4824db'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:30:57.398621 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] Routers {'a4b01ad1-d952-4deb-88df-6930ad4824db'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:30:57.399468 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae87a986d0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:30:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['a4b01ad1-d952-4deb-88df-6930ad4824db'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:30:57.403942 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] Notify callbacks [] for port, precommit_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:57.421672 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.provisioning_blocks [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] Transition to ACTIVE for port object 5d9c4d5c-7c2e-4911-823a-3a3242707096 will not be triggered until provisioned by entity L2. {{(pid=92326) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:30:57.435889 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-c8423321-8a21-48cb-980d-4762935f20fb req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:57.503754 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:57.506460 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-c8423321-8a21-48cb-980d-4762935f20fb req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Transition to ACTIVE for port object 764aa3d0-d145-4744-9cb1-e9bdd5654748 will not be triggered until provisioned by entity L2. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:30:57.512236 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-24cb7957-ac10-4253-ac02-b993427cf35d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:57.621100 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 46220) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:30:57.629729 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-b3c68e00-e145-4be7-af90-0e6c11c19664 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1548890539', 'description': 'tempest-description--600918554'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:30:57.649076 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-c8423321-8a21-48cb-980d-4762935f20fb req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:57.653090 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-b3c68e00-e145-4be7-af90-0e6c11c19664 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:30:57.691044 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b2e08be7-d9d4-4cf9-8033-cfa9a81cf8b2 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:57.830330 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-b3c68e00-e145-4be7-af90-0e6c11c19664 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Usage tracker for resource:security_group and tenant:36c42f532cd14f19811ffbee3a39a208 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:30:58.017505 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] Set router a4b01ad1-d952-4deb-88df-6930ad4824db gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:30:58.080035 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-b3c68e00-e145-4be7-af90-0e6c11c19664 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:30:58.099476 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Pushing event updated for resources: {'Port': ['ID=764aa3d0-d145-4744-9cb1-e9bdd5654748,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:58.157213 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4606a4e-37e4-4641-88dd-ceff1af5ca43 None None] Pushing event updated for resources: {'Port': ['ID=5d9c4d5c-7c2e-4911-823a-3a3242707096,revision_number=3']} {{(pid=92326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:58.171591 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-f4606a4e-37e4-4641-88dd-ceff1af5ca43 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.659s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:58.183301 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] Attempting to bind port 5d9c4d5c-7c2e-4911-823a-3a3242707096 on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:30:58.184268 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] Attempting to bind port 5d9c4d5c-7c2e-4911-823a-3a3242707096 by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '377c6f4a-d9be-4dae-86db-35230d8009c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba'}] {{(pid=92326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:30:58.186806 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] Attempting to bind port 5d9c4d5c-7c2e-4911-823a-3a3242707096 on network 958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:30:58.204410 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 30, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:30:58.204943 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] Checking segment: {'id': '377c6f4a-d9be-4dae-86db-35230d8009c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92326) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:30:58.205504 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:58.208092 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] Bound using segment: {'id': '377c6f4a-d9be-4dae-86db-35230d8009c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba'} {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:30:58.209723 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] Bound port: 5d9c4d5c-7c2e-4911-823a-3a3242707096, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '377c6f4a-d9be-4dae-86db-35230d8009c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba'}}] {{(pid=92326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:30:58.211371 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:58.239098 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-b3c68e00-e145-4be7-af90-0e6c11c19664 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:30:58.296058 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.605s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:58.383827 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.db [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] For port 5d9c4d5c-7c2e-4911-823a-3a3242707096, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92326) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:30:58.389574 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.db [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] For port 5d9c4d5c-7c2e-4911-823a-3a3242707096, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=5d9c4d5c-7c2e-4911-823a-3a3242707096,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92326) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:30:58.466207 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:58.472433 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:58.618221 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] Routers {'cb358121-3d7d-46b4-8e93-e40d5a92215c'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:30:58.620097 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86c6fe20>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:30:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['cb358121-3d7d-46b4-8e93-e40d5a92215c'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:30:58.772455 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-c8423321-8a21-48cb-980d-4762935f20fb req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Attempting to bind port 764aa3d0-d145-4744-9cb1-e9bdd5654748 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:30:58.773024 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-c8423321-8a21-48cb-980d-4762935f20fb req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Attempting to bind port 764aa3d0-d145-4744-9cb1-e9bdd5654748 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '5a5b66b5-9e55-4a2d-87ec-5d31f3999401', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '70332c9d-d098-4fc3-97a8-2773d2d72e48'}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:30:58.773604 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8423321-8a21-48cb-980d-4762935f20fb req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Attempting to bind port 764aa3d0-d145-4744-9cb1-e9bdd5654748 on network 70332c9d-d098-4fc3-97a8-2773d2d72e48 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:30:58.795069 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b3c68e00-e145-4be7-af90-0e6c11c19664 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:58.822473 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8423321-8a21-48cb-980d-4762935f20fb req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Port 764aa3d0-d145-4744-9cb1-e9bdd5654748 on network 70332c9d-d098-4fc3-97a8-2773d2d72e48 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 03 08:30:58.823022 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8423321-8a21-48cb-980d-4762935f20fb req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Attempting to bind port 764aa3d0-d145-4744-9cb1-e9bdd5654748 on network 70332c9d-d098-4fc3-97a8-2773d2d72e48 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:30:58.850457 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8423321-8a21-48cb-980d-4762935f20fb req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Checking agent: {'id': '181c5753-100b-4f03-bda8-e34279b057f4', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'started_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 30, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:30:58.851370 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8423321-8a21-48cb-980d-4762935f20fb req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Checking segment: {'id': '5a5b66b5-9e55-4a2d-87ec-5d31f3999401', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '70332c9d-d098-4fc3-97a8-2773d2d72e48'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:30:58.851988 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c8423321-8a21-48cb-980d-4762935f20fb req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Bound using segment: {'id': '5a5b66b5-9e55-4a2d-87ec-5d31f3999401', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '70332c9d-d098-4fc3-97a8-2773d2d72e48'} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:30:58.852458 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-c8423321-8a21-48cb-980d-4762935f20fb req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Bound port: 764aa3d0-d145-4744-9cb1-e9bdd5654748, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5a5b66b5-9e55-4a2d-87ec-5d31f3999401', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 544, 'network_id': '70332c9d-d098-4fc3-97a8-2773d2d72e48'}}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:30:58.853084 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-c8423321-8a21-48cb-980d-4762935f20fb req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:59.003096 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-b3c68e00-e145-4be7-af90-0e6c11c19664 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:30:59.005792 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae87a986d0>, [{'id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'name': 'tempest-AttachVolumeTestJSON-1767133114-router', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241'}], 'enable_snat': True}, 'gw_port_id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:38Z', 'updated_at': '2021-06-03T08:30:51Z', 'revision_number': 4, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'gw_port': {'id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:65:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '09aff824-d423-4557-8913-463e6f53d3e5', 'name': '', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'mac_address': 'fa:16:3e:c4:92:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_interface', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:47Z', 'updated_at': '2021-06-03T08:30:53Z', 'revision_number': 2, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'subnets': [{'id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:30:59.011588 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] Checking router: a4b01ad1-d952-4deb-88df-6930ad4824db for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:30:59.011951 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] Updating router a4b01ad1-d952-4deb-88df-6930ad4824db port 09aff824-d423-4557-8913-463e6f53d3e5 binding host dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 03 08:30:59.028250 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 24826ba2-ee17-4774-b5ca-2cd1675f325a {{(pid=92323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:30:59.046601 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-b3c68e00-e145-4be7-af90-0e6c11c19664 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Usage tracker for resource:security_group_rule and tenant:36c42f532cd14f19811ffbee3a39a208 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:30:59.064234 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-b3c68e00-e145-4be7-af90-0e6c11c19664 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:30:59.091231 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:59.093001 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:59.116749 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-b3c68e00-e145-4be7-af90-0e6c11c19664 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:30:59.129391 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-c8423321-8a21-48cb-980d-4762935f20fb req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] For port 764aa3d0-d145-4744-9cb1-e9bdd5654748, host hv-cinder-78726, cleared binding levels {{(pid=92323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:30:59.148712 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-c8423321-8a21-48cb-980d-4762935f20fb req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] For port 764aa3d0-d145-4744-9cb1-e9bdd5654748, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=764aa3d0-d145-4744-9cb1-e9bdd5654748,segment=NetworkSegment(5a5b66b5-9e55-4a2d-87ec-5d31f3999401),segment_id=5a5b66b5-9e55-4a2d-87ec-5d31f3999401)] {{(pid=92323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:30:59.149776 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4606a4e-37e4-4641-88dd-ceff1af5ca43 None None] Pushing event updated for resources: {'Port': ['ID=5d9c4d5c-7c2e-4911-823a-3a3242707096,revision_number=4']} {{(pid=92326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:30:59.172439 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed147a53-32f9-4d9c-b0a3-078f7aa57328 req-47ad31f1-25ef-4f6d-9002-c17de6246970 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:30:59.174655 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-ed147a53-32f9-4d9c-b0a3-078f7aa57328 req-47ad31f1-25ef-4f6d-9002-c17de6246970 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Synchronizing usage tracker for tenant:7bac6d994f4d49b292bc39fac07c0311 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:30:59.191911 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Transition to ACTIVE for port object 24826ba2-ee17-4774-b5ca-2cd1675f325a will not be triggered until provisioned by entity L2. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:30:59.194908 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-f4606a4e-37e4-4641-88dd-ceff1af5ca43 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.722s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:30:59.248308 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] Set router cb358121-3d7d-46b4-8e93-e40d5a92215c gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:30:59.299674 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-c8423321-8a21-48cb-980d-4762935f20fb req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:59.300684 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:59.345307 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:30:59.476419 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-ed147a53-32f9-4d9c-b0a3-078f7aa57328 req-47ad31f1-25ef-4f6d-9002-c17de6246970 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Unset dirty status for tenant:7bac6d994f4d49b292bc39fac07c0311 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:30:59.492884 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ed147a53-32f9-4d9c-b0a3-078f7aa57328 req-47ad31f1-25ef-4f6d-9002-c17de6246970 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 932 time: 1.2677610
Jun 03 08:30:59.568793 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b3c68e00-e145-4be7-af90-0e6c11c19664 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:59.678273 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8423321-8a21-48cb-980d-4762935f20fb req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:30:59.679021 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-c8423321-8a21-48cb-980d-4762935f20fb req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:59.680432 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c8423321-8a21-48cb-980d-4762935f20fb req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] 10.222.0.55 "PUT /v2.0/ports/764aa3d0-d145-4744-9cb1-e9bdd5654748 HTTP/1.1" status: 200  len: 1093 time: 4.5192997
Jun 03 08:30:59.685926 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'de45acc4-ab6b-4eea-9e74-150c5641eb59', 'tag': '764aa3d0-d145-4744-9cb1-e9bdd5654748'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:30:59.771341 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b3c68e00-e145-4be7-af90-0e6c11c19664 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:30:59.941619 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ed147a53-32f9-4d9c-b0a3-078f7aa57328 req-c25615f8-98c2-4142-a6da-02ba6e56edf0 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4478390
Jun 03 08:30:59.946122 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Pushing event updated for resources: {'Port': ['ID=764aa3d0-d145-4744-9cb1-e9bdd5654748,revision_number=3']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:00.247100 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] Notify callbacks [] for port, precommit_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:00.247100 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] Transition to ACTIVE for port object 09aff824-d423-4557-8913-463e6f53d3e5 will not be triggered until provisioned by entity L2. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:31:00.247956 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86c6fe20>, [{'id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-router', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:37Z', 'updated_at': '2021-06-03T08:30:48Z', 'revision_number': 4, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'gw_port': {'id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:11:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '5d9c4d5c-7c2e-4911-823a-3a3242707096', 'name': '', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'mac_address': 'fa:16:3e:0c:7e:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_interface', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:46Z', 'updated_at': '2021-06-03T08:30:58Z', 'revision_number': 4, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'subnets': [{'id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:31:00.248566 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19feaf93-fee8-4041-b888-a4bd6400b301 None None] The sync data for ids ['cb358121-3d7d-46b4-8e93-e40d5a92215c'] in dv-cinder-787262-5-iscsi is: [{'id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-router', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:37Z', 'updated_at': '2021-06-03T08:30:48Z', 'revision_number': 4, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'gw_port': {'id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:11:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '5d9c4d5c-7c2e-4911-823a-3a3242707096', 'name': '', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'mac_address': 'fa:16:3e:0c:7e:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_interface', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:46Z', 'updated_at': '2021-06-03T08:30:58Z', 'revision_number': 4, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'subnets': [{'id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:31:00.248941 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-52f1a056-ecfd-46de-8d58-a76f49164af3" -d '{"events": [{"name": "network-changed", "server_uuid": "de45acc4-ab6b-4eea-9e74-150c5641eb59", "tag": "764aa3d0-d145-4744-9cb1-e9bdd5654748"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:31:00.315553 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Attempting to bind port 24826ba2-ee17-4774-b5ca-2cd1675f325a on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:31:00.316104 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Attempting to bind port 24826ba2-ee17-4774-b5ca-2cd1675f325a by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '9923ac74-9556-45ec-9044-43728d2a8ec3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4'}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:31:00.316539 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Attempting to bind port 24826ba2-ee17-4774-b5ca-2cd1675f325a on network f9db9a2a-942b-4a98-97ed-1896cb9158b4 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:31:00.325860 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Pushing event updated for resources: {'Port': ['ID=24826ba2-ee17-4774-b5ca-2cd1675f325a,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:00.341407 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.996s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:00.364650 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.712s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:00.364650 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:00.369548 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.467s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:00.406128 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Port 24826ba2-ee17-4774-b5ca-2cd1675f325a on network f9db9a2a-942b-4a98-97ed-1896cb9158b4 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 03 08:31:00.418811 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Attempting to bind port 24826ba2-ee17-4774-b5ca-2cd1675f325a on network f9db9a2a-942b-4a98-97ed-1896cb9158b4 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:31:00.445793 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b3c68e00-e145-4be7-af90-0e6c11c19664 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:00.448392 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-b3c68e00-e145-4be7-af90-0e6c11c19664 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1777 time: 2.8262169
Jun 03 08:31:00.452408 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 46292) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:00.464375 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-ab15e5e3-61f2-4424-89a8-b4d4c096b9e8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Request body: {'security_group_rule': {'security_group_id': '548f6ffb-55f0-4e53-89ee-7d877c658fda', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:31:00.468518 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Checking agent: {'id': '181c5753-100b-4f03-bda8-e34279b057f4', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'started_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 30, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:31:00.469186 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Checking segment: {'id': '9923ac74-9556-45ec-9044-43728d2a8ec3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:31:00.469786 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Bound using segment: {'id': '9923ac74-9556-45ec-9044-43728d2a8ec3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4'} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:31:00.470461 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Bound port: 24826ba2-ee17-4774-b5ca-2cd1675f325a, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9923ac74-9556-45ec-9044-43728d2a8ec3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4'}}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:31:00.471200 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:00.472723 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-ab15e5e3-61f2-4424-89a8-b4d4c096b9e8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:00.481831 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-ab15e5e3-61f2-4424-89a8-b4d4c096b9e8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Usage tracker for resource:security_group_rule and tenant:36c42f532cd14f19811ffbee3a39a208 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:00.487566 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-ab15e5e3-61f2-4424-89a8-b4d4c096b9e8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:00.504950 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-ab15e5e3-61f2-4424-89a8-b4d4c096b9e8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:00.522191 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3c68e00-e145-4be7-af90-0e6c11c19664 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Pushing event updated for resources: {'SecurityGroup': ['ID=548f6ffb-55f0-4e53-89ee-7d877c658fda,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:00.574364 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b3c68e00-e145-4be7-af90-0e6c11c19664 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.205s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:00.637262 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8423321-8a21-48cb-980d-4762935f20fb req-5e24533e-9782-4992-ae31-f9c0fdf40915 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:00.639714 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c8423321-8a21-48cb-980d-4762935f20fb req-5e24533e-9782-4992-ae31-f9c0fdf40915 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=52d59e3293254fcc85972c62e654f494&device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 1096 time: 0.5283642
Jun 03 08:31:00.690398 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4600b350-859c-4d58-a05c-20482eff0cd0 req-65306fc8-a699-408a-b150-32bdf2638aba tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:00.695480 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-4600b350-859c-4d58-a05c-20482eff0cd0 req-65306fc8-a699-408a-b150-32bdf2638aba tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Synchronizing usage tracker for tenant:52d59e3293254fcc85972c62e654f494 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:31:00.702787 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] For port 24826ba2-ee17-4774-b5ca-2cd1675f325a, host hv-cinder-78726, cleared binding levels {{(pid=92323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:31:00.707616 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] For port 24826ba2-ee17-4774-b5ca-2cd1675f325a, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=24826ba2-ee17-4774-b5ca-2cd1675f325a,segment=NetworkSegment(9923ac74-9556-45ec-9044-43728d2a8ec3),segment_id=9923ac74-9556-45ec-9044-43728d2a8ec3)] {{(pid=92323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:31:00.916024 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:00.930900 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:01.211365 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab9d6f51-044c-42a6-8fa7-1e88fe51cee0 None None] Pushing event updated for resources: {'Port': ['ID=09aff824-d423-4557-8913-463e6f53d3e5,revision_number=3']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:01.225605 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-ab9d6f51-044c-42a6-8fa7-1e88fe51cee0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.303s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:01.317237 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] Attempting to bind port 09aff824-d423-4557-8913-463e6f53d3e5 on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:31:01.318001 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] Attempting to bind port 09aff824-d423-4557-8913-463e6f53d3e5 by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '56366949-8cc8-4cf3-b3eb-d458d3515059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 531, 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b'}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:31:01.318001 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] Attempting to bind port 09aff824-d423-4557-8913-463e6f53d3e5 on network 020eaa43-2d59-46e1-8aec-0a688069f72b {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:31:01.325145 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 30, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:31:01.342148 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] Checking segment: {'id': '56366949-8cc8-4cf3-b3eb-d458d3515059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 531, 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:31:01.342148 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:01.342148 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] Bound using segment: {'id': '56366949-8cc8-4cf3-b3eb-d458d3515059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 531, 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b'} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:31:01.342148 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] Bound port: 09aff824-d423-4557-8913-463e6f53d3e5, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56366949-8cc8-4cf3-b3eb-d458d3515059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 531, 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b'}}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:31:01.342148 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:01.455732 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ab15e5e3-61f2-4424-89a8-b4d4c096b9e8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:01.512089 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] For port 09aff824-d423-4557-8913-463e6f53d3e5, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:31:01.515510 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] For port 09aff824-d423-4557-8913-463e6f53d3e5, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=09aff824-d423-4557-8913-463e6f53d3e5,segment=NetworkSegment(56366949-8cc8-4cf3-b3eb-d458d3515059),segment_id=56366949-8cc8-4cf3-b3eb-d458d3515059)] {{(pid=92325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:31:01.538237 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ab15e5e3-61f2-4424-89a8-b4d4c096b9e8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:01.594805 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:01.594805 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:01.668633 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 46308) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:01.674883 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-23b0ae51-1d8e-4eb9-bc55-9a238fe2a364 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1688928482', 'description': 'tempest-description--1746383693'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:31:01.693185 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-23b0ae51-1d8e-4eb9-bc55-9a238fe2a364 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:01.707261 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-23b0ae51-1d8e-4eb9-bc55-9a238fe2a364 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Usage tracker for resource:security_group and tenant:755371c3d9de4747a47ba62e4d101829 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:01.715280 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-23b0ae51-1d8e-4eb9-bc55-9a238fe2a364 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:01.732550 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-23b0ae51-1d8e-4eb9-bc55-9a238fe2a364 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:01.775689 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ab15e5e3-61f2-4424-89a8-b4d4c096b9e8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:01.775959 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:01.782617 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.002s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:01.787688 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-b62912f7-df93-4d48-bf58-7f37b4469fb2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:01.849663 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Pushing event updated for resources: {'Port': ['ID=24826ba2-ee17-4774-b5ca-2cd1675f325a,revision_number=3']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:01.862812 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-4600b350-859c-4d58-a05c-20482eff0cd0 req-65306fc8-a699-408a-b150-32bdf2638aba tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Unset dirty status for tenant:52d59e3293254fcc85972c62e654f494 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:31:01.866934 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4600b350-859c-4d58-a05c-20482eff0cd0 req-65306fc8-a699-408a-b150-32bdf2638aba tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 943 time: 1.6358094
Jun 03 08:31:01.866934 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.273s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:01.867526 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:01.868303 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:01.870538 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] 10.222.0.55 "PUT /v2.0/ports/24826ba2-ee17-4774-b5ca-2cd1675f325a HTTP/1.1" status: 200  len: 1094 time: 7.0994275
Jun 03 08:31:01.889992 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-23b0ae51-1d8e-4eb9-bc55-9a238fe2a364 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:01.923324 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab15e5e3-61f2-4424-89a8-b4d4c096b9e8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ebfa2682-7fb1-4bf3-a980-32b8aba4289e,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:01.930451 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-ab15e5e3-61f2-4424-89a8-b4d4c096b9e8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:01.948759 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 5d9c4d5c-7c2e-4911-823a-3a3242707096 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:31:01.951921 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ab15e5e3-61f2-4424-89a8-b4d4c096b9e8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:01.953141 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-ab15e5e3-61f2-4424-89a8-b4d4c096b9e8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 1.4996932
Jun 03 08:31:01.955804 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 46312) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:01.974269 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-23b0ae51-1d8e-4eb9-bc55-9a238fe2a364 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:02.007924 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-759c0ea3-1358-4f01-b607-43761bcef660 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Request body: {'security_group_rule': {'security_group_id': '548f6ffb-55f0-4e53-89ee-7d877c658fda', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:31:02.018190 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-759c0ea3-1358-4f01-b607-43761bcef660 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:02.031100 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-759c0ea3-1358-4f01-b607-43761bcef660 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Usage tracker for resource:security_group_rule and tenant:36c42f532cd14f19811ffbee3a39a208 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:02.031100 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-759c0ea3-1358-4f01-b607-43761bcef660 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:02.031957 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4600b350-859c-4d58-a05c-20482eff0cd0 req-7377fdbb-d401-4001-8ca5-6dcfa80f0768 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/security-groups?id=12cbc694-d459-4366-b758-44d0f16106cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1482594
Jun 03 08:31:02.038122 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-759c0ea3-1358-4f01-b607-43761bcef660 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:02.090206 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-23b0ae51-1d8e-4eb9-bc55-9a238fe2a364 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Usage tracker for resource:security_group_rule and tenant:755371c3d9de4747a47ba62e4d101829 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:02.097032 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-23b0ae51-1d8e-4eb9-bc55-9a238fe2a364 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:02.105907 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] Routers {'a4b01ad1-d952-4deb-88df-6930ad4824db'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:31:02.107148 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae87a986d0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:30:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['a4b01ad1-d952-4deb-88df-6930ad4824db'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:31:02.120128 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-23b0ae51-1d8e-4eb9-bc55-9a238fe2a364 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:02.183560 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-759c0ea3-1358-4f01-b607-43761bcef660 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:02.274765 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab9d6f51-044c-42a6-8fa7-1e88fe51cee0 None None] Pushing event updated for resources: {'Port': ['ID=09aff824-d423-4557-8913-463e6f53d3e5,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:02.314571 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-ab9d6f51-044c-42a6-8fa7-1e88fe51cee0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.525s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:02.321099 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-23b0ae51-1d8e-4eb9-bc55-9a238fe2a364 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:02.327840 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-759c0ea3-1358-4f01-b607-43761bcef660 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:02.383799 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:31:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fdaec0c2-f2b1-4b33-8a85-3d0c7eb7ada9 x-openstack-request-id: req-fdaec0c2-f2b1-4b33-8a85-3d0c7eb7ada9 {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:31:02.385507 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "de45acc4-ab6b-4eea-9e74-150c5641eb59", "tag": "764aa3d0-d145-4744-9cb1-e9bdd5654748", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:31:02.385993 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-fdaec0c2-f2b1-4b33-8a85-3d0c7eb7ada9 {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:31:02.386688 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'de45acc4-ab6b-4eea-9e74-150c5641eb59', 'tag': '764aa3d0-d145-4744-9cb1-e9bdd5654748', 'status': 'completed', 'code': 200}
Jun 03 08:31:02.449780 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-759c0ea3-1358-4f01-b607-43761bcef660 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:02.451287 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-23b0ae51-1d8e-4eb9-bc55-9a238fe2a364 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:02.454052 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-ab15e5e3-61f2-4424-89a8-b4d4c096b9e8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:02.540651 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] Set router a4b01ad1-d952-4deb-88df-6930ad4824db gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:31:02.610671 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-759c0ea3-1358-4f01-b607-43761bcef660 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ea9d7b6f-5abd-47d4-b66c-c6dca62e6a40,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:02.611630 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port 5d9c4d5c-7c2e-4911-823a-3a3242707096 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:31:02.612502 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-759c0ea3-1358-4f01-b607-43761bcef660 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:02.613547 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.064s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:02.623663 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 5d9c4d5c-7c2e-4911-823a-3a3242707096 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:31:02.624342 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:02.680468 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23b0ae51-1d8e-4eb9-bc55-9a238fe2a364 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:02.687681 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-23b0ae51-1d8e-4eb9-bc55-9a238fe2a364 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:02.735727 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d6d2e45-99ab-4fa9-a41a-8b1c27bce343 req-b234b749-6d03-4f12-90cb-93d77325cefa tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:02.744056 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8d6d2e45-99ab-4fa9-a41a-8b1c27bce343 req-b234b749-6d03-4f12-90cb-93d77325cefa tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 944 time: 0.1781020
Jun 03 08:31:02.787201 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8d6d2e45-99ab-4fa9-a41a-8b1c27bce343 req-a70a2159-5dff-4b91-bbb9-e902002069ca tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0419228
Jun 03 08:31:02.997852 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5294684d-0216-4a93-a1a5-09fc9c5ee3dd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:03.009587 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:03.030945 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-23b0ae51-1d8e-4eb9-bc55-9a238fe2a364 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:03.037569 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 46336) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:03.038966 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-23b0ae51-1d8e-4eb9-bc55-9a238fe2a364 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1778 time: 1.3691456
Jun 03 08:31:03.043206 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-c66ace08-28aa-4b6d-9085-0c719d035f81 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Request body: {'security_group_rule': {'security_group_id': 'ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:31:03.054526 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-c66ace08-28aa-4b6d-9085-0c719d035f81 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:03.059718 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-c66ace08-28aa-4b6d-9085-0c719d035f81 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Usage tracker for resource:security_group_rule and tenant:755371c3d9de4747a47ba62e4d101829 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:03.075290 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-c66ace08-28aa-4b6d-9085-0c719d035f81 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:03.096091 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-c66ace08-28aa-4b6d-9085-0c719d035f81 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:03.113754 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-759c0ea3-1358-4f01-b607-43761bcef660 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:03.115422 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-759c0ea3-1358-4f01-b607-43761bcef660 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 1.1433151
Jun 03 08:31:03.123716 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 46340) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:03.128873 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Request body: {'floatingip': {'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:31:03.140788 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port 5d9c4d5c-7c2e-4911-823a-3a3242707096, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=5d9c4d5c-7c2e-4911-823a-3a3242707096,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:31:03.163770 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:03.179455 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Usage tracker for resource:floatingip and tenant:36c42f532cd14f19811ffbee3a39a208 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:03.206130 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c66ace08-28aa-4b6d-9085-0c719d035f81 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:03.210102 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:03.224523 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae87a986d0>, [{'id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'name': 'tempest-AttachVolumeTestJSON-1767133114-router', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241'}], 'enable_snat': True}, 'gw_port_id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:38Z', 'updated_at': '2021-06-03T08:30:51Z', 'revision_number': 4, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'gw_port': {'id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:65:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '09aff824-d423-4557-8913-463e6f53d3e5', 'name': '', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'mac_address': 'fa:16:3e:c4:92:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_interface', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:47Z', 'updated_at': '2021-06-03T08:31:01Z', 'revision_number': 4, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'subnets': [{'id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:31:03.232538 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:03.238669 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-645d635d-e1f9-4633-9f2d-8a3fe593097b None None] The sync data for ids ['a4b01ad1-d952-4deb-88df-6930ad4824db'] in dv-cinder-787262-5-iscsi is: [{'id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'name': 'tempest-AttachVolumeTestJSON-1767133114-router', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241'}], 'enable_snat': True}, 'gw_port_id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:38Z', 'updated_at': '2021-06-03T08:30:51Z', 'revision_number': 4, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'gw_port': {'id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:65:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '09aff824-d423-4557-8913-463e6f53d3e5', 'name': '', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'mac_address': 'fa:16:3e:c4:92:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_interface', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:47Z', 'updated_at': '2021-06-03T08:31:01Z', 'revision_number': 4, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'subnets': [{'id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:31:03.251232 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:03.253736 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-ab9d6f51-044c-42a6-8fa7-1e88fe51cee0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:03.370372 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for floatingip, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:03.441648 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=5d9c4d5c-7c2e-4911-823a-3a3242707096,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:03.450454 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.197s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:03.458448 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c8423321-8a21-48cb-980d-4762935f20fb req-c7c0c132-f876-4b1b-b30d-50fecc44c52e service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=764aa3d0-d145-4744-9cb1-e9bdd5654748 HTTP/1.1" status: 200  len: 217 time: 0.1386917
Jun 03 08:31:03.515834 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c66ace08-28aa-4b6d-9085-0c719d035f81 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:03.688461 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:03.692617 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68778f4f-7082-4b71-9348-bc51b66b1891 req-506dfd2a-eaac-45c8-855d-1b3288f63e90 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:03.694436 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-68778f4f-7082-4b71-9348-bc51b66b1891 req-506dfd2a-eaac-45c8-855d-1b3288f63e90 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 943 time: 0.4510260
Jun 03 08:31:03.701173 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8423321-8a21-48cb-980d-4762935f20fb req-c71310aa-5698-4912-bb09-af382c9ca6fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:03.701173 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c8423321-8a21-48cb-980d-4762935f20fb req-c71310aa-5698-4912-bb09-af382c9ca6fb service neutron] 10.222.0.55 "GET /v2.0/subnets?id=3c41763f-e17d-4df7-96ea-31656322a752 HTTP/1.1" status: 200  len: 852 time: 0.1800277
Jun 03 08:31:03.728067 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-12ff04a1-9915-40e7-945e-4f11f9d0ae26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:03.730530 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-12ff04a1-9915-40e7-945e-4f11f9d0ae26 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=7bac6d994f4d49b292bc39fac07c0311&device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 1097 time: 0.2119193
Jun 03 08:31:03.875277 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-5e8abedd-6442-4d05-9221-0e56082470cf service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=24826ba2-ee17-4774-b5ca-2cd1675f325a HTTP/1.1" status: 200  len: 217 time: 0.0858963
Jun 03 08:31:03.885213 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c8423321-8a21-48cb-980d-4762935f20fb req-cc52f33e-06c7-4b1d-baaf-48d42d2dc15c service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=70332c9d-d098-4fc3-97a8-2773d2d72e48&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1466479
Jun 03 08:31:03.890436 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c66ace08-28aa-4b6d-9085-0c719d035f81 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:03.897731 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:03.914044 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.db_base_plugin_common [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Allocated IP 172.27.0.151 (684ef871-89aa-450d-ae0d-e232bfaf51fb/e7b58fba-1ed5-483b-b341-7736b2ffb853/d889b1e4-520a-45ff-a1c2-e0155186650d) {{(pid=92324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:31:03.963079 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c66ace08-28aa-4b6d-9085-0c719d035f81 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6fea4db2-d489-4c00-9636-06bf63381533,revision_number=0']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:03.975766 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-68778f4f-7082-4b71-9348-bc51b66b1891 req-e9114dca-22fc-491c-8841-6d0c644b0236 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/security-groups?id=12cbc694-d459-4366-b758-44d0f16106cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2706106
Jun 03 08:31:04.029585 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 5d9c4d5c-7c2e-4911-823a-3a3242707096 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:31:04.191884 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for port, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:04.216418 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 5d9c4d5c-7c2e-4911-823a-3a3242707096 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:31:04.216418 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:04.402432 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:04.416890 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:04.489430 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0a3d1adc-5874-4a88-8aee-893097ee9077', 'tag': '24826ba2-ee17-4774-b5ca-2cd1675f325a'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:31:04.501363 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 09aff824-d423-4557-8913-463e6f53d3e5 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:31:04.505350 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4cc6ce9b-49f1-4e38-ba7e-facdc9434868" -d '{"events": [{"name": "network-changed", "server_uuid": "0a3d1adc-5874-4a88-8aee-893097ee9077", "tag": "24826ba2-ee17-4774-b5ca-2cd1675f325a"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:31:04.509931 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c8423321-8a21-48cb-980d-4762935f20fb req-152ba0d9-4273-43c5-b8e6-6ce7a7d3a0a8 service neutron] 10.222.0.55 "GET /v2.0/networks/70332c9d-d098-4fc3-97a8-2773d2d72e48?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5511386
Jun 03 08:31:04.565845 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c66ace08-28aa-4b6d-9085-0c719d035f81 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.642s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:04.565845 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c66ace08-28aa-4b6d-9085-0c719d035f81 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:04.565845 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-c66ace08-28aa-4b6d-9085-0c719d035f81 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 1.5048892
Jun 03 08:31:04.570929 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 46378) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:04.589953 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-860da70f-5db2-4cc8-b035-a268de7209ee tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Request body: {'security_group_rule': {'security_group_id': 'ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:31:04.605598 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-860da70f-5db2-4cc8-b035-a268de7209ee tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:04.618446 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-860da70f-5db2-4cc8-b035-a268de7209ee tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Usage tracker for resource:security_group_rule and tenant:755371c3d9de4747a47ba62e4d101829 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:04.619931 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-860da70f-5db2-4cc8-b035-a268de7209ee tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:04.646419 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-860da70f-5db2-4cc8-b035-a268de7209ee tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:04.672443 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:31:04.712817 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:31:04.712817 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Received port after_create {{(pid=92324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:31:04.826075 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:04.865248 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Pushing event updated for resources: {'Port': ['ID=d889b1e4-520a-45ff-a1c2-e0155186650d,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:04.871928 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.455s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:04.884188 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:31:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f0341165-2c9f-4971-9908-ed7ceb97855c x-openstack-request-id: req-f0341165-2c9f-4971-9908-ed7ceb97855c {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:31:04.885624 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0a3d1adc-5874-4a88-8aee-893097ee9077", "tag": "24826ba2-ee17-4774-b5ca-2cd1675f325a", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:31:04.885624 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-f0341165-2c9f-4971-9908-ed7ceb97855c {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:31:04.885888 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0a3d1adc-5874-4a88-8aee-893097ee9077', 'tag': '24826ba2-ee17-4774-b5ca-2cd1675f325a', 'status': 'completed', 'code': 200}
Jun 03 08:31:04.899683 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-860da70f-5db2-4cc8-b035-a268de7209ee tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:04.948208 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-bd493183-2ecf-45fe-bf02-b7b58d426ef9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:04.949669 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-bd493183-2ecf-45fe-bf02-b7b58d426ef9 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=5f3b55e2-964f-4ce8-9d71-3ac11dc6ebf1 HTTP/1.1" status: 200  len: 855 time: 1.0215490
Jun 03 08:31:04.951504 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port 09aff824-d423-4557-8913-463e6f53d3e5 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:31:04.960499 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c8423321-8a21-48cb-980d-4762935f20fb req-b834e4ae-3b9a-4f75-a9dc-43c12f85ad5a service neutron] 10.222.0.55 "GET /v2.0/networks/70332c9d-d098-4fc3-97a8-2773d2d72e48?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4159939
Jun 03 08:31:04.964849 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 09aff824-d423-4557-8913-463e6f53d3e5 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:31:04.965002 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:05.004376 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcb83d5d-d3df-46a8-9968-e404bb208d08 req-924f7d7b-7360-4d21-9e78-fe5d20e69f36 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:05.019487 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fcb83d5d-d3df-46a8-9968-e404bb208d08 req-924f7d7b-7360-4d21-9e78-fe5d20e69f36 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 944 time: 0.4782591
Jun 03 08:31:05.059674 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-860da70f-5db2-4cc8-b035-a268de7209ee tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:05.071660 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:05.187504 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-3971aa15-db1f-48e1-8051-9b148f8552f1 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=f9db9a2a-942b-4a98-97ed-1896cb9158b4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1045232
Jun 03 08:31:05.192985 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-860da70f-5db2-4cc8-b035-a268de7209ee tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:05.258880 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:05.296261 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:05.306087 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:05.367256 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port 09aff824-d423-4557-8913-463e6f53d3e5, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=09aff824-d423-4557-8913-463e6f53d3e5,segment=NetworkSegment(56366949-8cc8-4cf3-b3eb-d458d3515059),segment_id=56366949-8cc8-4cf3-b3eb-d458d3515059)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:31:05.387194 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fcb83d5d-d3df-46a8-9968-e404bb208d08 req-e52d85cd-8625-4b34-9428-966d3eefc2bc tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3652117
Jun 03 08:31:05.390194 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-dffed482-8cf2-49e8-b587-5fe7ba672beb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:05.425518 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-860da70f-5db2-4cc8-b035-a268de7209ee tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1a2c2287-afb5-4d6a-ad8a-de1d6a22941e,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:05.441032 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-860da70f-5db2-4cc8-b035-a268de7209ee tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:05.448228 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-860da70f-5db2-4cc8-b035-a268de7209ee tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.8647351
Jun 03 08:31:05.448228 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-860da70f-5db2-4cc8-b035-a268de7209ee tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.185s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:05.452918 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 46390) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:05.459641 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Request body: {'floatingip': {'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:31:05.470777 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:05.473323 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:05.482883 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:05.494669 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Usage tracker for resource:floatingip and tenant:755371c3d9de4747a47ba62e4d101829 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:05.502611 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:05.525988 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:05.537549 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f1a056-ecfd-46de-8d58-a76f49164af3 req-00f47603-bb9f-4f9d-8cd7-0f6abbec5f65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:05.539071 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-52f1a056-ecfd-46de-8d58-a76f49164af3 req-00f47603-bb9f-4f9d-8cd7-0f6abbec5f65 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=52d59e3293254fcc85972c62e654f494&device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 1096 time: 0.3250039
Jun 03 08:31:05.545760 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-7902043e-5665-4cc3-a528-017123ae1826 service neutron] 10.222.0.55 "GET /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2163467
Jun 03 08:31:05.572182 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=09aff824-d423-4557-8913-463e6f53d3e5,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:05.577738 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:05.647858 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6995999c-603f-4013-b907-9320bc39669a req-33bbf5bb-bbf0-4dee-850a-044584fe68a4 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:05.649290 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6995999c-603f-4013-b907-9320bc39669a req-33bbf5bb-bbf0-4dee-850a-044584fe68a4 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 943 time: 0.4551878
Jun 03 08:31:05.745306 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for floatingip, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:05.805733 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6995999c-603f-4013-b907-9320bc39669a req-18b77081-49cf-413e-8d16-eff952b68040 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/security-groups?id=12cbc694-d459-4366-b758-44d0f16106cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1363201
Jun 03 08:31:05.838722 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 09aff824-d423-4557-8913-463e6f53d3e5 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:31:05.874480 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for port, precommit_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:05.972580 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:06.006600 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 09aff824-d423-4557-8913-463e6f53d3e5 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:31:06.011966 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:06.020048 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-65e1decf-28fd-4f6b-b1be-5e0f587e7868 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:06.099919 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16327919'] for floatingip, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:06.162784 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Pushing event updated for resources: {'Port': ['ID=d889b1e4-520a-45ff-a1c2-e0155186650d,revision_number=2']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:06.173707 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:06.203012 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for floatingip, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:06.223230 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 3.1033826
Jun 03 08:31:06.261283 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:06.263584 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:06.638579 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.db_base_plugin_common [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Allocated IP 172.27.0.237 (684ef871-89aa-450d-ae0d-e232bfaf51fb/e7b58fba-1ed5-483b-b341-7736b2ffb853/03327af9-40af-442d-a5f1-adb5c39cb86a) {{(pid=92324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:31:06.713708 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 46436) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:06.748951 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f1a056-ecfd-46de-8d58-a76f49164af3 req-fa24dd1e-1033-40bb-bb2b-7191846228f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:06.750260 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-52f1a056-ecfd-46de-8d58-a76f49164af3 req-fa24dd1e-1033-40bb-bb2b-7191846228f2 service neutron] 10.222.0.55 "GET /v2.0/networks?id=70332c9d-d098-4fc3-97a8-2773d2d72e48 HTTP/1.1" status: 200  len: 913 time: 0.5704572
Jun 03 08:31:06.758068 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b7b48737-e403-4f28-a417-6c7a9b4fa9d9 req-ae3924cb-c72d-46d2-92b4-4dc314796ec8 service neutron] 10.222.0.55 "GET /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5770748
Jun 03 08:31:06.822875 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-363210ce-55e1-4217-bf01-34849f49919e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-securitygroup--1548890539&fields=id&tenant_id=36c42f532cd14f19811ffbee3a39a208 HTTP/1.1" status: 200  len: 267 time: 0.1701190
Jun 03 08:31:06.860423 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-52f1a056-ecfd-46de-8d58-a76f49164af3 req-1b9b860b-cb8f-43a1-b862-be7d2ebe40df service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=764aa3d0-d145-4744-9cb1-e9bdd5654748 HTTP/1.1" status: 200  len: 217 time: 0.0945055
Jun 03 08:31:06.911678 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48b4b181-dc1c-4c2d-9bdc-ae73b5d9fddc req-7601138a-b926-4ae6-9685-afce2542fba6 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:06.913193 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-48b4b181-dc1c-4c2d-9bdc-ae73b5d9fddc req-7601138a-b926-4ae6-9685-afce2542fba6 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 944 time: 0.2816937
Jun 03 08:31:06.976876 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f1a056-ecfd-46de-8d58-a76f49164af3 req-28345025-4830-4076-a1a5-8cb264f63507 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:06.980410 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-52f1a056-ecfd-46de-8d58-a76f49164af3 req-28345025-4830-4076-a1a5-8cb264f63507 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=3c41763f-e17d-4df7-96ea-31656322a752 HTTP/1.1" status: 200  len: 852 time: 0.1098168
Jun 03 08:31:06.980579 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for port, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:06.986876 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-258d9c6d-5331-4673-a20c-0558a242f0a7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:07.033803 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-258d9c6d-5331-4673-a20c-0558a242f0a7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:07.052617 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-258d9c6d-5331-4673-a20c-0558a242f0a7 admin admin] Usage tracker for resource:security_group_rule and tenant:a928086c805c472c80c73af17b2b4082 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:07.052617 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-258d9c6d-5331-4673-a20c-0558a242f0a7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:07.073850 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-258d9c6d-5331-4673-a20c-0558a242f0a7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:07.090186 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-48b4b181-dc1c-4c2d-9bdc-ae73b5d9fddc req-fcc39528-303b-4bd0-bb08-7805e6c079e0 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1664715
Jun 03 08:31:07.094159 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-b6882c96-cf0c-4bd9-9b93-c1cf298cb1b2 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:07.100836 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-b6882c96-cf0c-4bd9-9b93-c1cf298cb1b2 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/networks?id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba HTTP/1.1" status: 200  len: 817 time: 0.2764666
Jun 03 08:31:07.101709 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-52f1a056-ecfd-46de-8d58-a76f49164af3 req-d17ded3b-b3d2-4102-892c-1b0a75285651 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=70332c9d-d098-4fc3-97a8-2773d2d72e48&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1113913
Jun 03 08:31:07.140975 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-3a172c1b-ddf7-4e6e-a1ee-2610c8eb8fef tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/quotas/36c42f532cd14f19811ffbee3a39a208 HTTP/1.1" status: 200  len: 375 time: 0.0391545
Jun 03 08:31:07.236618 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 46454) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:07.244413 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cc6ce9b-49f1-4e38-ba7e-facdc9434868 req-2c8780e2-24c5-44e0-8c08-dcf7250bd69c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:07.245865 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4cc6ce9b-49f1-4e38-ba7e-facdc9434868 req-2c8780e2-24c5-44e0-8c08-dcf7250bd69c service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=7bac6d994f4d49b292bc39fac07c0311&device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 1097 time: 0.2059319
Jun 03 08:31:07.261597 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:07.278807 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9931a42b-9503-41d5-afd8-d0ebb25a852c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:07.351276 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-258d9c6d-5331-4673-a20c-0558a242f0a7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:07.359919 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-a067b76e-aabe-43f4-a831-97906139d451 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Synchronizing usage tracker for tenant:36c42f532cd14f19811ffbee3a39a208 on resource:port {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:31:07.382945 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:31:07.393548 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:31:07.398442 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d4d78669-dd54-4b85-ad98-fc7a1f572765 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:07.413838 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Received port after_create {{(pid=92324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:31:07.422309 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Pushing event updated for resources: {'Port': ['ID=03327af9-40af-442d-a5f1-adb5c39cb86a,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:07.429737 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:07.429844 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-52f1a056-ecfd-46de-8d58-a76f49164af3 req-8d8726cd-f4b4-4419-9de7-f43dca1d0bc0 service neutron] 10.222.0.55 "GET /v2.0/networks/70332c9d-d098-4fc3-97a8-2773d2d72e48?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3126669
Jun 03 08:31:07.433485 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-258d9c6d-5331-4673-a20c-0558a242f0a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:07.434307 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-d4d78669-dd54-4b85-ad98-fc7a1f572765 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:07.455688 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-d4d78669-dd54-4b85-ad98-fc7a1f572765 admin admin] Usage tracker for resource:security_group_rule and tenant:7aab828a86744fa0a3b18ea515e1b911 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:07.458189 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:07.468871 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-d4d78669-dd54-4b85-ad98-fc7a1f572765 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:07.478085 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-d4d78669-dd54-4b85-ad98-fc7a1f572765 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:07.512409 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-258d9c6d-5331-4673-a20c-0558a242f0a7 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=a928086c805c472c80c73af17b2b4082&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7976675
Jun 03 08:31:07.518224 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 46458) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:07.544393 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:07.547338 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-258d9c6d-5331-4673-a20c-0558a242f0a7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fbe23ead-5d1e-4013-a562-94a1f40bc689,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:07.549717 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-a067b76e-aabe-43f4-a831-97906139d451 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Unset dirty status for tenant:36c42f532cd14f19811ffbee3a39a208 on resource:port {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:31:07.551043 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-a067b76e-aabe-43f4-a831-97906139d451 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=36c42f532cd14f19811ffbee3a39a208&fields=id HTTP/1.1" status: 200  len: 348 time: 0.4093390
Jun 03 08:31:07.551778 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-258d9c6d-5331-4673-a20c-0558a242f0a7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:07.557051 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cc6ce9b-49f1-4e38-ba7e-facdc9434868 req-aade6f3e-3ab7-448c-b779-41f08d7aa051 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:07.557959 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4cc6ce9b-49f1-4e38-ba7e-facdc9434868 req-aade6f3e-3ab7-448c-b779-41f08d7aa051 service neutron] 10.222.0.55 "GET /v2.0/networks?id=f9db9a2a-942b-4a98-97ed-1896cb9158b4 HTTP/1.1" status: 200  len: 916 time: 0.2723446
Jun 03 08:31:07.573841 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35488295-efb6-45da-8780-c5db9387b53e req-96c067d6-9035-4250-a3b4-320b89ced41d tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:07.575337 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-35488295-efb6-45da-8780-c5db9387b53e req-96c067d6-9035-4250-a3b4-320b89ced41d tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 943 time: 0.3265426
Jun 03 08:31:07.669812 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4cc6ce9b-49f1-4e38-ba7e-facdc9434868 req-86e8143c-a682-472d-8a74-f106129c8fa0 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=24826ba2-ee17-4774-b5ca-2cd1675f325a HTTP/1.1" status: 200  len: 217 time: 0.1051683
Jun 03 08:31:07.748825 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-52f1a056-ecfd-46de-8d58-a76f49164af3 req-48b88dfd-3d5d-4048-b98a-2c5b7909f601 service neutron] 10.222.0.55 "GET /v2.0/networks/70332c9d-d098-4fc3-97a8-2773d2d72e48?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3101115
Jun 03 08:31:07.761241 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-35488295-efb6-45da-8780-c5db9387b53e req-7554b56a-f5c6-47ce-b3e3-eafc3c8191c3 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/security-groups?id=12cbc694-d459-4366-b758-44d0f16106cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1222892
Jun 03 08:31:07.771573 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cc6ce9b-49f1-4e38-ba7e-facdc9434868 req-37417779-0d48-4485-b2f7-f02754ebc8af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:07.773135 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4cc6ce9b-49f1-4e38-ba7e-facdc9434868 req-37417779-0d48-4485-b2f7-f02754ebc8af service neutron] 10.222.0.55 "GET /v2.0/subnets?id=5f3b55e2-964f-4ce8-9d71-3ac11dc6ebf1 HTTP/1.1" status: 200  len: 855 time: 0.0964906
Jun 03 08:31:07.798483 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-57c92425-7e34-44ba-8606-4a73bb57ae2a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:07.822430 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4cc6ce9b-49f1-4e38-ba7e-facdc9434868 req-3b6438f2-ebb3-440c-b43e-ef3544dd8820 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=f9db9a2a-942b-4a98-97ed-1896cb9158b4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0420401
Jun 03 08:31:07.851303 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:07.888530 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d4d78669-dd54-4b85-ad98-fc7a1f572765 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:07.906305 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-f429cb99-5d6f-4b46-9f40-f4671524945d service neutron] 10.222.0.11 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3378546
Jun 03 08:31:07.939860 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-57c92425-7e34-44ba-8606-4a73bb57ae2a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:07.958453 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d4d78669-dd54-4b85-ad98-fc7a1f572765 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:07.961779 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4cc6ce9b-49f1-4e38-ba7e-facdc9434868 req-661084e4-7058-4d47-bfe6-7139f4b0f32c service neutron] 10.222.0.55 "GET /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1309004
Jun 03 08:31:08.001464 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:08.018310 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:08.120551 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4cc6ce9b-49f1-4e38-ba7e-facdc9434868 req-65aad576-2b15-40df-86c2-33714807b479 service neutron] 10.222.0.55 "GET /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1518314
Jun 03 08:31:08.224358 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-d4d78669-dd54-4b85-ad98-fc7a1f572765 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=7aab828a86744fa0a3b18ea515e1b911&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9862559
Jun 03 08:31:08.226521 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 46478) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:08.362634 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4d78669-dd54-4b85-ad98-fc7a1f572765 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=423ffd74-f725-4afd-9e3e-d50c227ef34c,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:08.366547 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-d4d78669-dd54-4b85-ad98-fc7a1f572765 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.365s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:08.376341 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-373ce246-8336-49b8-ad90-301a4ef5be22 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:08.408015 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-dd392070-3bf1-4d85-a69a-e03d11def85f service neutron] 10.222.0.11 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4922137
Jun 03 08:31:08.439815 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-373ce246-8336-49b8-ad90-301a4ef5be22 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:08.466452 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e66d8ab-4940-4546-8df2-cf1d206de7ee req-42352bd3-f375-44d2-bb97-4c6b29a9d8d3 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:08.480854 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3e66d8ab-4940-4546-8df2-cf1d206de7ee req-42352bd3-f375-44d2-bb97-4c6b29a9d8d3 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 944 time: 0.2082462
Jun 03 08:31:08.480973 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-57c92425-7e34-44ba-8606-4a73bb57ae2a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:08.480973 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for port, precommit_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:08.481620 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-d4d78669-dd54-4b85-ad98-fc7a1f572765 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:08.492864 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57c92425-7e34-44ba-8606-4a73bb57ae2a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fbe23ead-5d1e-4013-a562-94a1f40bc689,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:08.528734 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-57c92425-7e34-44ba-8606-4a73bb57ae2a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:08.543538 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-57c92425-7e34-44ba-8606-4a73bb57ae2a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:08.547288 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-57c92425-7e34-44ba-8606-4a73bb57ae2a admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/fbe23ead-5d1e-4013-a562-94a1f40bc689 HTTP/1.1" status: 204  len: 168 time: 1.0241437
Jun 03 08:31:08.569048 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:08.578312 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:08.641690 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16327919'] for floatingip, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:08.707746 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Pushing event updated for resources: {'Port': ['ID=03327af9-40af-442d-a5f1-adb5c39cb86a,revision_number=2']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:08.710887 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3e66d8ab-4940-4546-8df2-cf1d206de7ee req-3211d24c-8be1-48c6-bccf-4332c46fd779 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2272899
Jun 03 08:31:08.722373 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:08.724799 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-7b725915-808d-4f51-bc4c-07e67cc54630 req-f591a8f9-b505-41af-8a92-1c7abcbfb90b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 210 time: 0.0670211
Jun 03 08:31:08.808795 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-373ce246-8336-49b8-ad90-301a4ef5be22 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:08.814289 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f3c297ad-3271-4477-9063-8c26cca98f88 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:08.826980 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-373ce246-8336-49b8-ad90-301a4ef5be22 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=423ffd74-f725-4afd-9e3e-d50c227ef34c,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:08.829299 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-373ce246-8336-49b8-ad90-301a4ef5be22 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:08.834629 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-373ce246-8336-49b8-ad90-301a4ef5be22 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:08.835851 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-373ce246-8336-49b8-ad90-301a4ef5be22 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/423ffd74-f725-4afd-9e3e-d50c227ef34c HTTP/1.1" status: 204  len: 168 time: 0.6081822
Jun 03 08:31:08.860904 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for floatingip, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:08.862814 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 3.4074464
Jun 03 08:31:08.997851 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a668b31-0677-48a9-9bce-6835f2d021ee req-0d63aa50-30e0-41cd-a8d6-f3b6557448de tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:08.999414 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0a668b31-0677-48a9-9bce-6835f2d021ee req-0d63aa50-30e0-41cd-a8d6-f3b6557448de tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 943 time: 0.0974560
Jun 03 08:31:09.062526 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0a668b31-0677-48a9-9bce-6835f2d021ee req-f1238095-329a-45cc-858b-8d61c2eb0c92 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/security-groups?id=12cbc694-d459-4366-b758-44d0f16106cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0535953
Jun 03 08:31:09.364025 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-960be65b-455e-47b8-9a50-17cedef7705f req-71bd49df-5bf7-448f-85c5-ea8c0181e891 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Synchronizing usage tracker for tenant:755371c3d9de4747a47ba62e4d101829 on resource:security_group {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:31:09.465618 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-960be65b-455e-47b8-9a50-17cedef7705f req-71bd49df-5bf7-448f-85c5-ea8c0181e891 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Unset dirty status for tenant:755371c3d9de4747a47ba62e4d101829 on resource:security_group {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:31:09.466954 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-960be65b-455e-47b8-9a50-17cedef7705f req-71bd49df-5bf7-448f-85c5-ea8c0181e891 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-securitygroup--1688928482&fields=id&tenant_id=755371c3d9de4747a47ba62e4d101829 HTTP/1.1" status: 200  len: 267 time: 0.1586680
Jun 03 08:31:09.689757 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-960be65b-455e-47b8-9a50-17cedef7705f req-d033199f-8175-434e-8215-bdc5512a3291 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:09.690441 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-960be65b-455e-47b8-9a50-17cedef7705f req-d033199f-8175-434e-8215-bdc5512a3291 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Synchronizing usage tracker for tenant:755371c3d9de4747a47ba62e4d101829 on resource:network {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:31:09.787150 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-960be65b-455e-47b8-9a50-17cedef7705f req-d033199f-8175-434e-8215-bdc5512a3291 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Unset dirty status for tenant:755371c3d9de4747a47ba62e4d101829 on resource:network {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:31:09.794550 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-960be65b-455e-47b8-9a50-17cedef7705f req-d033199f-8175-434e-8215-bdc5512a3291 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/networks?id=020eaa43-2d59-46e1-8aec-0a688069f72b HTTP/1.1" status: 200  len: 811 time: 0.3151288
Jun 03 08:31:09.810224 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 46546) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:09.818240 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-960be65b-455e-47b8-9a50-17cedef7705f req-0245c802-5d97-43c5-83f8-c0c5298e2c54 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/quotas/755371c3d9de4747a47ba62e4d101829 HTTP/1.1" status: 200  len: 375 time: 0.0164766
Jun 03 08:31:09.834230 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d6434987-2370-4824-b328-c6885f538dfe admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:09.893084 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-d6434987-2370-4824-b328-c6885f538dfe admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:09.898974 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-d6434987-2370-4824-b328-c6885f538dfe admin admin] Usage tracker for resource:security_group_rule and tenant:eb65eb01975640e297683723f27ac6cc is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:09.908587 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-d6434987-2370-4824-b328-c6885f538dfe admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:09.910071 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-960be65b-455e-47b8-9a50-17cedef7705f req-b351465f-900c-4820-a1e7-d69dda185472 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Synchronizing usage tracker for tenant:755371c3d9de4747a47ba62e4d101829 on resource:port {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:31:09.922879 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-d6434987-2370-4824-b328-c6885f538dfe admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:09.970906 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8df24ab2-e268-4555-9975-a3a761b91047 req-80ee46f2-d082-438a-a0d7-0a56519f1297 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:09.972461 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8df24ab2-e268-4555-9975-a3a761b91047 req-80ee46f2-d082-438a-a0d7-0a56519f1297 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 944 time: 0.1280215
Jun 03 08:31:09.990467 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-960be65b-455e-47b8-9a50-17cedef7705f req-b351465f-900c-4820-a1e7-d69dda185472 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Unset dirty status for tenant:755371c3d9de4747a47ba62e4d101829 on resource:port {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:31:09.991815 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-960be65b-455e-47b8-9a50-17cedef7705f req-b351465f-900c-4820-a1e7-d69dda185472 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=755371c3d9de4747a47ba62e4d101829&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1675723
Jun 03 08:31:10.042311 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8df24ab2-e268-4555-9975-a3a761b91047 req-66b387f7-bcbc-4e87-8d37-945ecf50c09e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0609913
Jun 03 08:31:10.083124 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d6434987-2370-4824-b328-c6885f538dfe admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:10.166826 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-960be65b-455e-47b8-9a50-17cedef7705f req-5e56e93e-f408-4906-b294-0a7f778aa116 service neutron] 10.222.0.11 "GET /v2.0/networks/020eaa43-2d59-46e1-8aec-0a688069f72b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1620190
Jun 03 08:31:10.195542 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d6434987-2370-4824-b328-c6885f538dfe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:10.210012 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5dd7e481-e61e-43a6-af3f-6a05a1038ed7 req-9502118d-bce7-46ce-8466-2f1cc986e288 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 210 time: 0.0635629
Jun 03 08:31:10.212163 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:10.283585 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-d6434987-2370-4824-b328-c6885f538dfe admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=eb65eb01975640e297683723f27ac6cc&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4720528
Jun 03 08:31:10.299805 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6434987-2370-4824-b328-c6885f538dfe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=41b0ed30-99a7-4ff3-b6aa-ea4aac3edcde,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:10.306156 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-d6434987-2370-4824-b328-c6885f538dfe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:10.306704 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 46564) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:10.396196 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1b5b8ac8-62fe-4eef-a2f6-0d55c579b2d2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:10.412422 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-960be65b-455e-47b8-9a50-17cedef7705f req-4fa11ba2-aa45-4d13-8fa8-be150ae0658f service neutron] 10.222.0.11 "GET /v2.0/networks/020eaa43-2d59-46e1-8aec-0a688069f72b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2392986
Jun 03 08:31:10.430644 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1b5b8ac8-62fe-4eef-a2f6-0d55c579b2d2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:10.561273 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 764aa3d0-d145-4744-9cb1-e9bdd5654748 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:31:10.561848 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-035e1ad5-b2a8-4737-b7c9-566f76201237 req-0dd2354d-8e01-4252-97c7-9774d24b739d tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:10.563595 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-035e1ad5-b2a8-4737-b7c9-566f76201237 req-0dd2354d-8e01-4252-97c7-9774d24b739d tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 943 time: 0.1354322
Jun 03 08:31:10.619500 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-035e1ad5-b2a8-4737-b7c9-566f76201237 req-66164524-ffb7-48cf-8062-fd8dc36b63b8 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/security-groups?id=12cbc694-d459-4366-b758-44d0f16106cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0488636
Jun 03 08:31:10.716673 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-70495761-29f4-4ecf-94e3-016445c59c70 req-ddf30c19-20a8-4466-a035-40141289eade tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 210 time: 0.0526137
Jun 03 08:31:10.718369 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1b5b8ac8-62fe-4eef-a2f6-0d55c579b2d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:10.724579 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-373ce246-8336-49b8-ad90-301a4ef5be22 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:10.739546 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1b5b8ac8-62fe-4eef-a2f6-0d55c579b2d2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:10.747303 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-1b5b8ac8-62fe-4eef-a2f6-0d55c579b2d2 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/41b0ed30-99a7-4ff3-b6aa-ea4aac3edcde HTTP/1.1" status: 204  len: 168 time: 0.4324553
Jun 03 08:31:10.747303 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b5b8ac8-62fe-4eef-a2f6-0d55c579b2d2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=41b0ed30-99a7-4ff3-b6aa-ea4aac3edcde,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:10.756154 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-1b5b8ac8-62fe-4eef-a2f6-0d55c579b2d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:10.872796 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 764aa3d0-d145-4744-9cb1-e9bdd5654748, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=764aa3d0-d145-4744-9cb1-e9bdd5654748,segment=NetworkSegment(5a5b66b5-9e55-4a2d-87ec-5d31f3999401),segment_id=5a5b66b5-9e55-4a2d-87ec-5d31f3999401)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:31:10.887475 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': '764aa3d0-d145-4744-9cb1-e9bdd5654748', 'network_id': '70332c9d-d098-4fc3-97a8-2773d2d72e48', 'port_id': '764aa3d0-d145-4744-9cb1-e9bdd5654748', 'mac_address': 'fa:16:3e:45:93:a6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 544, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3c41763f-e17d-4df7-96ea-31656322a752', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:31:10.947236 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:10.964521 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 764aa3d0-d145-4744-9cb1-e9bdd5654748 {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:31:10.980616 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 764aa3d0-d145-4744-9cb1-e9bdd5654748, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=764aa3d0-d145-4744-9cb1-e9bdd5654748,segment=NetworkSegment(5a5b66b5-9e55-4a2d-87ec-5d31f3999401),segment_id=5a5b66b5-9e55-4a2d-87ec-5d31f3999401)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:31:11.105774 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:11.106586 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 24826ba2-ee17-4774-b5ca-2cd1675f325a details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:31:11.108707 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:11.203326 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=764aa3d0-d145-4744-9cb1-e9bdd5654748,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:11.207606 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:11.258146 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92b2c475-31a5-4725-aa95-385e1751b3cd req-25b52262-8b4a-4f86-8fcb-058a0408098c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:11.262025 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-92b2c475-31a5-4725-aa95-385e1751b3cd req-25b52262-8b4a-4f86-8fcb-058a0408098c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 944 time: 0.1097288
Jun 03 08:31:11.329854 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 24826ba2-ee17-4774-b5ca-2cd1675f325a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=24826ba2-ee17-4774-b5ca-2cd1675f325a,segment=NetworkSegment(9923ac74-9556-45ec-9044-43728d2a8ec3),segment_id=9923ac74-9556-45ec-9044-43728d2a8ec3)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:31:11.345075 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': '24826ba2-ee17-4774-b5ca-2cd1675f325a', 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4', 'port_id': '24826ba2-ee17-4774-b5ca-2cd1675f325a', 'mac_address': 'fa:16:3e:03:fd:9b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 511, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5f3b55e2-964f-4ce8-9d71-3ac11dc6ebf1', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:31:11.356564 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-92b2c475-31a5-4725-aa95-385e1751b3cd req-3ffc6fc0-4280-49a9-8a78-74bcca8e9daf tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0886829
Jun 03 08:31:11.450570 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:11.477574 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 24826ba2-ee17-4774-b5ca-2cd1675f325a {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:31:11.507195 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 24826ba2-ee17-4774-b5ca-2cd1675f325a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=24826ba2-ee17-4774-b5ca-2cd1675f325a,segment=NetworkSegment(9923ac74-9556-45ec-9044-43728d2a8ec3),segment_id=9923ac74-9556-45ec-9044-43728d2a8ec3)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:31:11.569690 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-adafec0f-f16e-4918-add6-9a3163a0560b req-178e78fa-f36c-4a69-9768-18f76f14d59e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 210 time: 0.0423436
Jun 03 08:31:11.667527 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:11.675827 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.003s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:11.776261 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=24826ba2-ee17-4774-b5ca-2cd1675f325a,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:11.779770 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:11.831562 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-982ea8a0-2ca5-43cb-a9cf-dd8329a4f34a req-e795085b-43dc-4e48-82e8-0afe219c39d9 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:11.833033 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-982ea8a0-2ca5-43cb-a9cf-dd8329a4f34a req-e795085b-43dc-4e48-82e8-0afe219c39d9 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 944 time: 0.0982223
Jun 03 08:31:11.873317 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-01c16d0e-f874-4320-9906-a324578a317f req-cdecc5b4-4473-4fd5-935a-a3357b2e1b16 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 210 time: 0.0712895
Jun 03 08:31:11.903941 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-982ea8a0-2ca5-43cb-a9cf-dd8329a4f34a req-0b61ba95-3102-4716-ade1-882e37e8af7a tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/security-groups?id=12cbc694-d459-4366-b758-44d0f16106cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0644805
Jun 03 08:31:11.968512 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-01e40dfe-2174-4358-adfe-bf0497a73f14 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:11.969739 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-01e40dfe-2174-4358-adfe-bf0497a73f14 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Synchronizing usage tracker for tenant:36c42f532cd14f19811ffbee3a39a208 on resource:network {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:31:11.983597 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['764aa3d0-d145-4744-9cb1-e9bdd5654748'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:31:12.075998 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['24826ba2-ee17-4774-b5ca-2cd1675f325a'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:31:12.132408 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-01e40dfe-2174-4358-adfe-bf0497a73f14 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Unset dirty status for tenant:36c42f532cd14f19811ffbee3a39a208 on resource:network {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:31:12.133558 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-01e40dfe-2174-4358-adfe-bf0497a73f14 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.55 "GET /v2.0/networks?id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba HTTP/1.1" status: 200  len: 817 time: 0.4458930
Jun 03 08:31:12.201689 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-494ddce8-7f91-47f3-871c-a01f0cb5a71b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Synchronizing usage tracker for tenant:36c42f532cd14f19811ffbee3a39a208 on resource:security_group {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:31:12.372630 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-494ddce8-7f91-47f3-871c-a01f0cb5a71b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Unset dirty status for tenant:36c42f532cd14f19811ffbee3a39a208 on resource:security_group {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:31:12.374074 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-494ddce8-7f91-47f3-871c-a01f0cb5a71b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.55 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=36c42f532cd14f19811ffbee3a39a208 HTTP/1.1" status: 200  len: 380 time: 0.2308767
Jun 03 08:31:12.384666 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-f8549f22-ed83-45ec-a36d-9f4c21a67184 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Request body: {'port': {'device_id': '0c731ecb-c3fc-401e-af74-34336582cf7d', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'admin_state_up': True, 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'security_groups': ['548f6ffb-55f0-4e53-89ee-7d877c658fda']}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:31:12.598858 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-f8549f22-ed83-45ec-a36d-9f4c21a67184 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:12.616080 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-f8549f22-ed83-45ec-a36d-9f4c21a67184 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:12.638213 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8415b1e0-562b-4ab6-8e0e-8b98d1690891 req-55fe3542-e014-40df-9462-dd1b01b739ca tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:12.639757 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8415b1e0-562b-4ab6-8e0e-8b98d1690891 req-55fe3542-e014-40df-9462-dd1b01b739ca tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 945 time: 0.1463857
Jun 03 08:31:12.685212 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8415b1e0-562b-4ab6-8e0e-8b98d1690891 req-6c2e58c0-6bec-4dc2-9cf8-1046118cb8b5 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394821
Jun 03 08:31:12.736607 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-57c9db90-cff6-4a94-9657-71b7ff791e35 req-1c1b2981-74c0-422a-9c83-0ad5ed361b70 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 210 time: 0.0472333
Jun 03 08:31:12.780301 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-f8549f22-ed83-45ec-a36d-9f4c21a67184 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Made reservation on behalf of 36c42f532cd14f19811ffbee3a39a208 for: {'port': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:31:12.784415 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-f8549f22-ed83-45ec-a36d-9f4c21a67184 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:12.977655 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-f8549f22-ed83-45ec-a36d-9f4c21a67184 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Allocated IP 172.20.0.5 (958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba/cff67a13-bc33-4d3e-a796-5829103ca25c/7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:31:13.064000 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0b8332e0-af5d-4aba-9f50-23b1c7955afb req-2071230b-f799-4e5b-a40a-84cfa6139e25 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 210 time: 0.0573840
Jun 03 08:31:13.146782 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d240155-525b-4273-bbad-2bde1e30a513 req-4b039c5c-ecf2-4ca6-969f-ccd168c6f362 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:13.148698 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0d240155-525b-4273-bbad-2bde1e30a513 req-4b039c5c-ecf2-4ca6-969f-ccd168c6f362 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 944 time: 0.1152258
Jun 03 08:31:13.230981 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0d240155-525b-4273-bbad-2bde1e30a513 req-7a96d550-650d-4f29-9b17-d964d09cb594 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/security-groups?id=12cbc694-d459-4366-b758-44d0f16106cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0751595
Jun 03 08:31:13.284806 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-f8549f22-ed83-45ec-a36d-9f4c21a67184 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:13.306384 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-f8549f22-ed83-45ec-a36d-9f4c21a67184 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Transition to ACTIVE for port object 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 will not be triggered until provisioned by entity DHCP. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:31:13.426091 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-f8549f22-ed83-45ec-a36d-9f4c21a67184 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:13.444578 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-9164aa4b-be2b-42b3-843e-fbf0cb6538af admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:13.485138 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 46680) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:13.520945 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-f8549f22-ed83-45ec-a36d-9f4c21a67184 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Network 958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:31:13.525544 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-f8549f22-ed83-45ec-a36d-9f4c21a67184 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:31:13.529890 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-f8549f22-ed83-45ec-a36d-9f4c21a67184 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:31:13.537053 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-f8549f22-ed83-45ec-a36d-9f4c21a67184 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:13.537053 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-f8549f22-ed83-45ec-a36d-9f4c21a67184 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:13.571437 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8549f22-ed83-45ec-a36d-9f4c21a67184 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Pushing event updated for resources: {'Port': ['ID=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:13.575448 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f8549f22-ed83-45ec-a36d-9f4c21a67184 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:13.671144 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-f8549f22-ed83-45ec-a36d-9f4c21a67184 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.55 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.2863758
Jun 03 08:31:13.678075 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Request body: {'port': {'device_id': '0c731ecb-c3fc-401e-af74-34336582cf7d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:31:13.706594 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-873b276b-6b5e-4ac3-a6bb-ce4e0c3a71f0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:13.760390 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-873b276b-6b5e-4ac3-a6bb-ce4e0c3a71f0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:13.770845 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-873b276b-6b5e-4ac3-a6bb-ce4e0c3a71f0 admin admin] Usage tracker for resource:security_group_rule and tenant:ee7fc36698164422bc3cb4f8b544b029 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:13.774674 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-873b276b-6b5e-4ac3-a6bb-ce4e0c3a71f0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:13.785116 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-873b276b-6b5e-4ac3-a6bb-ce4e0c3a71f0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:13.940566 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-7b6c3c93-e62c-4edc-bde0-bf2240175935 None None] Provisioning for port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:31:13.945755 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-7b6c3c93-e62c-4edc-bde0-bf2240175935 None None] Provisioning complete for port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:31:13.946194 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-7b6c3c93-e62c-4edc-bde0-bf2240175935 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:13.990253 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-873b276b-6b5e-4ac3-a6bb-ce4e0c3a71f0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:13.999869 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f302bcf-f519-4a7a-96d5-5bd96287eb34 req-3f6261e3-3285-4d73-8605-3e7ab09348c6 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:14.001418 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-9f302bcf-f519-4a7a-96d5-5bd96287eb34 req-3f6261e3-3285-4d73-8605-3e7ab09348c6 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 945 time: 0.1509776
Jun 03 08:31:14.006564 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-7b6c3c93-e62c-4edc-bde0-bf2240175935 None None] Port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:31:14.050795 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-9f302bcf-f519-4a7a-96d5-5bd96287eb34 req-ca971a05-f674-4011-80e5-24a4852c34c4 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433967
Jun 03 08:31:14.055117 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:14.174115 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-873b276b-6b5e-4ac3-a6bb-ce4e0c3a71f0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:14.176461 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dd7777a-6420-41b0-af6f-8c9feafc641e req-89db012d-5443-4546-b7c7-7daa676b6a4f tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:14.177177 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-4dd7777a-6420-41b0-af6f-8c9feafc641e req-89db012d-5443-4546-b7c7-7daa676b6a4f tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Synchronizing usage tracker for tenant:36c42f532cd14f19811ffbee3a39a208 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:31:14.198244 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:14.267433 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-9c9b7a32-f574-409a-9bbf-ffb0a7c201ac req-4c2821e6-06c1-4b90-b2d8-18f3260cb85a tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 210 time: 0.0700188
Jun 03 08:31:14.276314 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-873b276b-6b5e-4ac3-a6bb-ce4e0c3a71f0 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=ee7fc36698164422bc3cb4f8b544b029&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7901678
Jun 03 08:31:14.279701 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 46702) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:14.310135 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-873b276b-6b5e-4ac3-a6bb-ce4e0c3a71f0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=49eda20b-1649-4052-92f2-bf6983a88172,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:14.311094 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-873b276b-6b5e-4ac3-a6bb-ce4e0c3a71f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:14.386169 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-4dd7777a-6420-41b0-af6f-8c9feafc641e req-89db012d-5443-4546-b7c7-7daa676b6a4f tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Unset dirty status for tenant:36c42f532cd14f19811ffbee3a39a208 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:31:14.391348 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e75da396-1ca8-4425-bffc-67c0c05a1faa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:14.392802 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4dd7777a-6420-41b0-af6f-8c9feafc641e req-89db012d-5443-4546-b7c7-7daa676b6a4f tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 931 time: 0.4704518
Jun 03 08:31:14.433068 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e75da396-1ca8-4425-bffc-67c0c05a1faa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:14.551776 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 764aa3d0-d145-4744-9cb1-e9bdd5654748 up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:31:14.627980 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-960be65b-455e-47b8-9a50-17cedef7705f req-62bf5a00-05d2-4c74-83e2-7d5ef228b2b1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:14.627980 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-960be65b-455e-47b8-9a50-17cedef7705f req-62bf5a00-05d2-4c74-83e2-7d5ef228b2b1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.55 "GET /v2.0/networks?id=020eaa43-2d59-46e1-8aec-0a688069f72b HTTP/1.1" status: 200  len: 811 time: 0.4848480
Jun 03 08:31:14.657082 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afd5472e-8257-4691-ab9d-a8e59f665032 req-e97f7241-d734-4d8b-924f-938c2a1a8f82 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:14.667140 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-afd5472e-8257-4691-ab9d-a8e59f665032 req-e97f7241-d734-4d8b-924f-938c2a1a8f82 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 944 time: 0.2236102
Jun 03 08:31:14.690610 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4dd7777a-6420-41b0-af6f-8c9feafc641e req-c2cbf46c-3488-405f-922d-a5b46a6a0be9 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2968147
Jun 03 08:31:14.723203 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-afd5472e-8257-4691-ab9d-a8e59f665032 req-6c7e8f06-1044-4777-b977-778024c96b57 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/security-groups?id=12cbc694-d459-4366-b758-44d0f16106cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0550826
Jun 03 08:31:14.743023 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-960be65b-455e-47b8-9a50-17cedef7705f req-de4c9fbe-af38-4f3c-be25-d04b1d92b41e tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.55 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=755371c3d9de4747a47ba62e4d101829 HTTP/1.1" status: 200  len: 380 time: 0.0846312
Jun 03 08:31:14.749765 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-960be65b-455e-47b8-9a50-17cedef7705f req-413dcec8-3a42-4829-b65d-77589c788a7b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Request body: {'port': {'device_id': '86bd903e-c2b5-4452-bc75-39a347cba9db', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'admin_state_up': True, 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'security_groups': ['ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7']}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:31:14.895430 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e75da396-1ca8-4425-bffc-67c0c05a1faa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:14.896445 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning for port 764aa3d0-d145-4744-9cb1-e9bdd5654748 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:31:14.909945 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port 764aa3d0-d145-4744-9cb1-e9bdd5654748 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:31:14.910944 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:14.914447 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:14.948659 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e75da396-1ca8-4425-bffc-67c0c05a1faa admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:14.950043 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-e75da396-1ca8-4425-bffc-67c0c05a1faa admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/49eda20b-1649-4052-92f2-bf6983a88172 HTTP/1.1" status: 204  len: 168 time: 0.6695311
Jun 03 08:31:14.951305 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e75da396-1ca8-4425-bffc-67c0c05a1faa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=49eda20b-1649-4052-92f2-bf6983a88172,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:14.952420 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 {{(pid=92323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:31:14.953784 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e75da396-1ca8-4425-bffc-67c0c05a1faa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:14.966599 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:14.980156 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-960be65b-455e-47b8-9a50-17cedef7705f req-413dcec8-3a42-4829-b65d-77589c788a7b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:14.990749 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Transition to ACTIVE for port object 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 will not be triggered until provisioned by entity L2. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:31:14.995575 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-960be65b-455e-47b8-9a50-17cedef7705f req-413dcec8-3a42-4829-b65d-77589c788a7b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:15.091135 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:15.100067 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a41e1ac9-0d2b-4e8c-972e-9d665abbd4c7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:15.133645 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:15.155731 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-960be65b-455e-47b8-9a50-17cedef7705f req-413dcec8-3a42-4829-b65d-77589c788a7b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Made reservation on behalf of 755371c3d9de4747a47ba62e4d101829 for: {'port': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:31:15.160331 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-960be65b-455e-47b8-9a50-17cedef7705f req-413dcec8-3a42-4829-b65d-77589c788a7b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:15.166693 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'de45acc4-ab6b-4eea-9e74-150c5641eb59', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '764aa3d0-d145-4744-9cb1-e9bdd5654748'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:31:15.250185 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 764aa3d0-d145-4744-9cb1-e9bdd5654748, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=764aa3d0-d145-4744-9cb1-e9bdd5654748,segment=NetworkSegment(5a5b66b5-9e55-4a2d-87ec-5d31f3999401),segment_id=5a5b66b5-9e55-4a2d-87ec-5d31f3999401)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:31:15.351542 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:15.353386 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 24826ba2-ee17-4774-b5ca-2cd1675f325a up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:31:15.369413 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Pushing event updated for resources: {'Port': ['ID=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:15.404330 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:15.428410 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.328s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:15.474762 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5e1e3e58-7140-4070-8a40-f9a6f8492ba2" -d '{"events": [{"server_uuid": "de45acc4-ab6b-4eea-9e74-150c5641eb59", "name": "network-vif-plugged", "status": "completed", "tag": "764aa3d0-d145-4744-9cb1-e9bdd5654748"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:31:15.514736 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Attempting to bind port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:31:15.515435 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Attempting to bind port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '377c6f4a-d9be-4dae-86db-35230d8009c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba'}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:31:15.515899 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Attempting to bind port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 on network 958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:31:15.523621 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-29992119-5b73-4809-8c90-4a6dae8df027 req-3030d244-9b1a-4640-94b4-62b702132b4f tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 210 time: 0.0706646
Jun 03 08:31:15.531530 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 on network 958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 03 08:31:15.531530 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Attempting to bind port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 on network 958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:31:15.544924 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Checking agent: {'id': '181c5753-100b-4f03-bda8-e34279b057f4', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'started_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 30, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:31:15.545307 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Checking segment: {'id': '377c6f4a-d9be-4dae-86db-35230d8009c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:31:15.545805 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Bound using segment: {'id': '377c6f4a-d9be-4dae-86db-35230d8009c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba'} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:31:15.546257 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Bound port: 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '377c6f4a-d9be-4dae-86db-35230d8009c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba'}}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:31:15.546605 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:15.646466 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=764aa3d0-d145-4744-9cb1-e9bdd5654748,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:15.660896 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.256s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:15.677923 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30a3cffa-cd7e-4f44-982b-bc23bb4c0371 req-93c87b14-ee34-4241-8b4f-61b2f706836e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:15.679484 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-30a3cffa-cd7e-4f44-982b-bc23bb4c0371 req-93c87b14-ee34-4241-8b4f-61b2f706836e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 945 time: 0.4140167
Jun 03 08:31:15.721337 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [req-960be65b-455e-47b8-9a50-17cedef7705f req-413dcec8-3a42-4829-b65d-77589c788a7b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Allocated IP 172.20.0.4 (020eaa43-2d59-46e1-8aec-0a688069f72b/5baf74c9-e686-40a5-b52f-f01da3bd1af9/19f733be-bd85-43df-86fd-5a9c617b3df4) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:31:15.744385 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:31:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6ff352cf-08d5-449a-9dd7-165ba81b2e65 x-openstack-request-id: req-6ff352cf-08d5-449a-9dd7-165ba81b2e65 {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:31:15.744937 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "de45acc4-ab6b-4eea-9e74-150c5641eb59", "name": "network-vif-plugged", "status": "completed", "tag": "764aa3d0-d145-4744-9cb1-e9bdd5654748", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:31:15.745626 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-6ff352cf-08d5-449a-9dd7-165ba81b2e65 {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:31:15.746321 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'de45acc4-ab6b-4eea-9e74-150c5641eb59', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '764aa3d0-d145-4744-9cb1-e9bdd5654748', 'code': 200}
Jun 03 08:31:15.816310 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-30a3cffa-cd7e-4f44-982b-bc23bb4c0371 req-55d2b6c8-1131-4a63-8396-f34873dd9ed0 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1269975
Jun 03 08:31:15.824433 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] For port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97, host hv-cinder-78726, cleared binding levels {{(pid=92323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:31:15.835408 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] For port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:31:15.926182 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7209142-29cf-467b-af32-a72af70f07f1 req-9235d080-0991-4776-b63a-9f111c3f0092 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:15.927908 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e7209142-29cf-467b-af32-a72af70f07f1 req-9235d080-0991-4776-b63a-9f111c3f0092 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0896206
Jun 03 08:31:15.951525 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning for port 24826ba2-ee17-4774-b5ca-2cd1675f325a completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:31:15.957624 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port 24826ba2-ee17-4774-b5ca-2cd1675f325a triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:31:15.959383 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:15.977264 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e7209142-29cf-467b-af32-a72af70f07f1 req-e45c2e72-2fd9-479f-b3c7-c332c4b9f78f tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0426497
Jun 03 08:31:16.008499 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:16.074690 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:16.129631 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:16.168632 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 24826ba2-ee17-4774-b5ca-2cd1675f325a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=24826ba2-ee17-4774-b5ca-2cd1675f325a,segment=NetworkSegment(9923ac74-9556-45ec-9044-43728d2a8ec3),segment_id=9923ac74-9556-45ec-9044-43728d2a8ec3)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:31:16.212056 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.55', 49911) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:16.275705 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 46768) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:16.298329 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:16.301369 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:16.303427 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8a8b9b34-3bf5-445c-a016-0301547f3c72 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:16.312904 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:16.313628 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:16.315188 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] 10.222.0.55 "PUT /v2.0/ports/7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 HTTP/1.1" status: 200  len: 1093 time: 2.6416664
Jun 03 08:31:16.315784 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0c731ecb-c3fc-401e-af74-34336582cf7d', 'tag': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:31:16.329469 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a7575420-4247-4c8f-94df-3e139cb0f473" -d '{"events": [{"name": "network-changed", "server_uuid": "0c731ecb-c3fc-401e-af74-34336582cf7d", "tag": "7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:31:16.334032 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-8a8b9b34-3bf5-445c-a016-0301547f3c72 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:16.357071 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-8a8b9b34-3bf5-445c-a016-0301547f3c72 admin admin] Usage tracker for resource:security_group_rule and tenant:9b3ec2f4f7fc45758fe88ae00218b8ec is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:16.361124 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-960be65b-455e-47b8-9a50-17cedef7705f req-413dcec8-3a42-4829-b65d-77589c788a7b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:16.362588 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-8a8b9b34-3bf5-445c-a016-0301547f3c72 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:16.372799 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Pushing event updated for resources: {'Port': ['ID=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,revision_number=3']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:16.376031 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-8a8b9b34-3bf5-445c-a016-0301547f3c72 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:16.376445 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.302s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:16.391706 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-960be65b-455e-47b8-9a50-17cedef7705f req-413dcec8-3a42-4829-b65d-77589c788a7b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Transition to ACTIVE for port object 19f733be-bd85-43df-86fd-5a9c617b3df4 will not be triggered until provisioned by entity DHCP. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:31:16.414702 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d902f9ea-8b25-4eae-8a22-7c7fcb62204e req-f6dae1cb-1231-4da4-9ce7-1e6cf5c89181 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:16.427144 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d902f9ea-8b25-4eae-8a22-7c7fcb62204e req-f6dae1cb-1231-4da4-9ce7-1e6cf5c89181 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 945 time: 0.4888504
Jun 03 08:31:16.435373 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=24826ba2-ee17-4774-b5ca-2cd1675f325a,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:16.439701 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:16.444057 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83a10b0e-89b2-47ff-bbe1-37b0548d6a8b req-498482e1-1cc6-4fa5-a0a0-9d6226a1cbba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:16.445739 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-83a10b0e-89b2-47ff-bbe1-37b0548d6a8b req-498482e1-1cc6-4fa5-a0a0-9d6226a1cbba service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 1098 time: 0.2321131
Jun 03 08:31:16.453891 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:31:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-141654d4-e8cc-4340-a07e-57de79add5cb x-openstack-request-id: req-141654d4-e8cc-4340-a07e-57de79add5cb {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:31:16.454248 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0c731ecb-c3fc-401e-af74-34336582cf7d", "tag": "7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:31:16.454521 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-141654d4-e8cc-4340-a07e-57de79add5cb {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:31:16.454965 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0c731ecb-c3fc-401e-af74-34336582cf7d', 'tag': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97', 'status': 'completed', 'code': 200}
Jun 03 08:31:16.473990 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-83a10b0e-89b2-47ff-bbe1-37b0548d6a8b req-f1971619-2fa9-4cd6-8fc6-8a328e2c6d1e service neutron] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:16.501126 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [req-83a10b0e-89b2-47ff-bbe1-37b0548d6a8b req-f1971619-2fa9-4cd6-8fc6-8a328e2c6d1e service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:16.514305 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-83a10b0e-89b2-47ff-bbe1-37b0548d6a8b req-f1971619-2fa9-4cd6-8fc6-8a328e2c6d1e service neutron] Usage tracker for resource:security_group_rule and tenant:c379711d07ee4799b0e38ad3e4bcd932 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:16.526744 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-83a10b0e-89b2-47ff-bbe1-37b0548d6a8b req-f1971619-2fa9-4cd6-8fc6-8a328e2c6d1e service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:16.537868 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [req-83a10b0e-89b2-47ff-bbe1-37b0548d6a8b req-f1971619-2fa9-4cd6-8fc6-8a328e2c6d1e service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:16.559042 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d902f9ea-8b25-4eae-8a22-7c7fcb62204e req-a7effb21-65a8-442d-a2f9-3dd70b9e4e91 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/security-groups?id=12cbc694-d459-4366-b758-44d0f16106cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1310019
Jun 03 08:31:16.573678 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8a8b9b34-3bf5-445c-a016-0301547f3c72 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:16.584684 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7575420-4247-4c8f-94df-3e139cb0f473 req-4f1943ae-bf4f-433e-851e-da24c971ccb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:16.586238 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a7575420-4247-4c8f-94df-3e139cb0f473 req-4f1943ae-bf4f-433e-851e-da24c971ccb8 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=36c42f532cd14f19811ffbee3a39a208&device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 1096 time: 0.1357384
Jun 03 08:31:16.691307 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-960be65b-455e-47b8-9a50-17cedef7705f req-413dcec8-3a42-4829-b65d-77589c788a7b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:16.711943 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:16.757567 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8a8b9b34-3bf5-445c-a016-0301547f3c72 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:16.779674 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:16.798324 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-960be65b-455e-47b8-9a50-17cedef7705f req-413dcec8-3a42-4829-b65d-77589c788a7b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Network 020eaa43-2d59-46e1-8aec-0a688069f72b is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:31:16.803898 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [req-960be65b-455e-47b8-9a50-17cedef7705f req-413dcec8-3a42-4829-b65d-77589c788a7b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:31:16.817078 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-960be65b-455e-47b8-9a50-17cedef7705f req-413dcec8-3a42-4829-b65d-77589c788a7b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:31:16.823372 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-960be65b-455e-47b8-9a50-17cedef7705f req-413dcec8-3a42-4829-b65d-77589c788a7b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:16.824020 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-960be65b-455e-47b8-9a50-17cedef7705f req-413dcec8-3a42-4829-b65d-77589c788a7b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:16.845802 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-8a8b9b34-3bf5-445c-a016-0301547f3c72 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=9b3ec2f4f7fc45758fe88ae00218b8ec&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5605488
Jun 03 08:31:16.846006 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-413dcec8-3a42-4829-b65d-77589c788a7b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Pushing event updated for resources: {'Port': ['ID=19f733be-bd85-43df-86fd-5a9c617b3df4,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:16.847812 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7575420-4247-4c8f-94df-3e139cb0f473 req-e2e4c8d8-f7d1-475e-8255-5af884a0420e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:16.850064 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a7575420-4247-4c8f-94df-3e139cb0f473 req-e2e4c8d8-f7d1-475e-8255-5af884a0420e service neutron] 10.222.0.55 "GET /v2.0/networks?tenant_id=36c42f532cd14f19811ffbee3a39a208&shared=False HTTP/1.1" status: 200  len: 918 time: 0.2572293
Jun 03 08:31:16.852984 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 46782) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:16.854112 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-413dcec8-3a42-4829-b65d-77589c788a7b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:16.892338 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a8b9b34-3bf5-445c-a016-0301547f3c72 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8f8ec35a-46b7-4198-a097-76c6c909c09c,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:16.896960 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-8a8b9b34-3bf5-445c-a016-0301547f3c72 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:16.930075 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10fa8d96-ac76-4fbc-87f1-28c93ee7fb89 req-c902ac57-984f-407e-b5bd-463148136122 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:16.933036 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-10fa8d96-ac76-4fbc-87f1-28c93ee7fb89 req-c902ac57-984f-407e-b5bd-463148136122 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 931 time: 0.2679319
Jun 03 08:31:16.945225 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-83a10b0e-89b2-47ff-bbe1-37b0548d6a8b req-f1971619-2fa9-4cd6-8fc6-8a328e2c6d1e service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:17.002960 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-10fa8d96-ac76-4fbc-87f1-28c93ee7fb89 req-91c921d6-90e6-4b8e-928f-93179b193518 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0603075
Jun 03 08:31:17.054155 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-83a10b0e-89b2-47ff-bbe1-37b0548d6a8b req-f1971619-2fa9-4cd6-8fc6-8a328e2c6d1e service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:17.069059 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-258d9c6d-5331-4673-a20c-0558a242f0a7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:17.097946 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-960be65b-455e-47b8-9a50-17cedef7705f req-413dcec8-3a42-4829-b65d-77589c788a7b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.55 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.3510809
Jun 03 08:31:17.131870 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-83a10b0e-89b2-47ff-bbe1-37b0548d6a8b req-f1971619-2fa9-4cd6-8fc6-8a328e2c6d1e service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=12cbc694-d459-4366-b758-44d0f16106cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.6791644
Jun 03 08:31:17.143198 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-960be65b-455e-47b8-9a50-17cedef7705f req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Request body: {'port': {'device_id': '86bd903e-c2b5-4452-bc75-39a347cba9db', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:31:17.151479 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1971619-2fa9-4cd6-8fc6-8a328e2c6d1e service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=7515540f-5e53-4b3d-a16f-51a986be89fb,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:17.154880 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f1971619-2fa9-4cd6-8fc6-8a328e2c6d1e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:17.223276 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-af94e07b-6839-41fe-afe3-e47da9bd2966 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:17.304920 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7575420-4247-4c8f-94df-3e139cb0f473 req-8b176afc-a4a2-4cb7-8c4f-cf7f48aa3533 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:17.307067 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a7575420-4247-4c8f-94df-3e139cb0f473 req-8b176afc-a4a2-4cb7-8c4f-cf7f48aa3533 service neutron] 10.222.0.55 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.4356849
Jun 03 08:31:17.330839 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-af94e07b-6839-41fe-afe3-e47da9bd2966 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:17.346566 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7dc28e3-081c-473e-b3c5-7e9b24ecb1f5 req-478d6c47-a08a-430e-bf34-fc2fcb0aabfd tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:17.348378 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d7dc28e3-081c-473e-b3c5-7e9b24ecb1f5 req-478d6c47-a08a-430e-bf34-fc2fcb0aabfd tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.1137240
Jun 03 08:31:17.374483 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0390c5ed-4138-419c-a5ea-29fae3643033 None None] Provisioning for port 19f733be-bd85-43df-86fd-5a9c617b3df4 completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:31:17.381436 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0390c5ed-4138-419c-a5ea-29fae3643033 None None] Provisioning complete for port 19f733be-bd85-43df-86fd-5a9c617b3df4 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:31:17.381866 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0390c5ed-4138-419c-a5ea-29fae3643033 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:17.409035 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d7dc28e3-081c-473e-b3c5-7e9b24ecb1f5 req-26683de0-cd53-4e8c-85b6-fa6fe39af23c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0546303
Jun 03 08:31:17.443640 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-960be65b-455e-47b8-9a50-17cedef7705f req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:17.466597 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0390c5ed-4138-419c-a5ea-29fae3643033 None None] Port 19f733be-bd85-43df-86fd-5a9c617b3df4 cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:31:17.466777 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d18d7ea7-e010-4970-a6d4-76257dd0fac2 req-f14c72be-a5d6-471e-9460-f122de72104f tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:17.470065 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d18d7ea7-e010-4970-a6d4-76257dd0fac2 req-f14c72be-a5d6-471e-9460-f122de72104f tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 946 time: 0.4167936
Jun 03 08:31:17.594805 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d18d7ea7-e010-4970-a6d4-76257dd0fac2 req-e8efd92b-b8b7-4e64-b0f0-69bad7cd7aa4 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1156142
Jun 03 08:31:17.684377 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-c7e250dd-d558-4f51-867f-32373e4f27b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:17.686122 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-c7e250dd-d558-4f51-867f-32373e4f27b9 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=36c42f532cd14f19811ffbee3a39a208&device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 1096 time: 0.3161459
Jun 03 08:31:17.748635 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0a3d1adc-5874-4a88-8aee-893097ee9077', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '24826ba2-ee17-4774-b5ca-2cd1675f325a'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:31:17.751388 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bcdb7a46-7aad-4985-8f2f-c46bf0d24a40" -d '{"events": [{"server_uuid": "0a3d1adc-5874-4a88-8aee-893097ee9077", "name": "network-vif-plugged", "status": "completed", "tag": "24826ba2-ee17-4774-b5ca-2cd1675f325a"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:31:17.752320 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-af94e07b-6839-41fe-afe3-e47da9bd2966 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:17.770929 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70eaf149-e33f-4340-9ab4-79b5c3ce4789 req-99a58a6a-421c-4e58-8a9e-8320ecc0280f tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:17.772912 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-70eaf149-e33f-4340-9ab4-79b5c3ce4789 req-99a58a6a-421c-4e58-8a9e-8320ecc0280f tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 945 time: 0.0931344
Jun 03 08:31:17.776782 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-4b395f4e-9a04-4a34-8205-b0de698492ad admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:17.789724 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-f19db92a-4398-41e3-8ede-344b86544772 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 HTTP/1.1" status: 200  len: 217 time: 0.0933325
Jun 03 08:31:17.796772 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:31:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-47d0ed1f-2790-4c01-866d-e365e9d55301 x-openstack-request-id: req-47d0ed1f-2790-4c01-866d-e365e9d55301 {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:31:17.797128 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0a3d1adc-5874-4a88-8aee-893097ee9077", "name": "network-vif-plugged", "status": "completed", "tag": "24826ba2-ee17-4774-b5ca-2cd1675f325a", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:31:17.797383 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-47d0ed1f-2790-4c01-866d-e365e9d55301 {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:31:17.797771 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0a3d1adc-5874-4a88-8aee-893097ee9077', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '24826ba2-ee17-4774-b5ca-2cd1675f325a', 'code': 200}
Jun 03 08:31:17.827283 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-70eaf149-e33f-4340-9ab4-79b5c3ce4789 req-0986d943-3548-4f38-b65e-f8252c289966 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/security-groups?id=12cbc694-d459-4366-b758-44d0f16106cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0476973
Jun 03 08:31:17.859063 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af94e07b-6839-41fe-afe3-e47da9bd2966 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8f8ec35a-46b7-4198-a097-76c6c909c09c,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:17.876877 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-af94e07b-6839-41fe-afe3-e47da9bd2966 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:17.933897 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-af94e07b-6839-41fe-afe3-e47da9bd2966 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:17.935723 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-af94e07b-6839-41fe-afe3-e47da9bd2966 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/8f8ec35a-46b7-4198-a097-76c6c909c09c HTTP/1.1" status: 204  len: 168 time: 1.0805292
Jun 03 08:31:17.986857 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-4dc0019b-2e97-45a8-b99b-c64c920ad61b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:17.989031 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-4dc0019b-2e97-45a8-b99b-c64c920ad61b service neutron] 10.222.0.55 "GET /v2.0/subnets?id=cff67a13-bc33-4d3e-a796-5829103ca25c HTTP/1.1" status: 200  len: 856 time: 0.1737151
Jun 03 08:31:18.191066 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [req-960be65b-455e-47b8-9a50-17cedef7705f req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 19f733be-bd85-43df-86fd-5a9c617b3df4 {{(pid=92323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:31:18.197638 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-2c4c28df-8154-4a20-9256-a4082129c492 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:18.199212 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-2c4c28df-8154-4a20-9256-a4082129c492 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1957998
Jun 03 08:31:18.209854 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-960be65b-455e-47b8-9a50-17cedef7705f req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:18.246317 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f732426c-a2fc-4af3-b31e-309763f8cd68 req-45698b48-0cf5-486e-a889-16e19d97b3d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:18.248487 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f732426c-a2fc-4af3-b31e-309763f8cd68 req-45698b48-0cf5-486e-a889-16e19d97b3d6 service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 1099 time: 0.0801589
Jun 03 08:31:18.306667 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f732426c-a2fc-4af3-b31e-309763f8cd68 req-13874c7c-9ee3-4ed5-861b-3f6bbb697b17 service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0457129
Jun 03 08:31:18.352034 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-960be65b-455e-47b8-9a50-17cedef7705f req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Transition to ACTIVE for port object 19f733be-bd85-43df-86fd-5a9c617b3df4 will not be triggered until provisioned by entity L2. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:31:18.431184 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-814b8bbe-f39d-4ee4-9943-e11041edf7a2 req-efd32bd6-a913-4b47-9b7b-2580aceec3c4 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:18.438550 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-814b8bbe-f39d-4ee4-9943-e11041edf7a2 req-efd32bd6-a913-4b47-9b7b-2580aceec3c4 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Synchronizing usage tracker for tenant:755371c3d9de4747a47ba62e4d101829 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:31:18.463059 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-960be65b-455e-47b8-9a50-17cedef7705f req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:18.466232 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-e86045a6-bfec-4b68-8e53-1deca1d5e173 service neutron] 10.222.0.55 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2529972
Jun 03 08:31:18.470846 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:18.669690 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-814b8bbe-f39d-4ee4-9943-e11041edf7a2 req-efd32bd6-a913-4b47-9b7b-2580aceec3c4 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Unset dirty status for tenant:755371c3d9de4747a47ba62e4d101829 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:31:18.678874 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-814b8bbe-f39d-4ee4-9943-e11041edf7a2 req-efd32bd6-a913-4b47-9b7b-2580aceec3c4 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 931 time: 0.5410993
Jun 03 08:31:18.833834 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d72d0c04-dfec-4f48-af54-479b4da63aa9 req-2189129e-7332-4636-84f2-ead57ebd9b8c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:18.835842 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d72d0c04-dfec-4f48-af54-479b4da63aa9 req-2189129e-7332-4636-84f2-ead57ebd9b8c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.1039171
Jun 03 08:31:18.856724 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Pushing event updated for resources: {'Port': ['ID=19f733be-bd85-43df-86fd-5a9c617b3df4,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:18.864716 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.394s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:18.895810 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d72d0c04-dfec-4f48-af54-479b4da63aa9 req-3165b6bb-a6a6-4e69-8e0e-05ca1eb461b2 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0506868
Jun 03 08:31:18.961797 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-814b8bbe-f39d-4ee4-9943-e11041edf7a2 req-cb8e76d4-52b3-4b51-9da6-bb4ece8a24dc tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2815964
Jun 03 08:31:18.963423 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-960be65b-455e-47b8-9a50-17cedef7705f req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Attempting to bind port 19f733be-bd85-43df-86fd-5a9c617b3df4 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:31:18.963795 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-960be65b-455e-47b8-9a50-17cedef7705f req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Attempting to bind port 19f733be-bd85-43df-86fd-5a9c617b3df4 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '56366949-8cc8-4cf3-b3eb-d458d3515059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 531, 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b'}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:31:18.964277 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-960be65b-455e-47b8-9a50-17cedef7705f req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Attempting to bind port 19f733be-bd85-43df-86fd-5a9c617b3df4 on network 020eaa43-2d59-46e1-8aec-0a688069f72b {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:31:18.971441 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-11b30ca7-549b-4817-a163-27e2f8eb9c7c req-65b1b157-3a55-4919-9b64-1d6285e31ff7 service neutron] 10.222.0.55 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4679642
Jun 03 08:31:18.974164 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-960be65b-455e-47b8-9a50-17cedef7705f req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Port 19f733be-bd85-43df-86fd-5a9c617b3df4 on network 020eaa43-2d59-46e1-8aec-0a688069f72b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 03 08:31:18.974803 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-960be65b-455e-47b8-9a50-17cedef7705f req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Attempting to bind port 19f733be-bd85-43df-86fd-5a9c617b3df4 on network 020eaa43-2d59-46e1-8aec-0a688069f72b {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:31:18.993226 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-960be65b-455e-47b8-9a50-17cedef7705f req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Checking agent: {'id': '181c5753-100b-4f03-bda8-e34279b057f4', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'started_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 30, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:31:18.993697 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-960be65b-455e-47b8-9a50-17cedef7705f req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Checking segment: {'id': '56366949-8cc8-4cf3-b3eb-d458d3515059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 531, 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:31:18.994263 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-960be65b-455e-47b8-9a50-17cedef7705f req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Bound using segment: {'id': '56366949-8cc8-4cf3-b3eb-d458d3515059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 531, 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b'} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:31:18.995657 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-960be65b-455e-47b8-9a50-17cedef7705f req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Bound port: 19f733be-bd85-43df-86fd-5a9c617b3df4, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '56366949-8cc8-4cf3-b3eb-d458d3515059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 531, 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b'}}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:31:18.996068 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-960be65b-455e-47b8-9a50-17cedef7705f req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:19.154873 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-960be65b-455e-47b8-9a50-17cedef7705f req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] For port 19f733be-bd85-43df-86fd-5a9c617b3df4, host hv-cinder-78726, cleared binding levels {{(pid=92323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:31:19.174405 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-960be65b-455e-47b8-9a50-17cedef7705f req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] For port 19f733be-bd85-43df-86fd-5a9c617b3df4, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=19f733be-bd85-43df-86fd-5a9c617b3df4,segment=NetworkSegment(56366949-8cc8-4cf3-b3eb-d458d3515059),segment_id=56366949-8cc8-4cf3-b3eb-d458d3515059)] {{(pid=92323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:31:19.202649 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23c73c60-5b99-4a10-9fab-4067ccdc0583 req-ebc8bbc8-168d-47a1-97e2-8cb819d73107 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:19.204446 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-23c73c60-5b99-4a10-9fab-4067ccdc0583 req-ebc8bbc8-168d-47a1-97e2-8cb819d73107 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 946 time: 0.1070101
Jun 03 08:31:19.206445 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a04c26de-f6ff-4bc5-9a35-deef37f5ffa2 req-f9598168-4d6c-4cf8-8ab9-19ec86a5fb3d tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:19.207961 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a04c26de-f6ff-4bc5-9a35-deef37f5ffa2 req-f9598168-4d6c-4cf8-8ab9-19ec86a5fb3d tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 945 time: 0.0884140
Jun 03 08:31:19.251048 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-960be65b-455e-47b8-9a50-17cedef7705f req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:19.254362 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-23c73c60-5b99-4a10-9fab-4067ccdc0583 req-cc2b4c97-663c-4dd0-acf7-6af883d528b1 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0431113
Jun 03 08:31:19.257534 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a04c26de-f6ff-4bc5-9a35-deef37f5ffa2 req-3351dd18-9b4b-4881-bc8e-e292bca28fc9 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/security-groups?id=12cbc694-d459-4366-b758-44d0f16106cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425255
Jun 03 08:31:19.260231 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:19.331560 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-960be65b-455e-47b8-9a50-17cedef7705f req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:19.332194 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-960be65b-455e-47b8-9a50-17cedef7705f req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:19.333903 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-960be65b-455e-47b8-9a50-17cedef7705f req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] 10.222.0.55 "PUT /v2.0/ports/19f733be-bd85-43df-86fd-5a9c617b3df4 HTTP/1.1" status: 200  len: 1093 time: 2.2056234
Jun 03 08:31:19.337855 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '86bd903e-c2b5-4452-bc75-39a347cba9db', 'tag': '19f733be-bd85-43df-86fd-5a9c617b3df4'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:31:19.340602 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f6c874f2-e9a5-4bc0-a3bf-f709b4af6ac9" -d '{"events": [{"name": "network-changed", "server_uuid": "86bd903e-c2b5-4452-bc75-39a347cba9db", "tag": "19f733be-bd85-43df-86fd-5a9c617b3df4"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:31:19.387504 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Pushing event updated for resources: {'Port': ['ID=19f733be-bd85-43df-86fd-5a9c617b3df4,revision_number=3']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:19.398635 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:19.414671 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:31:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-63e95fc2-e511-4a36-8835-6a1802d3ef1d x-openstack-request-id: req-63e95fc2-e511-4a36-8835-6a1802d3ef1d {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:31:19.414988 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "86bd903e-c2b5-4452-bc75-39a347cba9db", "tag": "19f733be-bd85-43df-86fd-5a9c617b3df4", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:31:19.417241 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-63e95fc2-e511-4a36-8835-6a1802d3ef1d {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:31:19.417681 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '86bd903e-c2b5-4452-bc75-39a347cba9db', 'tag': '19f733be-bd85-43df-86fd-5a9c617b3df4', 'status': 'completed', 'code': 200}
Jun 03 08:31:20.169057 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d95a9f2-8793-43a0-b5da-e40158f5539a req-f7f3f0d9-e08d-4388-87db-e48945231700 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:20.170727 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-5d95a9f2-8793-43a0-b5da-e40158f5539a req-f7f3f0d9-e08d-4388-87db-e48945231700 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.1376054
Jun 03 08:31:20.233538 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-5d95a9f2-8793-43a0-b5da-e40158f5539a req-d727459f-f783-4e54-a339-e5c6c3f5ccd9 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0563612
Jun 03 08:31:20.291486 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25069710-0989-43f8-bce8-aeba91e12dd0 req-4f5545f7-c862-4192-935f-3d9b47f09da3 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:20.293226 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-25069710-0989-43f8-bce8-aeba91e12dd0 req-4f5545f7-c862-4192-935f-3d9b47f09da3 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 943 time: 0.0944343
Jun 03 08:31:20.365704 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-25069710-0989-43f8-bce8-aeba91e12dd0 req-b38a7c38-1655-450e-b51f-5f48092aacb6 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0633485
Jun 03 08:31:20.506882 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7c70744-b9f9-4b99-8b1b-4e7dba7a0a07 req-e4f676a6-405c-4216-904d-18c40319ccb8 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:20.509549 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a7c70744-b9f9-4b99-8b1b-4e7dba7a0a07 req-e4f676a6-405c-4216-904d-18c40319ccb8 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 946 time: 0.0995765
Jun 03 08:31:20.560567 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a7c70744-b9f9-4b99-8b1b-4e7dba7a0a07 req-44e1e1c4-2ff4-4088-ae3b-73235941465f tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433304
Jun 03 08:31:21.421795 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20cfa7a4-0f49-4538-96f6-16135daddb7a req-0730710c-36b2-49ee-b8e2-900532e7dc7f tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:21.423300 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-20cfa7a4-0f49-4538-96f6-16135daddb7a req-0730710c-36b2-49ee-b8e2-900532e7dc7f tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0855658
Jun 03 08:31:21.469647 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-20cfa7a4-0f49-4538-96f6-16135daddb7a req-d994ef2d-5185-4cfd-96ab-b10f704b40e7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0405993
Jun 03 08:31:21.586868 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7818fae9-23f7-4452-9a50-297f4e70370d req-002cfcfd-ef4b-4499-b689-19ceb9603099 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:21.593993 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-7818fae9-23f7-4452-9a50-297f4e70370d req-002cfcfd-ef4b-4499-b689-19ceb9603099 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 943 time: 0.1270483
Jun 03 08:31:21.644688 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-7818fae9-23f7-4452-9a50-297f4e70370d req-fdd836cf-c339-4b33-927c-4b00047a79fb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0492871
Jun 03 08:31:21.654097 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6c874f2-e9a5-4bc0-a3bf-f709b4af6ac9 req-28f218a9-bb9a-4fd4-aaf4-a226dd88ceb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:21.659373 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f6c874f2-e9a5-4bc0-a3bf-f709b4af6ac9 req-28f218a9-bb9a-4fd4-aaf4-a226dd88ceb6 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=755371c3d9de4747a47ba62e4d101829&device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 1096 time: 0.1063583
Jun 03 08:31:21.888927 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6c874f2-e9a5-4bc0-a3bf-f709b4af6ac9 req-09960af7-463a-45a0-b965-81f20a168e6d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:21.890486 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f6c874f2-e9a5-4bc0-a3bf-f709b4af6ac9 req-09960af7-463a-45a0-b965-81f20a168e6d service neutron] 10.222.0.55 "GET /v2.0/networks?tenant_id=755371c3d9de4747a47ba62e4d101829&shared=False HTTP/1.1" status: 200  len: 912 time: 0.2218401
Jun 03 08:31:21.901280 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdc40611-64cf-4610-9492-b13d2a24021e req-a24eb9a0-1eed-46c7-8f7f-a10004509075 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:21.902672 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fdc40611-64cf-4610-9492-b13d2a24021e req-a24eb9a0-1eed-46c7-8f7f-a10004509075 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 946 time: 0.1970482
Jun 03 08:31:22.043458 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fdc40611-64cf-4610-9492-b13d2a24021e req-3b1d4539-4657-4deb-8ca3-5b6b90e43c6c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1188827
Jun 03 08:31:22.070567 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6c874f2-e9a5-4bc0-a3bf-f709b4af6ac9 req-d19061dc-e734-49e1-9fde-a65cbff54e15 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:22.072188 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f6c874f2-e9a5-4bc0-a3bf-f709b4af6ac9 req-d19061dc-e734-49e1-9fde-a65cbff54e15 service neutron] 10.222.0.55 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1686473
Jun 03 08:31:22.674236 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3be3d3a7-aae4-4a27-a09b-83d673517597 req-43324b2e-c909-4c81-9309-68f3335e5634 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:22.675830 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3be3d3a7-aae4-4a27-a09b-83d673517597 req-43324b2e-c909-4c81-9309-68f3335e5634 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0852053
Jun 03 08:31:22.727639 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3be3d3a7-aae4-4a27-a09b-83d673517597 req-d47b86c9-b029-4f2e-815a-66224067c304 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0421679
Jun 03 08:31:22.850381 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e6a39e2-c90f-42f4-b071-593bf5df4322 req-36515b5e-1647-42ee-90fe-433d50218381 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:22.851989 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8e6a39e2-c90f-42f4-b071-593bf5df4322 req-36515b5e-1647-42ee-90fe-433d50218381 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 943 time: 0.0855677
Jun 03 08:31:22.897841 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8e6a39e2-c90f-42f4-b071-593bf5df4322 req-17d89339-46d7-4c67-9260-256eedbe9c29 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0400972
Jun 03 08:31:23.233210 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36c57092-0570-4970-8d1a-f32ba0a07710 req-2a13ae11-f986-49af-8953-036c1eeb29f4 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:23.234701 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-36c57092-0570-4970-8d1a-f32ba0a07710 req-2a13ae11-f986-49af-8953-036c1eeb29f4 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 946 time: 0.0852737
Jun 03 08:31:23.280033 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-36c57092-0570-4970-8d1a-f32ba0a07710 req-5ccc2912-1ac5-4703-bbb9-dfd5d65bee65 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396948
Jun 03 08:31:23.928400 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55f8b87b-493a-46a1-a5b7-7794ad50a78b req-a19a0baf-ef0d-4035-bcfa-039ec005f2d3 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:23.929844 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-55f8b87b-493a-46a1-a5b7-7794ad50a78b req-a19a0baf-ef0d-4035-bcfa-039ec005f2d3 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0826540
Jun 03 08:31:23.978231 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-55f8b87b-493a-46a1-a5b7-7794ad50a78b req-91c5e422-337f-4feb-a130-f56f843b6f91 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0412092
Jun 03 08:31:24.087459 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c022f979-4eda-4093-a2d5-660e17cf5ece req-c8c90f86-350c-4144-8e1d-29c15806f222 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:24.088971 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c022f979-4eda-4093-a2d5-660e17cf5ece req-c8c90f86-350c-4144-8e1d-29c15806f222 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 943 time: 0.0840535
Jun 03 08:31:24.140867 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c022f979-4eda-4093-a2d5-660e17cf5ece req-d022f43d-6215-474d-a0f3-6b8109a0a224 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0460718
Jun 03 08:31:24.530735 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4375749f-2e24-4089-a524-30088975e064 req-5a576e58-082a-4344-a315-50d4c53369bb tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:24.532218 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4375749f-2e24-4089-a524-30088975e064 req-5a576e58-082a-4344-a315-50d4c53369bb tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 946 time: 0.1439600
Jun 03 08:31:24.577135 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4375749f-2e24-4089-a524-30088975e064 req-47fd96fe-e9f6-4140-bc91-20b7cb5f95aa tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391109
Jun 03 08:31:25.208176 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61c0a4d3-cfe6-4ada-b6c0-428d01ca48d5 req-88ffdb04-43ce-4a89-a77c-a8b64ae99247 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:25.212551 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-960be65b-455e-47b8-9a50-17cedef7705f req-f00dbded-024b-4428-ac0e-1b377030529a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:25.214810 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-960be65b-455e-47b8-9a50-17cedef7705f req-f00dbded-024b-4428-ac0e-1b377030529a service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=755371c3d9de4747a47ba62e4d101829&device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 1096 time: 0.0923450
Jun 03 08:31:25.216497 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-61c0a4d3-cfe6-4ada-b6c0-428d01ca48d5 req-88ffdb04-43ce-4a89-a77c-a8b64ae99247 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.1212382
Jun 03 08:31:25.262663 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-61c0a4d3-cfe6-4ada-b6c0-428d01ca48d5 req-f30db74e-b767-447e-821c-99eba9d0f1af tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0452626
Jun 03 08:31:25.320110 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:31:25.333903 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-960be65b-455e-47b8-9a50-17cedef7705f req-a657291d-d94c-4675-b541-eb2b7a2fcbf7 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=19f733be-bd85-43df-86fd-5a9c617b3df4 HTTP/1.1" status: 200  len: 217 time: 0.1101658
Jun 03 08:31:25.417265 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-960be65b-455e-47b8-9a50-17cedef7705f req-d61dca68-a91c-4bfc-bb13-45b2fae6fd16 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:25.418636 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-960be65b-455e-47b8-9a50-17cedef7705f req-d61dca68-a91c-4bfc-bb13-45b2fae6fd16 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=5baf74c9-e686-40a5-b52f-f01da3bd1af9 HTTP/1.1" status: 200  len: 850 time: 0.0727215
Jun 03 08:31:25.426862 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-001e7893-79b0-4d12-bdf3-0c58cb87d7eb req-9cf1f898-bcef-4bfe-87a0-6685655f0351 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:25.428227 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-001e7893-79b0-4d12-bdf3-0c58cb87d7eb req-9cf1f898-bcef-4bfe-87a0-6685655f0351 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 943 time: 0.1522906
Jun 03 08:31:25.525002 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-001e7893-79b0-4d12-bdf3-0c58cb87d7eb req-0517b95c-bfd3-4e3f-a861-8e42fa8f5243 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0612645
Jun 03 08:31:25.543760 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-960be65b-455e-47b8-9a50-17cedef7705f req-553637de-9639-47c8-8e6e-4b5db9eeae9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:25.545472 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-960be65b-455e-47b8-9a50-17cedef7705f req-553637de-9639-47c8-8e6e-4b5db9eeae9c service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=020eaa43-2d59-46e1-8aec-0a688069f72b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1163936
Jun 03 08:31:25.683215 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-960be65b-455e-47b8-9a50-17cedef7705f req-3d8bd5ad-4bb9-4c05-a3b0-40b40b828a9e service neutron] 10.222.0.55 "GET /v2.0/networks/020eaa43-2d59-46e1-8aec-0a688069f72b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1296475
Jun 03 08:31:25.818046 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-960be65b-455e-47b8-9a50-17cedef7705f req-8af306ea-4178-4bd5-8687-95857116df1c service neutron] 10.222.0.55 "GET /v2.0/networks/020eaa43-2d59-46e1-8aec-0a688069f72b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1279874
Jun 03 08:31:26.069697 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:26.461376 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a668582-94af-4a7b-8ee5-ae8c855e0c5d req-ad5c40b6-b67a-4472-9a0f-c6453ef63a2a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:26.463009 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0a668582-94af-4a7b-8ee5-ae8c855e0c5d req-ad5c40b6-b67a-4472-9a0f-c6453ef63a2a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0866857
Jun 03 08:31:26.507757 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0a668582-94af-4a7b-8ee5-ae8c855e0c5d req-50b63dc8-e37c-424d-a6b1-6e86495a399e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0390499
Jun 03 08:31:26.614038 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:31:26.727089 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2289a760-6770-4c8f-9f98-c35eab8709af req-6d69f262-c15c-44e3-8c1c-967fb1c8c37a tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:26.729275 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2289a760-6770-4c8f-9f98-c35eab8709af req-6d69f262-c15c-44e3-8c1c-967fb1c8c37a tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 943 time: 0.0894763
Jun 03 08:31:26.757350 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:31:26.771820 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'port_id': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97', 'mac_address': 'fa:16:3e:93:b9:aa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 526, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:31:26.786761 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2289a760-6770-4c8f-9f98-c35eab8709af req-ff452afb-4db0-423b-9d07-8e165290eb07 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0484915
Jun 03 08:31:26.849945 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:26.867580 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:31:26.884614 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:31:27.043194 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:27.045063 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:27.113949 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:27.117235 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:27.271154 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:31:28.878908 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f63dd183-7c42-4bb6-b569-129afe887ac9 req-d4180abf-23e9-4811-bf24-a5ad24369846 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:28.880385 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f63dd183-7c42-4bb6-b569-129afe887ac9 req-d4180abf-23e9-4811-bf24-a5ad24369846 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 944 time: 0.1357150
Jun 03 08:31:28.932084 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f63dd183-7c42-4bb6-b569-129afe887ac9 req-30cf8d81-e33d-4c25-a16a-04cf511f3602 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0459030
Jun 03 08:31:29.085742 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 19f733be-bd85-43df-86fd-5a9c617b3df4 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:31:29.125841 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67b81e79-ed0e-499d-89fa-939628abe57d req-71157470-2927-4608-80b3-bd390794047f tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:29.129195 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-67b81e79-ed0e-499d-89fa-939628abe57d req-71157470-2927-4608-80b3-bd390794047f tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 943 time: 0.0954957
Jun 03 08:31:29.174340 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-67b81e79-ed0e-499d-89fa-939628abe57d req-0bff1fba-5209-4e62-9e79-54a6b4da8771 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0437849
Jun 03 08:31:29.231144 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 19f733be-bd85-43df-86fd-5a9c617b3df4, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=19f733be-bd85-43df-86fd-5a9c617b3df4,segment=NetworkSegment(56366949-8cc8-4cf3-b3eb-d458d3515059),segment_id=56366949-8cc8-4cf3-b3eb-d458d3515059)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:31:29.244573 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': '19f733be-bd85-43df-86fd-5a9c617b3df4', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'port_id': '19f733be-bd85-43df-86fd-5a9c617b3df4', 'mac_address': 'fa:16:3e:ec:bc:3b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 531, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:31:29.298841 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:29.318928 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 19f733be-bd85-43df-86fd-5a9c617b3df4 {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:31:29.334613 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 19f733be-bd85-43df-86fd-5a9c617b3df4, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=19f733be-bd85-43df-86fd-5a9c617b3df4,segment=NetworkSegment(56366949-8cc8-4cf3-b3eb-d458d3515059),segment_id=56366949-8cc8-4cf3-b3eb-d458d3515059)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:31:29.390597 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:29.392359 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:29.457190 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=19f733be-bd85-43df-86fd-5a9c617b3df4,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:29.460500 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:30.038709 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:31:30.130544 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0686fea9-d4d6-46db-87db-1b6a6a5f4998 req-26517dfa-94e6-41a9-9ebc-1558c3437305 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:30.132040 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0686fea9-d4d6-46db-87db-1b6a6a5f4998 req-26517dfa-94e6-41a9-9ebc-1558c3437305 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 944 time: 0.0870819
Jun 03 08:31:30.162558 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning for port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:31:30.168599 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:31:30.169051 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:30.181047 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0686fea9-d4d6-46db-87db-1b6a6a5f4998 req-ad65c7e7-6e12-41f7-b841-d87756d3e6ff tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0415177
Jun 03 08:31:30.295846 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:30.325249 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0c731ecb-c3fc-401e-af74-34336582cf7d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:31:30.327646 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-41ad9c89-6708-40e8-b83a-f122eb0bfe9e" -d '{"events": [{"server_uuid": "0c731ecb-c3fc-401e-af74-34336582cf7d", "name": "network-vif-plugged", "status": "completed", "tag": "7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:31:30.336142 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:31:30.363907 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e8896d3-bf14-4492-b1a6-d73208f2f1a7 req-4a2569f4-4a11-4c78-91f7-2ea88e5b8ef3 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:30.365391 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8e8896d3-bf14-4492-b1a6-d73208f2f1a7 req-4a2569f4-4a11-4c78-91f7-2ea88e5b8ef3 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 944 time: 0.0823488
Jun 03 08:31:30.379486 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:31:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-315e1236-0cb6-4042-b4cd-335a3dab86e4 x-openstack-request-id: req-315e1236-0cb6-4042-b4cd-335a3dab86e4 {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:31:30.379789 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0c731ecb-c3fc-401e-af74-34336582cf7d", "name": "network-vif-plugged", "status": "completed", "tag": "7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:31:30.380068 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-315e1236-0cb6-4042-b4cd-335a3dab86e4 {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:31:30.380441 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0c731ecb-c3fc-401e-af74-34336582cf7d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97', 'code': 200}
Jun 03 08:31:30.411620 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8e8896d3-bf14-4492-b1a6-d73208f2f1a7 req-b705ac27-67c5-4c45-91ad-473f8a0790f1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0397859
Jun 03 08:31:30.423582 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:30.425476 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:30.501559 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:30.504475 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:31.379183 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['19f733be-bd85-43df-86fd-5a9c617b3df4'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:31:31.408209 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44a98cc0-727d-41b6-b716-0e2785ae2995 req-def05f6f-7f04-47ab-ab52-dc3feb09812e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:31.409769 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-44a98cc0-727d-41b6-b716-0e2785ae2995 req-def05f6f-7f04-47ab-ab52-dc3feb09812e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.0940537
Jun 03 08:31:31.508258 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-44a98cc0-727d-41b6-b716-0e2785ae2995 req-dd60e083-5ede-4338-8129-b02311787945 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0640767
Jun 03 08:31:31.541005 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a1e6d92-334c-440c-80b1-0325fea3c1db req-e3f1197f-719a-46f1-83ca-0440fb33a2e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:31.541005 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7a1e6d92-334c-440c-80b1-0325fea3c1db req-e3f1197f-719a-46f1-83ca-0440fb33a2e6 service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 1098 time: 0.1233220
Jun 03 08:31:31.583171 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7a1e6d92-334c-440c-80b1-0325fea3c1db req-d4fd6054-efd6-4a99-8df0-baffbc3da5aa service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0406606
Jun 03 08:31:31.633341 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ced8015-e51e-46cc-98d4-be24a045814c req-3523b840-85ed-4214-9db8-2bc8c563f871 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:31.635646 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8ced8015-e51e-46cc-98d4-be24a045814c req-3523b840-85ed-4214-9db8-2bc8c563f871 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 944 time: 0.0895176
Jun 03 08:31:31.684002 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8ced8015-e51e-46cc-98d4-be24a045814c req-b697340d-8bbf-43a0-91f8-0776954e8f28 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0426497
Jun 03 08:31:32.540545 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-f7a9845b-1c3f-4a55-8631-da8efdfcff2e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:32.715730 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a7c685a-5283-4877-91d5-66ae7a011859 req-ad4ccb13-b1ea-4332-b12f-dee6d87319ad tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:32.723924 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7a7c685a-5283-4877-91d5-66ae7a011859 req-ad4ccb13-b1ea-4332-b12f-dee6d87319ad tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.0937603
Jun 03 08:31:32.783863 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7a7c685a-5283-4877-91d5-66ae7a011859 req-27f0e820-7043-45c1-9740-807d5e24a410 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0535715
Jun 03 08:31:32.933403 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c28bf34-7897-461f-9df9-0c718423ebe7 req-a9f6329d-65d8-4ec5-9ffc-5bb10678b0e1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:32.935299 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-9c28bf34-7897-461f-9df9-0c718423ebe7 req-a9f6329d-65d8-4ec5-9ffc-5bb10678b0e1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 944 time: 0.1103253
Jun 03 08:31:32.982678 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-9c28bf34-7897-461f-9df9-0c718423ebe7 req-19cb9c86-ec01-4f86-ab3c-0a115d67e135 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0414836
Jun 03 08:31:33.047952 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 19f733be-bd85-43df-86fd-5a9c617b3df4 up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:31:33.219534 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning for port 19f733be-bd85-43df-86fd-5a9c617b3df4 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:31:33.224428 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port 19f733be-bd85-43df-86fd-5a9c617b3df4 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:31:33.224809 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:33.343626 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:33.373105 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '86bd903e-c2b5-4452-bc75-39a347cba9db', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '19f733be-bd85-43df-86fd-5a9c617b3df4'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:31:33.375366 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7d5b978e-a824-46fb-acca-7ff41ec58324" -d '{"events": [{"server_uuid": "86bd903e-c2b5-4452-bc75-39a347cba9db", "name": "network-vif-plugged", "status": "completed", "tag": "19f733be-bd85-43df-86fd-5a9c617b3df4"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:31:33.384515 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 19f733be-bd85-43df-86fd-5a9c617b3df4, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=19f733be-bd85-43df-86fd-5a9c617b3df4,segment=NetworkSegment(56366949-8cc8-4cf3-b3eb-d458d3515059),segment_id=56366949-8cc8-4cf3-b3eb-d458d3515059)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:31:33.422693 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:31:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-943930e9-c859-4667-8456-7b6c312f9244 x-openstack-request-id: req-943930e9-c859-4667-8456-7b6c312f9244 {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:31:33.423265 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "86bd903e-c2b5-4452-bc75-39a347cba9db", "name": "network-vif-plugged", "status": "completed", "tag": "19f733be-bd85-43df-86fd-5a9c617b3df4", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:31:33.423712 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-943930e9-c859-4667-8456-7b6c312f9244 {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:31:33.424155 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '86bd903e-c2b5-4452-bc75-39a347cba9db', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '19f733be-bd85-43df-86fd-5a9c617b3df4', 'code': 200}
Jun 03 08:31:33.461868 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 47204) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:33.464916 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:33.467142 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:33.548950 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=19f733be-bd85-43df-86fd-5a9c617b3df4,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:33.559533 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:33.638343 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5c69a3a9-2004-47d9-b23a-7b8277437548 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:33.977868 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-5c69a3a9-2004-47d9-b23a-7b8277437548 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:33.977868 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-5c69a3a9-2004-47d9-b23a-7b8277437548 admin admin] Usage tracker for resource:security_group_rule and tenant:9dedee6f2551459d813e36b823c792cf is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:33.977868 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-5c69a3a9-2004-47d9-b23a-7b8277437548 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:33.977868 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-5c69a3a9-2004-47d9-b23a-7b8277437548 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:33.977868 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5c69a3a9-2004-47d9-b23a-7b8277437548 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:33.977868 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dc3f4b3-aae0-4321-8d07-29c0bb387f11 req-304e45f0-3a70-4961-84df-e3d8b2751a1e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:33.977868 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-9dc3f4b3-aae0-4321-8d07-29c0bb387f11 req-304e45f0-3a70-4961-84df-e3d8b2751a1e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.0820544
Jun 03 08:31:34.019385 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-9dc3f4b3-aae0-4321-8d07-29c0bb387f11 req-3a21e3ae-f79a-4adf-8d33-a71cea746e31 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0436261
Jun 03 08:31:34.184245 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab7070c0-dc3b-4353-b0df-d8a943783dc1 req-0cc4d977-945b-4f0a-b14c-f671b1cd60a0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:34.186050 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ab7070c0-dc3b-4353-b0df-d8a943783dc1 req-0cc4d977-945b-4f0a-b14c-f671b1cd60a0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.0929520
Jun 03 08:31:34.217910 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4605abe-2abc-4ae8-a53d-57d846d1e3f3 req-9071e33f-064e-4716-94ec-bb611bdc62f6 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:34.219456 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d4605abe-2abc-4ae8-a53d-57d846d1e3f3 req-9071e33f-064e-4716-94ec-bb611bdc62f6 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.0929334
Jun 03 08:31:34.228550 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 47222) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:34.233565 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-89864bf1-6501-43a7-98b7-657f2781a5d6 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Request body: {'floatingip': {'port_id': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:31:34.237123 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ab7070c0-dc3b-4353-b0df-d8a943783dc1 req-1d863878-ef81-478a-bc21-5058b51024d0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0445831
Jun 03 08:31:34.324946 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-89864bf1-6501-43a7-98b7-657f2781a5d6 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for floatingip, before_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:34.582294 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5c69a3a9-2004-47d9-b23a-7b8277437548 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:34.599543 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:34.652866 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-5c69a3a9-2004-47d9-b23a-7b8277437548 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=9dedee6f2551459d813e36b823c792cf&name=default HTTP/1.1" status: 200  len: 2979 time: 1.1874869
Jun 03 08:31:34.653679 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 47226) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:34.657842 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c69a3a9-2004-47d9-b23a-7b8277437548 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0d70aefc-c809-4362-af1a-b8fcccbd6800,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:34.712278 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-5c69a3a9-2004-47d9-b23a-7b8277437548 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:34.803969 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-11660423-86df-46f7-b982-b007560a4bf5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:34.819604 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-879516eb-36bf-424f-902e-584eeb09a8f1 req-35180a5f-53c7-4292-a61d-8e0140f2092a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:34.821849 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-879516eb-36bf-424f-902e-584eeb09a8f1 req-35180a5f-53c7-4292-a61d-8e0140f2092a service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 1098 time: 0.1693790
Jun 03 08:31:34.848969 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-11660423-86df-46f7-b982-b007560a4bf5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:34.905810 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-879516eb-36bf-424f-902e-584eeb09a8f1 req-993e9407-f88a-4fe3-8994-097b346a5aa6 service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0768337
Jun 03 08:31:34.951184 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:35.076376 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-11660423-86df-46f7-b982-b007560a4bf5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:35.080945 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-af94e07b-6839-41fe-afe3-e47da9bd2966 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:35.159271 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11660423-86df-46f7-b982-b007560a4bf5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0d70aefc-c809-4362-af1a-b8fcccbd6800,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:35.165551 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-11660423-86df-46f7-b982-b007560a4bf5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:35.166968 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-11660423-86df-46f7-b982-b007560a4bf5 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/0d70aefc-c809-4362-af1a-b8fcccbd6800 HTTP/1.1" status: 204  len: 168 time: 0.4732170
Jun 03 08:31:35.172712 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11660423-86df-46f7-b982-b007560a4bf5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:35.173235 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11660423-86df-46f7-b982-b007560a4bf5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:35.173738 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11660423-86df-46f7-b982-b007560a4bf5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:35.174237 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11660423-86df-46f7-b982-b007560a4bf5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:35.174755 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11660423-86df-46f7-b982-b007560a4bf5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:35.175257 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11660423-86df-46f7-b982-b007560a4bf5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:35.175746 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11660423-86df-46f7-b982-b007560a4bf5 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:35.176248 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11660423-86df-46f7-b982-b007560a4bf5 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:35.176591 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11660423-86df-46f7-b982-b007560a4bf5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:35.176932 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11660423-86df-46f7-b982-b007560a4bf5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:35.177270 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11660423-86df-46f7-b982-b007560a4bf5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:35.177669 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11660423-86df-46f7-b982-b007560a4bf5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:35.187787 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-11660423-86df-46f7-b982-b007560a4bf5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:35.291447 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-89864bf1-6501-43a7-98b7-657f2781a5d6 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:35.396963 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-932b524d-3c8d-4be8-93c9-d8c4baf88b6e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:35.435383 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bff2867e-e873-4336-8c65-2c5d955ecb95 req-2a025bfa-0a20-4338-a056-dac47d0951d4 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:35.436851 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-bff2867e-e873-4336-8c65-2c5d955ecb95 req-2a025bfa-0a20-4338-a056-dac47d0951d4 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.0824320
Jun 03 08:31:35.474781 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-89864bf1-6501-43a7-98b7-657f2781a5d6 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16327919'] for floatingip, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:35.544016 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-bff2867e-e873-4336-8c65-2c5d955ecb95 req-c8d52d29-f4c5-4b8d-aa46-3bfdea7bf17a tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1014082
Jun 03 08:31:35.659344 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.l3_db [None req-89864bf1-6501-43a7-98b7-657f2781a5d6 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Floating IP 4ac13f19-aae2-4b91-8bfd-97e4db2bcc6b associated. External IP: 172.27.0.151, port: 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97.
Jun 03 08:31:36.046148 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-89864bf1-6501-43a7-98b7-657f2781a5d6 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Router cb358121-3d7d-46b4-8e93-e40d5a92215c has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:31:36.230643 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:36.284818 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-89864bf1-6501-43a7-98b7-657f2781a5d6 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:31:36.305054 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f19202f5-9afe-4ddc-a287-36367c35a6b4 None None] Sync routers for ids ['cb358121-3d7d-46b4-8e93-e40d5a92215c'] in dv-cinder-787262-5-iscsi {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:31:36.310337 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-89864bf1-6501-43a7-98b7-657f2781a5d6 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for floatingip, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:36.315255 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f19202f5-9afe-4ddc-a287-36367c35a6b4 None None] Routers {'cb358121-3d7d-46b4-8e93-e40d5a92215c'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:31:36.315871 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-f19202f5-9afe-4ddc-a287-36367c35a6b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae879d08e0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:31:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['cb358121-3d7d-46b4-8e93-e40d5a92215c'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:31:36.381332 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-89864bf1-6501-43a7-98b7-657f2781a5d6 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "PUT /v2.0/floatingips/4ac13f19-aae2-4b91-8bfd-97e4db2bcc6b HTTP/1.1" status: 200  len: 991 time: 2.1441000
Jun 03 08:31:36.381332 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0c731ecb-c3fc-401e-af74-34336582cf7d', 'tag': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97'}] {{(pid=92324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:31:36.520702 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-f19202f5-9afe-4ddc-a287-36367c35a6b4 None None] Set router cb358121-3d7d-46b4-8e93-e40d5a92215c gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:31:36.651593 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}25ad023063ed160b339e2d2d51ef3e5c51250aece1f4db0a35843dff1b64291a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b37e7d4b-88ed-429a-9c76-86d3a03cefce" -d '{"events": [{"name": "network-changed", "server_uuid": "0c731ecb-c3fc-401e-af74-34336582cf7d", "tag": "7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97"}]}' {{(pid=92324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:31:36.838248 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:31:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6365d273-3c8a-4363-91cb-ebb1af32c336 x-openstack-request-id: req-6365d273-3c8a-4363-91cb-ebb1af32c336 {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:31:36.838570 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0c731ecb-c3fc-401e-af74-34336582cf7d", "tag": "7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97", "status": "completed", "code": 200}]} {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:31:36.838843 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-6365d273-3c8a-4363-91cb-ebb1af32c336 {{(pid=92324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:31:36.845282 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0c731ecb-c3fc-401e-af74-34336582cf7d', 'tag': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97', 'status': 'completed', 'code': 200}
Jun 03 08:31:36.893299 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967aaaed-79c0-44fe-ab95-851cfb250697 req-c4a0abf5-2ff8-44fa-b360-f550eddb71e9 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:36.896049 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-967aaaed-79c0-44fe-ab95-851cfb250697 req-c4a0abf5-2ff8-44fa-b360-f550eddb71e9 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.1413465
Jun 03 08:31:36.949250 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-967aaaed-79c0-44fe-ab95-851cfb250697 req-b25c0fb9-59de-41e6-b00a-0400258a73ae tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0457308
Jun 03 08:31:36.950519 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b37e7d4b-88ed-429a-9c76-86d3a03cefce req-53ad7779-87b5-4ac2-aa7d-f7695fd2f382 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:36.952164 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b37e7d4b-88ed-429a-9c76-86d3a03cefce req-53ad7779-87b5-4ac2-aa7d-f7695fd2f382 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=36c42f532cd14f19811ffbee3a39a208&device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 1098 time: 0.0778904
Jun 03 08:31:37.060500 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-f19202f5-9afe-4ddc-a287-36367c35a6b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae879d08e0>, [{'id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-router', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:37Z', 'updated_at': '2021-06-03T08:30:48Z', 'revision_number': 4, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'gw_port': {'id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:11:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': '4ac13f19-aae2-4b91-8bfd-97e4db2bcc6b', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'floating_ip_address': '172.27.0.151', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'port_id': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 98, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'mac_address': 'fa:16:3e:93:b9:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c731ecb-c3fc-401e-af74-34336582cf7d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:31:04Z', 'updated_at': '2021-06-03T08:31:35Z', 'revision_number': 1, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5d9c4d5c-7c2e-4911-823a-3a3242707096', 'name': '', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'mac_address': 'fa:16:3e:0c:7e:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_interface', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:46Z', 'updated_at': '2021-06-03T08:31:03Z', 'revision_number': 5, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'subnets': [{'id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:31:37.067208 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f19202f5-9afe-4ddc-a287-36367c35a6b4 None None] Checking router: cb358121-3d7d-46b4-8e93-e40d5a92215c for host: dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:31:37.078384 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f19202f5-9afe-4ddc-a287-36367c35a6b4 None None] Routers {'cb358121-3d7d-46b4-8e93-e40d5a92215c'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:31:37.079448 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-f19202f5-9afe-4ddc-a287-36367c35a6b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae879d08e0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:31:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['cb358121-3d7d-46b4-8e93-e40d5a92215c'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:31:37.129419 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b37e7d4b-88ed-429a-9c76-86d3a03cefce req-643e36f1-9f74-4467-a6d9-b2163932030e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:37.130975 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b37e7d4b-88ed-429a-9c76-86d3a03cefce req-643e36f1-9f74-4467-a6d9-b2163932030e service neutron] 10.222.0.55 "GET /v2.0/networks?id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba HTTP/1.1" status: 200  len: 918 time: 0.1675000
Jun 03 08:31:37.304948 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b37e7d4b-88ed-429a-9c76-86d3a03cefce req-f3c9b630-5f16-4c4c-8bbc-c7a366b20172 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 HTTP/1.1" status: 200  len: 999 time: 0.1381590
Jun 03 08:31:37.307110 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-f19202f5-9afe-4ddc-a287-36367c35a6b4 None None] Set router cb358121-3d7d-46b4-8e93-e40d5a92215c gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:31:37.377909 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0900f77-0f1c-4969-af53-0a0272aaf9c7 req-a8cf4782-babc-405d-97d0-85a14f86b6f0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:37.379611 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b0900f77-0f1c-4969-af53-0a0272aaf9c7 req-a8cf4782-babc-405d-97d0-85a14f86b6f0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.2594121
Jun 03 08:31:37.389386 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 47326) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:37.394315 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-84206f31-13c0-4a89-8b4a-43bfbfc1fc02 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Request body: {'floatingip': {'port_id': '19f733be-bd85-43df-86fd-5a9c617b3df4'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:31:37.398666 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b37e7d4b-88ed-429a-9c76-86d3a03cefce req-c3ce390f-9ccc-4920-aa0c-c677f38ca45a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:37.401091 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b37e7d4b-88ed-429a-9c76-86d3a03cefce req-c3ce390f-9ccc-4920-aa0c-c677f38ca45a service neutron] 10.222.0.55 "GET /v2.0/subnets?id=cff67a13-bc33-4d3e-a796-5829103ca25c HTTP/1.1" status: 200  len: 856 time: 0.0897758
Jun 03 08:31:37.545896 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b37e7d4b-88ed-429a-9c76-86d3a03cefce req-f93771d0-da3b-4e5c-ba98-4e66ee310e0a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:37.548235 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b37e7d4b-88ed-429a-9c76-86d3a03cefce req-f93771d0-da3b-4e5c-ba98-4e66ee310e0a service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1308668
Jun 03 08:31:37.612678 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-84206f31-13c0-4a89-8b4a-43bfbfc1fc02 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for floatingip, before_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:37.762455 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b37e7d4b-88ed-429a-9c76-86d3a03cefce req-df222e3f-36ea-46d2-9129-d088f6df3f6f service neutron] 10.222.0.55 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1974165
Jun 03 08:31:37.896743 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-f19202f5-9afe-4ddc-a287-36367c35a6b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae879d08e0>, [{'id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-router', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:37Z', 'updated_at': '2021-06-03T08:30:48Z', 'revision_number': 4, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'gw_port': {'id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:11:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': '4ac13f19-aae2-4b91-8bfd-97e4db2bcc6b', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'floating_ip_address': '172.27.0.151', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'port_id': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 98, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'mac_address': 'fa:16:3e:93:b9:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c731ecb-c3fc-401e-af74-34336582cf7d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:31:04Z', 'updated_at': '2021-06-03T08:31:35Z', 'revision_number': 1, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5d9c4d5c-7c2e-4911-823a-3a3242707096', 'name': '', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'mac_address': 'fa:16:3e:0c:7e:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_interface', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:46Z', 'updated_at': '2021-06-03T08:31:03Z', 'revision_number': 5, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'subnets': [{'id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:31:37.907587 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f19202f5-9afe-4ddc-a287-36367c35a6b4 None None] The sync data for ids ['cb358121-3d7d-46b4-8e93-e40d5a92215c'] in dv-cinder-787262-5-iscsi is: [{'id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-router', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:37Z', 'updated_at': '2021-06-03T08:30:48Z', 'revision_number': 4, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'gw_port': {'id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:11:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': '4ac13f19-aae2-4b91-8bfd-97e4db2bcc6b', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'floating_ip_address': '172.27.0.151', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'port_id': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 98, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'mac_address': 'fa:16:3e:93:b9:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c731ecb-c3fc-401e-af74-34336582cf7d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:31:04Z', 'updated_at': '2021-06-03T08:31:35Z', 'revision_number': 1, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5d9c4d5c-7c2e-4911-823a-3a3242707096', 'name': '', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'mac_address': 'fa:16:3e:0c:7e:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_interface', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:46Z', 'updated_at': '2021-06-03T08:31:03Z', 'revision_number': 5, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'subnets': [{'id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:31:38.003301 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b37e7d4b-88ed-429a-9c76-86d3a03cefce req-e6f58830-bff7-466d-b202-4fb295dc8667 service neutron] 10.222.0.55 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2246857
Jun 03 08:31:38.071965 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:38.184347 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9835a51c-0690-4771-b190-1b3f2c751e56 None None] New status for floating IP 4ac13f19-aae2-4b91-8bfd-97e4db2bcc6b: ACTIVE {{(pid=92325) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 03 08:31:38.438306 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-84206f31-13c0-4a89-8b4a-43bfbfc1fc02 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:38.493624 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-84206f31-13c0-4a89-8b4a-43bfbfc1fc02 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16327919'] for floatingip, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:38.715379 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.l3_db [None req-84206f31-13c0-4a89-8b4a-43bfbfc1fc02 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Floating IP 6175662d-b2ef-45f8-ada4-07ee4d1d828f associated. External IP: 172.27.0.237, port: 19f733be-bd85-43df-86fd-5a9c617b3df4.
Jun 03 08:31:39.090592 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-84206f31-13c0-4a89-8b4a-43bfbfc1fc02 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Router a4b01ad1-d952-4deb-88df-6930ad4824db has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:31:39.208184 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 47390) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:39.226577 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 47394) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:39.373788 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-42a3cf25-9e35-4246-866e-1617c0756e22 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:39.408630 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c79cd8ab-4844-4080-bf1a-ce5e54b3dbcb admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:39.419544 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-42a3cf25-9e35-4246-866e-1617c0756e22 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:39.427202 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-42a3cf25-9e35-4246-866e-1617c0756e22 admin admin] Usage tracker for resource:security_group_rule and tenant:a89b0d7e18b5416f8a2e0cb7d2000b02 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:39.432087 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-42a3cf25-9e35-4246-866e-1617c0756e22 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:39.438764 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-c79cd8ab-4844-4080-bf1a-ce5e54b3dbcb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:39.439186 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-84206f31-13c0-4a89-8b4a-43bfbfc1fc02 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:31:39.442076 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-42a3cf25-9e35-4246-866e-1617c0756e22 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:39.447879 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-c79cd8ab-4844-4080-bf1a-ce5e54b3dbcb admin admin] Usage tracker for resource:security_group_rule and tenant:116ffc17ad84437bb1d6106bc9c1a5a5 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:39.453407 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a78c4966-0ccc-4258-a3e6-cdc4750fc0b7 None None] Sync routers for ids ['a4b01ad1-d952-4deb-88df-6930ad4824db'] in dv-cinder-787262-5-iscsi {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:31:39.456967 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-84206f31-13c0-4a89-8b4a-43bfbfc1fc02 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for floatingip, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:39.460547 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-c79cd8ab-4844-4080-bf1a-ce5e54b3dbcb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:39.467065 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a78c4966-0ccc-4258-a3e6-cdc4750fc0b7 None None] Routers {'a4b01ad1-d952-4deb-88df-6930ad4824db'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:31:39.473631 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-a78c4966-0ccc-4258-a3e6-cdc4750fc0b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86ac8460>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:31:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['a4b01ad1-d952-4deb-88df-6930ad4824db'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:31:39.494669 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-c79cd8ab-4844-4080-bf1a-ce5e54b3dbcb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:39.538964 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-84206f31-13c0-4a89-8b4a-43bfbfc1fc02 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "PUT /v2.0/floatingips/6175662d-b2ef-45f8-ada4-07ee4d1d828f HTTP/1.1" status: 200  len: 991 time: 2.1481094
Jun 03 08:31:39.539852 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '86bd903e-c2b5-4452-bc75-39a347cba9db', 'tag': '19f733be-bd85-43df-86fd-5a9c617b3df4'}] {{(pid=92324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:31:39.544141 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}25ad023063ed160b339e2d2d51ef3e5c51250aece1f4db0a35843dff1b64291a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-19822d53-a271-48b3-919e-c8e57754cf7f" -d '{"events": [{"name": "network-changed", "server_uuid": "86bd903e-c2b5-4452-bc75-39a347cba9db", "tag": "19f733be-bd85-43df-86fd-5a9c617b3df4"}]}' {{(pid=92324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:31:39.642536 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:31:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8b8e617f-dc93-482b-a398-dc7927d5409a x-openstack-request-id: req-8b8e617f-dc93-482b-a398-dc7927d5409a {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:31:39.642849 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "86bd903e-c2b5-4452-bc75-39a347cba9db", "tag": "19f733be-bd85-43df-86fd-5a9c617b3df4", "status": "completed", "code": 200}]} {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:31:39.643315 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-8b8e617f-dc93-482b-a398-dc7927d5409a {{(pid=92324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:31:39.643729 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '86bd903e-c2b5-4452-bc75-39a347cba9db', 'tag': '19f733be-bd85-43df-86fd-5a9c617b3df4', 'status': 'completed', 'code': 200}
Jun 03 08:31:39.652448 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-42a3cf25-9e35-4246-866e-1617c0756e22 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:39.669616 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c79cd8ab-4844-4080-bf1a-ce5e54b3dbcb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:39.700319 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-a78c4966-0ccc-4258-a3e6-cdc4750fc0b7 None None] Set router a4b01ad1-d952-4deb-88df-6930ad4824db gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:31:39.758109 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19822d53-a271-48b3-919e-c8e57754cf7f req-97d91006-0a52-49f4-8b9f-4c58ba5e76b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:39.760443 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-19822d53-a271-48b3-919e-c8e57754cf7f req-97d91006-0a52-49f4-8b9f-4c58ba5e76b6 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=755371c3d9de4747a47ba62e4d101829&device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 1098 time: 0.0861089
Jun 03 08:31:39.789619 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-42a3cf25-9e35-4246-866e-1617c0756e22 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:39.790331 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c79cd8ab-4844-4080-bf1a-ce5e54b3dbcb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:39.803718 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-2253eb7f-4326-4162-8aa7-ec58231a0886 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:39.954040 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-42a3cf25-9e35-4246-866e-1617c0756e22 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=a89b0d7e18b5416f8a2e0cb7d2000b02&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7257910
Jun 03 08:31:39.956694 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 47412) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:39.961715 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-c79cd8ab-4844-4080-bf1a-ce5e54b3dbcb admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=116ffc17ad84437bb1d6106bc9c1a5a5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7592776
Jun 03 08:31:39.962655 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42a3cf25-9e35-4246-866e-1617c0756e22 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c4a3ee4-829d-4882-b310-ea99a8088d66,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:39.967182 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 47414) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:40.033485 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5f135294-b207-42da-b8d5-e49625c5f7e1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:40.041471 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19822d53-a271-48b3-919e-c8e57754cf7f req-af7e5bb3-689e-43da-8efe-cdec0bb48b89 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:40.043738 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-19822d53-a271-48b3-919e-c8e57754cf7f req-af7e5bb3-689e-43da-8efe-cdec0bb48b89 service neutron] 10.222.0.55 "GET /v2.0/networks?id=020eaa43-2d59-46e1-8aec-0a688069f72b HTTP/1.1" status: 200  len: 912 time: 0.2756333
Jun 03 08:31:40.044428 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c79cd8ab-4844-4080-bf1a-ce5e54b3dbcb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d671e1dd-65da-40ed-aa32-61ca422885d5,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:40.077671 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c79cd8ab-4844-4080-bf1a-ce5e54b3dbcb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.274s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:40.081232 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.235s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:40.081508 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:40.086619 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5f135294-b207-42da-b8d5-e49625c5f7e1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:40.125656 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-a78c4966-0ccc-4258-a3e6-cdc4750fc0b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86ac8460>, [{'id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'name': 'tempest-AttachVolumeTestJSON-1767133114-router', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241'}], 'enable_snat': True}, 'gw_port_id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:38Z', 'updated_at': '2021-06-03T08:30:51Z', 'revision_number': 4, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'gw_port': {'id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:65:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': '6175662d-b2ef-45f8-ada4-07ee4d1d828f', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'floating_ip_address': '172.27.0.237', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'port_id': '19f733be-bd85-43df-86fd-5a9c617b3df4', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 106, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'mac_address': 'fa:16:3e:ec:bc:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86bd903e-c2b5-4452-bc75-39a347cba9db', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:31:07Z', 'updated_at': '2021-06-03T08:31:38Z', 'revision_number': 1, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '09aff824-d423-4557-8913-463e6f53d3e5', 'name': '', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'mac_address': 'fa:16:3e:c4:92:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_interface', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:47Z', 'updated_at': '2021-06-03T08:31:05Z', 'revision_number': 5, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'subnets': [{'id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:31:40.137537 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a78c4966-0ccc-4258-a3e6-cdc4750fc0b7 None None] Checking router: a4b01ad1-d952-4deb-88df-6930ad4824db for host: dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:31:40.154803 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a78c4966-0ccc-4258-a3e6-cdc4750fc0b7 None None] Routers {'a4b01ad1-d952-4deb-88df-6930ad4824db'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:31:40.155422 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-a78c4966-0ccc-4258-a3e6-cdc4750fc0b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86ac8460>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:31:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['a4b01ad1-d952-4deb-88df-6930ad4824db'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:31:40.202592 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1bffc234-6153-4a43-9ea3-18f8e964636f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:40.216808 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-19822d53-a271-48b3-919e-c8e57754cf7f req-b0c41384-8713-4be8-90e5-7c74fb9fdbda service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=19f733be-bd85-43df-86fd-5a9c617b3df4 HTTP/1.1" status: 200  len: 999 time: 0.1380262
Jun 03 08:31:40.264943 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5f135294-b207-42da-b8d5-e49625c5f7e1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:40.273028 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-cf730ac0-f703-43e7-92fc-9b74e49b9a05 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:40.278851 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1bffc234-6153-4a43-9ea3-18f8e964636f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:40.296465 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f135294-b207-42da-b8d5-e49625c5f7e1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c4a3ee4-829d-4882-b310-ea99a8088d66,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:40.307025 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f135294-b207-42da-b8d5-e49625c5f7e1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:40.307778 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f135294-b207-42da-b8d5-e49625c5f7e1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:40.308219 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f135294-b207-42da-b8d5-e49625c5f7e1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:40.308655 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f135294-b207-42da-b8d5-e49625c5f7e1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:40.309091 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f135294-b207-42da-b8d5-e49625c5f7e1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:40.309779 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f135294-b207-42da-b8d5-e49625c5f7e1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:40.310234 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f135294-b207-42da-b8d5-e49625c5f7e1 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:40.310709 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f135294-b207-42da-b8d5-e49625c5f7e1 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:40.311137 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f135294-b207-42da-b8d5-e49625c5f7e1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:40.311560 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f135294-b207-42da-b8d5-e49625c5f7e1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:40.312018 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f135294-b207-42da-b8d5-e49625c5f7e1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:40.312436 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f135294-b207-42da-b8d5-e49625c5f7e1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:31:40.316463 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5f135294-b207-42da-b8d5-e49625c5f7e1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:40.317717 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-5f135294-b207-42da-b8d5-e49625c5f7e1 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/1c4a3ee4-829d-4882-b310-ea99a8088d66 HTTP/1.1" status: 204  len: 168 time: 0.3597031
Jun 03 08:31:40.318895 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-5f135294-b207-42da-b8d5-e49625c5f7e1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:40.341885 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19822d53-a271-48b3-919e-c8e57754cf7f req-39ffeb95-d604-49d4-a98a-7a6aad373d5c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:40.343420 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-19822d53-a271-48b3-919e-c8e57754cf7f req-39ffeb95-d604-49d4-a98a-7a6aad373d5c service neutron] 10.222.0.55 "GET /v2.0/subnets?id=5baf74c9-e686-40a5-b52f-f01da3bd1af9 HTTP/1.1" status: 200  len: 850 time: 0.1140990
Jun 03 08:31:40.374031 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-a78c4966-0ccc-4258-a3e6-cdc4750fc0b7 None None] Set router a4b01ad1-d952-4deb-88df-6930ad4824db gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:31:40.469224 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19822d53-a271-48b3-919e-c8e57754cf7f req-a1942fba-ed0a-428c-a96f-be31ecdb2e0c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:40.473262 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-19822d53-a271-48b3-919e-c8e57754cf7f req-a1942fba-ed0a-428c-a96f-be31ecdb2e0c service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=020eaa43-2d59-46e1-8aec-0a688069f72b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1197922
Jun 03 08:31:40.473262 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1bffc234-6153-4a43-9ea3-18f8e964636f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:40.479361 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:40.601282 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1bffc234-6153-4a43-9ea3-18f8e964636f admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:40.621138 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-1bffc234-6153-4a43-9ea3-18f8e964636f admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/d671e1dd-65da-40ed-aa32-61ca422885d5 HTTP/1.1" status: 204  len: 168 time: 0.6527250
Jun 03 08:31:40.622297 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bffc234-6153-4a43-9ea3-18f8e964636f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d671e1dd-65da-40ed-aa32-61ca422885d5,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:40.632067 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-1bffc234-6153-4a43-9ea3-18f8e964636f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:40.850778 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-19822d53-a271-48b3-919e-c8e57754cf7f req-a2fe9895-817a-4627-970d-56028c2a9f14 service neutron] 10.222.0.55 "GET /v2.0/networks/020eaa43-2d59-46e1-8aec-0a688069f72b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3636036
Jun 03 08:31:40.905011 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-a78c4966-0ccc-4258-a3e6-cdc4750fc0b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86ac8460>, [{'id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'name': 'tempest-AttachVolumeTestJSON-1767133114-router', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241'}], 'enable_snat': True}, 'gw_port_id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:38Z', 'updated_at': '2021-06-03T08:30:51Z', 'revision_number': 4, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'gw_port': {'id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:65:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': '6175662d-b2ef-45f8-ada4-07ee4d1d828f', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'floating_ip_address': '172.27.0.237', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'port_id': '19f733be-bd85-43df-86fd-5a9c617b3df4', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 106, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'mac_address': 'fa:16:3e:ec:bc:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86bd903e-c2b5-4452-bc75-39a347cba9db', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:31:07Z', 'updated_at': '2021-06-03T08:31:38Z', 'revision_number': 1, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '09aff824-d423-4557-8913-463e6f53d3e5', 'name': '', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'mac_address': 'fa:16:3e:c4:92:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_interface', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:47Z', 'updated_at': '2021-06-03T08:31:05Z', 'revision_number': 5, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'subnets': [{'id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:31:40.908973 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a78c4966-0ccc-4258-a3e6-cdc4750fc0b7 None None] The sync data for ids ['a4b01ad1-d952-4deb-88df-6930ad4824db'] in dv-cinder-787262-5-iscsi is: [{'id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'name': 'tempest-AttachVolumeTestJSON-1767133114-router', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241'}], 'enable_snat': True}, 'gw_port_id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:38Z', 'updated_at': '2021-06-03T08:30:51Z', 'revision_number': 4, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'gw_port': {'id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:65:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': '6175662d-b2ef-45f8-ada4-07ee4d1d828f', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'floating_ip_address': '172.27.0.237', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'port_id': '19f733be-bd85-43df-86fd-5a9c617b3df4', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 106, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'mac_address': 'fa:16:3e:ec:bc:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86bd903e-c2b5-4452-bc75-39a347cba9db', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:31:07Z', 'updated_at': '2021-06-03T08:31:38Z', 'revision_number': 1, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '09aff824-d423-4557-8913-463e6f53d3e5', 'name': '', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'mac_address': 'fa:16:3e:c4:92:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_interface', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:47Z', 'updated_at': '2021-06-03T08:31:05Z', 'revision_number': 5, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'subnets': [{'id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:31:41.002118 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-19822d53-a271-48b3-919e-c8e57754cf7f req-241ab0ea-031f-4be6-b78a-28368b3a5858 service neutron] 10.222.0.55 "GET /v2.0/networks/020eaa43-2d59-46e1-8aec-0a688069f72b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1401052
Jun 03 08:31:41.207668 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf16f8e0-14c5-4e80-9710-37e5a1acb16e None None] New status for floating IP 6175662d-b2ef-45f8-ada4-07ee4d1d828f: ACTIVE {{(pid=92325) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 03 08:31:41.446128 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 47454) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:41.828789 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 47464) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:41.846715 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cc3786bf-1ee6-4e6c-b462-5dddf10867e5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:41.861853 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-cc3786bf-1ee6-4e6c-b462-5dddf10867e5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:41.865826 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-cc3786bf-1ee6-4e6c-b462-5dddf10867e5 admin admin] Usage tracker for resource:security_group_rule and tenant:d01a1a24aea94028bbaf2108bb542944 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:41.869390 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-cc3786bf-1ee6-4e6c-b462-5dddf10867e5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:41.875656 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-cc3786bf-1ee6-4e6c-b462-5dddf10867e5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:41.970139 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cc3786bf-1ee6-4e6c-b462-5dddf10867e5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:42.021651 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7ea1115f-db64-4ef1-a149-ff47a5c67d9e admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:42.036080 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 47470) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:42.046190 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-7ea1115f-db64-4ef1-a149-ff47a5c67d9e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:42.056269 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-7ea1115f-db64-4ef1-a149-ff47a5c67d9e admin admin] Usage tracker for resource:security_group_rule and tenant:83408b866e8e471da359b75375222dd3 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:42.060528 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-7ea1115f-db64-4ef1-a149-ff47a5c67d9e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:42.060728 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ce2cbe01-f9b6-41e5-b20d-39953ebb851e admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:42.067753 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-7ea1115f-db64-4ef1-a149-ff47a5c67d9e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:42.083382 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-ce2cbe01-f9b6-41e5-b20d-39953ebb851e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:42.087849 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cc3786bf-1ee6-4e6c-b462-5dddf10867e5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:42.090698 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-ce2cbe01-f9b6-41e5-b20d-39953ebb851e admin admin] Usage tracker for resource:security_group_rule and tenant:f3e18394034f444c8c0edccf0c3b3586 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:42.112121 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-ce2cbe01-f9b6-41e5-b20d-39953ebb851e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:42.115507 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-8a8b9b34-3bf5-445c-a016-0301547f3c72 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:42.160300 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-ce2cbe01-f9b6-41e5-b20d-39953ebb851e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:42.204357 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc3786bf-1ee6-4e6c-b462-5dddf10867e5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b5d083b0-ec0b-4233-8482-d84da7df2e8c,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:42.213882 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-cc3786bf-1ee6-4e6c-b462-5dddf10867e5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:42.218786 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-cc3786bf-1ee6-4e6c-b462-5dddf10867e5 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=d01a1a24aea94028bbaf2108bb542944&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3878121
Jun 03 08:31:42.220334 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 47472) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:42.230524 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7ea1115f-db64-4ef1-a149-ff47a5c67d9e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:42.311558 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2058eb9-09af-468a-88ce-6fce49698dea req-bfe00dfe-8a09-4f03-b8a3-31bd75bcd234 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:42.318971 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c2058eb9-09af-468a-88ce-6fce49698dea req-bfe00dfe-8a09-4f03-b8a3-31bd75bcd234 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 945 time: 0.1708460
Jun 03 08:31:42.344290 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9c79000e-d684-45fc-b252-0ec28a39e7ca admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:42.362660 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7ea1115f-db64-4ef1-a149-ff47a5c67d9e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:42.379411 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:42.419802 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c2058eb9-09af-468a-88ce-6fce49698dea req-b6238bca-46ad-4e39-9e09-438ccad54e94 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/security-groups?id=12cbc694-d459-4366-b758-44d0f16106cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0998635
Jun 03 08:31:42.426932 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9c79000e-d684-45fc-b252-0ec28a39e7ca admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:42.428810 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-7ea1115f-db64-4ef1-a149-ff47a5c67d9e admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=83408b866e8e471da359b75375222dd3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9814498
Jun 03 08:31:42.429758 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ea1115f-db64-4ef1-a149-ff47a5c67d9e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=21bc4625-d506-4ad1-ad47-9af5d91111e0,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:42.438629 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 47476) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:42.452721 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-7ea1115f-db64-4ef1-a149-ff47a5c67d9e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:42.564325 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-72df29fc-25cc-4447-a7ec-3d9fde145373 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:42.589221 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ce2cbe01-f9b6-41e5-b20d-39953ebb851e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:42.606381 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-72df29fc-25cc-4447-a7ec-3d9fde145373 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:42.688047 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9c79000e-d684-45fc-b252-0ec28a39e7ca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:42.691976 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-57c92425-7e34-44ba-8606-4a73bb57ae2a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:42.706691 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c79000e-d684-45fc-b252-0ec28a39e7ca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b5d083b0-ec0b-4233-8482-d84da7df2e8c,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:42.710144 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9c79000e-d684-45fc-b252-0ec28a39e7ca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:42.720666 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9c79000e-d684-45fc-b252-0ec28a39e7ca admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:42.721784 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-9c79000e-d684-45fc-b252-0ec28a39e7ca admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/b5d083b0-ec0b-4233-8482-d84da7df2e8c HTTP/1.1" status: 204  len: 168 time: 0.5004287
Jun 03 08:31:42.766700 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ce2cbe01-f9b6-41e5-b20d-39953ebb851e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:42.776714 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:42.817837 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-ce2cbe01-f9b6-41e5-b20d-39953ebb851e admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=f3e18394034f444c8c0edccf0c3b3586&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7805655
Jun 03 08:31:42.824202 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce2cbe01-f9b6-41e5-b20d-39953ebb851e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=448476b9-81fe-483e-88d9-402c4e42d88b,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:42.824392 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 47484) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:42.824512 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-ce2cbe01-f9b6-41e5-b20d-39953ebb851e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:42.847913 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-72df29fc-25cc-4447-a7ec-3d9fde145373 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:42.851782 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-72df29fc-25cc-4447-a7ec-3d9fde145373 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:42.851782 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-72df29fc-25cc-4447-a7ec-3d9fde145373 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/21bc4625-d506-4ad1-ad47-9af5d91111e0 HTTP/1.1" status: 204  len: 168 time: 0.4118888
Jun 03 08:31:42.852424 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-5f135294-b207-42da-b8d5-e49625c5f7e1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:42.862567 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72df29fc-25cc-4447-a7ec-3d9fde145373 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=21bc4625-d506-4ad1-ad47-9af5d91111e0,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:42.864884 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-72df29fc-25cc-4447-a7ec-3d9fde145373 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.012s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:42.883143 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9adafe2e-ed4a-491d-aa96-1c500def63d1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:42.911230 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9adafe2e-ed4a-491d-aa96-1c500def63d1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:43.013660 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9adafe2e-ed4a-491d-aa96-1c500def63d1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:43.018801 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:43.035528 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9adafe2e-ed4a-491d-aa96-1c500def63d1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=448476b9-81fe-483e-88d9-402c4e42d88b,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:43.037170 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-9adafe2e-ed4a-491d-aa96-1c500def63d1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:43.045672 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9adafe2e-ed4a-491d-aa96-1c500def63d1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:43.049139 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-9adafe2e-ed4a-491d-aa96-1c500def63d1 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/448476b9-81fe-483e-88d9-402c4e42d88b HTTP/1.1" status: 204  len: 168 time: 0.2237725
Jun 03 08:31:43.589419 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 47506) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:43.613319 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b6d3b5fe-d40e-42bc-9d5f-6898af3643cc admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:43.642884 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-b6d3b5fe-d40e-42bc-9d5f-6898af3643cc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:43.645693 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-b6d3b5fe-d40e-42bc-9d5f-6898af3643cc admin admin] Usage tracker for resource:security_group_rule and tenant:96cc0b67485344a5b254abede3443208 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:43.649606 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-b6d3b5fe-d40e-42bc-9d5f-6898af3643cc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:43.657251 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-b6d3b5fe-d40e-42bc-9d5f-6898af3643cc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:43.669041 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8caf637-15d5-4b67-b413-7afc9ff1d477 req-bc95c9a5-fa98-41e5-af83-7d78079174cd tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:43.670749 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e8caf637-15d5-4b67-b413-7afc9ff1d477 req-bc95c9a5-fa98-41e5-af83-7d78079174cd tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 945 time: 0.1399822
Jun 03 08:31:43.752776 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e8caf637-15d5-4b67-b413-7afc9ff1d477 req-88493fc1-8592-4ab9-87b7-27b30f230667 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/security-groups?id=12cbc694-d459-4366-b758-44d0f16106cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0746198
Jun 03 08:31:43.827159 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b6d3b5fe-d40e-42bc-9d5f-6898af3643cc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:43.899678 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b6d3b5fe-d40e-42bc-9d5f-6898af3643cc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:43.910136 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-1bffc234-6153-4a43-9ea3-18f8e964636f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:43.949503 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-b6d3b5fe-d40e-42bc-9d5f-6898af3643cc admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=96cc0b67485344a5b254abede3443208&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3586957
Jun 03 08:31:43.951125 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6d3b5fe-d40e-42bc-9d5f-6898af3643cc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b2275064-8212-4c32-9ad1-798d35f35b51,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:43.952153 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 47522) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:43.954201 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b6d3b5fe-d40e-42bc-9d5f-6898af3643cc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:44.015324 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e1987a09-1150-4f40-bf4d-c116444e9b6c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:44.044041 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e1987a09-1150-4f40-bf4d-c116444e9b6c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:44.213773 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e1987a09-1150-4f40-bf4d-c116444e9b6c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:44.220140 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:44.237765 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1987a09-1150-4f40-bf4d-c116444e9b6c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b2275064-8212-4c32-9ad1-798d35f35b51,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:44.237765 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e1987a09-1150-4f40-bf4d-c116444e9b6c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:44.242386 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e1987a09-1150-4f40-bf4d-c116444e9b6c admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:44.245468 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-e1987a09-1150-4f40-bf4d-c116444e9b6c admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/b2275064-8212-4c32-9ad1-798d35f35b51 HTTP/1.1" status: 204  len: 168 time: 0.2906301
Jun 03 08:31:44.902311 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 47556) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:44.919806 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-fe5df181-e380-493d-97d0-ccec4f077b21 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:44.937149 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-fe5df181-e380-493d-97d0-ccec4f077b21 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:44.941644 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-fe5df181-e380-493d-97d0-ccec4f077b21 admin admin] Usage tracker for resource:security_group_rule and tenant:3552dec4a7d5478dbfc9737108298277 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:44.946707 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-fe5df181-e380-493d-97d0-ccec4f077b21 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:44.953129 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-fe5df181-e380-493d-97d0-ccec4f077b21 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:45.046544 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-fe5df181-e380-493d-97d0-ccec4f077b21 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:45.109476 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-fe5df181-e380-493d-97d0-ccec4f077b21 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:45.117399 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:45.158268 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-fe5df181-e380-493d-97d0-ccec4f077b21 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=3552dec4a7d5478dbfc9737108298277&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2546926
Jun 03 08:31:45.158999 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe5df181-e380-493d-97d0-ccec4f077b21 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=db2452b2-7d20-41e8-b29a-f484863d577e,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:45.160804 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 47562) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:45.162017 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-fe5df181-e380-493d-97d0-ccec4f077b21 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:45.223622 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cab5cae3-9311-419e-b180-ea7d72b8af6a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:45.251220 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cab5cae3-9311-419e-b180-ea7d72b8af6a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:45.379199 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cab5cae3-9311-419e-b180-ea7d72b8af6a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:45.382921 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:45.396056 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cab5cae3-9311-419e-b180-ea7d72b8af6a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=db2452b2-7d20-41e8-b29a-f484863d577e,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:45.399510 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-cab5cae3-9311-419e-b180-ea7d72b8af6a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:45.403299 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cab5cae3-9311-419e-b180-ea7d72b8af6a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:45.404424 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-cab5cae3-9311-419e-b180-ea7d72b8af6a admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/db2452b2-7d20-41e8-b29a-f484863d577e HTTP/1.1" status: 204  len: 168 time: 0.2415154
Jun 03 08:31:46.237447 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc8c73c-facd-4bf6-93b7-231277694055 req-abc3a8c9-483e-4c54-83aa-af9049c1cc28 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:46.238959 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-edc8c73c-facd-4bf6-93b7-231277694055 req-abc3a8c9-483e-4c54-83aa-af9049c1cc28 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 945 time: 0.0941222
Jun 03 08:31:46.286735 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-edc8c73c-facd-4bf6-93b7-231277694055 req-783eca67-0bfe-468d-bdaa-c5e8cd83d92f tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/security-groups?id=12cbc694-d459-4366-b758-44d0f16106cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413084
Jun 03 08:31:46.775197 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 47640) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:47.179078 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8e37ccbd-c86e-46c2-9791-cb04ccfe98be admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:47.196803 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-8e37ccbd-c86e-46c2-9791-cb04ccfe98be admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:47.200851 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-8e37ccbd-c86e-46c2-9791-cb04ccfe98be admin admin] Usage tracker for resource:security_group_rule and tenant:692670be131e49ed9765033c84ff4add is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:47.203759 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-8e37ccbd-c86e-46c2-9791-cb04ccfe98be admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:47.209977 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-8e37ccbd-c86e-46c2-9791-cb04ccfe98be admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:47.305062 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8e37ccbd-c86e-46c2-9791-cb04ccfe98be admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:47.318027 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a7331a0-d8dd-44b8-804e-9de597077806 req-8df0a43e-dc6f-4ef9-840e-e002f2a4c30b tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:47.319591 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8a7331a0-d8dd-44b8-804e-9de597077806 req-8df0a43e-dc6f-4ef9-840e-e002f2a4c30b tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.55 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 945 time: 0.0902057
Jun 03 08:31:47.379282 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8e37ccbd-c86e-46c2-9791-cb04ccfe98be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:47.388633 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9c79000e-d684-45fc-b252-0ec28a39e7ca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:47.420343 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e37ccbd-c86e-46c2-9791-cb04ccfe98be admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4036e478-f9c8-4159-90ec-c77a939a126d,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:47.426533 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-8e37ccbd-c86e-46c2-9791-cb04ccfe98be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:47.500046 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-8a7331a0-d8dd-44b8-804e-9de597077806 req-33d9baea-6833-46f1-93d1-ff08ed87b7b4 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Deleting port 764aa3d0-d145-4744-9cb1-e9bdd5654748 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:31:47.500724 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-8a7331a0-d8dd-44b8-804e-9de597077806 req-33d9baea-6833-46f1-93d1-ff08ed87b7b4 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:47.501268 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-8e37ccbd-c86e-46c2-9791-cb04ccfe98be admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=692670be131e49ed9765033c84ff4add&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7268453
Jun 03 08:31:47.512165 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 47676) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:47.625570 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-729c07f7-8df2-4eb4-84fa-503ace08b7fc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:47.656191 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-729c07f7-8df2-4eb4-84fa-503ace08b7fc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:47.673928 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da6959c-cd48-4d60-bc0a-ac1707b268b0 req-1984c161-606c-468e-a156-e74c817b2929 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:47.675743 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-4da6959c-cd48-4d60-bc0a-ac1707b268b0 req-1984c161-606c-468e-a156-e74c817b2929 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 945 time: 0.2480152
Jun 03 08:31:47.693707 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-8a7331a0-d8dd-44b8-804e-9de597077806 req-33d9baea-6833-46f1-93d1-ff08ed87b7b4 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] For port 764aa3d0-d145-4744-9cb1-e9bdd5654748, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=764aa3d0-d145-4744-9cb1-e9bdd5654748,segment=NetworkSegment(5a5b66b5-9e55-4a2d-87ec-5d31f3999401),segment_id=5a5b66b5-9e55-4a2d-87ec-5d31f3999401)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:31:47.694165 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-8a7331a0-d8dd-44b8-804e-9de597077806 req-33d9baea-6833-46f1-93d1-ff08ed87b7b4 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:47.746343 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 47686) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:47.762962 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-4da6959c-cd48-4d60-bc0a-ac1707b268b0 req-5dc1f935-df80-48a1-8b1c-4e9f19ebab74 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/security-groups?id=12cbc694-d459-4366-b758-44d0f16106cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0767798
Jun 03 08:31:47.834528 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-8a7331a0-d8dd-44b8-804e-9de597077806 req-33d9baea-6833-46f1-93d1-ff08ed87b7b4 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Calling delete_port for 764aa3d0-d145-4744-9cb1-e9bdd5654748 owned by compute:nova {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:31:47.877800 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9eee7d41-2650-43c0-837a-ef2169256ce3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:47.892442 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-729c07f7-8df2-4eb4-84fa-503ace08b7fc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:47.904439 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:47.917329 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-9eee7d41-2650-43c0-837a-ef2169256ce3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:47.919973 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-729c07f7-8df2-4eb4-84fa-503ace08b7fc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4036e478-f9c8-4159-90ec-c77a939a126d,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:47.924779 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-729c07f7-8df2-4eb4-84fa-503ace08b7fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:47.926923 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-9eee7d41-2650-43c0-837a-ef2169256ce3 admin admin] Usage tracker for resource:security_group_rule and tenant:43359dccaf2e4003a07e969eef5e6104 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:47.930407 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-9eee7d41-2650-43c0-837a-ef2169256ce3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:47.934109 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-729c07f7-8df2-4eb4-84fa-503ace08b7fc admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:47.935529 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-729c07f7-8df2-4eb4-84fa-503ace08b7fc admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/4036e478-f9c8-4159-90ec-c77a939a126d HTTP/1.1" status: 204  len: 168 time: 0.4141517
Jun 03 08:31:47.939570 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-9eee7d41-2650-43c0-837a-ef2169256ce3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:48.045315 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9eee7d41-2650-43c0-837a-ef2169256ce3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:48.202717 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-8a7331a0-d8dd-44b8-804e-9de597077806 req-33d9baea-6833-46f1-93d1-ff08ed87b7b4 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:48.203720 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9eee7d41-2650-43c0-837a-ef2169256ce3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:48.212802 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:48.216084 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['764aa3d0-d145-4744-9cb1-e9bdd5654748'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:31:48.217544 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-cc3786bf-1ee6-4e6c-b462-5dddf10867e5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:48.340987 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33d9baea-6833-46f1-93d1-ff08ed87b7b4 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Pushing event deleted for resources: {'Port': ['ID=764aa3d0-d145-4744-9cb1-e9bdd5654748,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:48.345466 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-9eee7d41-2650-43c0-837a-ef2169256ce3 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=43359dccaf2e4003a07e969eef5e6104&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5980103
Jun 03 08:31:48.346277 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 47708) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:48.346987 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9eee7d41-2650-43c0-837a-ef2169256ce3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=04c5ef8f-cae9-47ef-b4f1-bf393ecd3b49,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:48.347961 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-33d9baea-6833-46f1-93d1-ff08ed87b7b4 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:48.399343 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9eee7d41-2650-43c0-837a-ef2169256ce3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:48.438404 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-8a7331a0-d8dd-44b8-804e-9de597077806 req-33d9baea-6833-46f1-93d1-ff08ed87b7b4 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] No DVR routers for this DVR port 764aa3d0-d145-4744-9cb1-e9bdd5654748 on host hv-cinder-78726 {{(pid=92323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:31:48.448987 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-8a7331a0-d8dd-44b8-804e-9de597077806 req-33d9baea-6833-46f1-93d1-ff08ed87b7b4 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:48.455835 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'de45acc4-ab6b-4eea-9e74-150c5641eb59', 'name': 'network-vif-deleted', 'tag': '764aa3d0-d145-4744-9cb1-e9bdd5654748'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:31:48.460648 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f6a4e68b-18d8-4ea5-8f2e-8108b4b1dc6d" -d '{"events": [{"server_uuid": "de45acc4-ab6b-4eea-9e74-150c5641eb59", "name": "network-vif-deleted", "tag": "764aa3d0-d145-4744-9cb1-e9bdd5654748"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:31:48.477362 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cc223374-fd33-464d-83c2-d3cb6fa06cfc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:48.507454 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cc223374-fd33-464d-83c2-d3cb6fa06cfc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:48.563087 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:31:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-29ac62ee-2f5a-4348-b148-00c0d7271d0b x-openstack-request-id: req-29ac62ee-2f5a-4348-b148-00c0d7271d0b {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:31:48.563637 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "de45acc4-ab6b-4eea-9e74-150c5641eb59", "name": "network-vif-deleted", "tag": "764aa3d0-d145-4744-9cb1-e9bdd5654748", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:31:48.564164 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-29ac62ee-2f5a-4348-b148-00c0d7271d0b {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:31:48.564724 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'de45acc4-ab6b-4eea-9e74-150c5641eb59', 'name': 'network-vif-deleted', 'tag': '764aa3d0-d145-4744-9cb1-e9bdd5654748', 'status': 'completed', 'code': 200}
Jun 03 08:31:48.620157 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8a7331a0-d8dd-44b8-804e-9de597077806 req-33d9baea-6833-46f1-93d1-ff08ed87b7b4 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.55 "DELETE /v2.0/ports/764aa3d0-d145-4744-9cb1-e9bdd5654748 HTTP/1.1" status: 204  len: 173 time: 1.2910800
Jun 03 08:31:48.682566 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cc223374-fd33-464d-83c2-d3cb6fa06cfc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:48.689141 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f1971619-2fa9-4cd6-8fc6-8a328e2c6d1e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:48.700934 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc223374-fd33-464d-83c2-d3cb6fa06cfc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=04c5ef8f-cae9-47ef-b4f1-bf393ecd3b49,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:48.704043 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-cc223374-fd33-464d-83c2-d3cb6fa06cfc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:48.717292 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cc223374-fd33-464d-83c2-d3cb6fa06cfc admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:48.730263 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-cc223374-fd33-464d-83c2-d3cb6fa06cfc admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/04c5ef8f-cae9-47ef-b4f1-bf393ecd3b49 HTTP/1.1" status: 204  len: 168 time: 0.3688200
Jun 03 08:31:48.978917 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-d434989b-79c8-46c8-9071-40b3bf7925ed req-28efd8ba-1fe1-4e54-b865-92476f6de65e tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Synchronizing usage tracker for tenant:52d59e3293254fcc85972c62e654f494 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:31:49.154761 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-d434989b-79c8-46c8-9071-40b3bf7925ed req-28efd8ba-1fe1-4e54-b865-92476f6de65e tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Unset dirty status for tenant:52d59e3293254fcc85972c62e654f494 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:31:49.159478 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d434989b-79c8-46c8-9071-40b3bf7925ed req-28efd8ba-1fe1-4e54-b865-92476f6de65e tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 210 time: 0.2854369
Jun 03 08:31:49.222792 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 47744) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:49.239676 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-992275c7-34ec-468a-988d-52ce0bc09734 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:49.255166 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-992275c7-34ec-468a-988d-52ce0bc09734 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:49.259890 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-992275c7-34ec-468a-988d-52ce0bc09734 admin admin] Usage tracker for resource:security_group_rule and tenant:4ee04cc2148249e59132d6ecd934c2cd is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:49.262863 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-992275c7-34ec-468a-988d-52ce0bc09734 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:49.269052 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-992275c7-34ec-468a-988d-52ce0bc09734 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:49.356482 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-992275c7-34ec-468a-988d-52ce0bc09734 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:49.431273 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-992275c7-34ec-468a-988d-52ce0bc09734 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:49.441934 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:49.491095 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-992275c7-34ec-468a-988d-52ce0bc09734 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=4ee04cc2148249e59132d6ecd934c2cd&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2670512
Jun 03 08:31:49.491885 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-992275c7-34ec-468a-988d-52ce0bc09734 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=934dcf75-996c-4c7a-9f1b-0b8a4c2d50a6,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:49.494631 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 47752) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:49.497545 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-992275c7-34ec-468a-988d-52ce0bc09734 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:49.597623 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-6b5a0cbf-c1e7-4563-b186-38a0899fde70 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:49.635452 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-6b5a0cbf-c1e7-4563-b186-38a0899fde70 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:49.794657 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 47754) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:49.812604 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-34503ebd-428b-4a9f-b0d2-64bb50685072 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:49.828372 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-6b5a0cbf-c1e7-4563-b186-38a0899fde70 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:49.833104 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:49.842241 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-34503ebd-428b-4a9f-b0d2-64bb50685072 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:49.847468 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b5a0cbf-c1e7-4563-b186-38a0899fde70 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=934dcf75-996c-4c7a-9f1b-0b8a4c2d50a6,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:49.850861 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-6b5a0cbf-c1e7-4563-b186-38a0899fde70 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:49.851811 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-34503ebd-428b-4a9f-b0d2-64bb50685072 admin admin] Usage tracker for resource:security_group_rule and tenant:88abbaa334334411874740546bc73e76 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:49.855809 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-34503ebd-428b-4a9f-b0d2-64bb50685072 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:49.862293 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-34503ebd-428b-4a9f-b0d2-64bb50685072 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:49.864525 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-6b5a0cbf-c1e7-4563-b186-38a0899fde70 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:49.865692 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-6b5a0cbf-c1e7-4563-b186-38a0899fde70 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/934dcf75-996c-4c7a-9f1b-0b8a4c2d50a6 HTTP/1.1" status: 204  len: 168 time: 0.3694384
Jun 03 08:31:49.962122 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-34503ebd-428b-4a9f-b0d2-64bb50685072 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:50.035129 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-34503ebd-428b-4a9f-b0d2-64bb50685072 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:50.045332 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-fe5df181-e380-493d-97d0-ccec4f077b21 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:50.089285 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-34503ebd-428b-4a9f-b0d2-64bb50685072 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=88abbaa334334411874740546bc73e76&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2934573
Jun 03 08:31:50.090469 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34503ebd-428b-4a9f-b0d2-64bb50685072 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=38eeaa6a-967e-4be2-8c94-a6f0217b1813,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:50.093297 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 47762) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:50.108106 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-34503ebd-428b-4a9f-b0d2-64bb50685072 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:50.194425 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-94c8f7b0-9d2d-44ab-93e5-cc6946db1470 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:50.225300 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-94c8f7b0-9d2d-44ab-93e5-cc6946db1470 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:50.384940 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-58a52aff-9db4-4610-a49f-c3163e36a015 req-9a6d294f-7ab8-43da-b8e6-52798b02601f tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] 10.222.0.11 "GET /v2.0/ports?device_id=de45acc4-ab6b-4eea-9e74-150c5641eb59 HTTP/1.1" status: 200  len: 210 time: 0.0559776
Jun 03 08:31:50.460221 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-94c8f7b0-9d2d-44ab-93e5-cc6946db1470 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:50.470169 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:50.499451 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94c8f7b0-9d2d-44ab-93e5-cc6946db1470 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=38eeaa6a-967e-4be2-8c94-a6f0217b1813,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:50.502654 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-94c8f7b0-9d2d-44ab-93e5-cc6946db1470 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:50.511091 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-94c8f7b0-9d2d-44ab-93e5-cc6946db1470 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:50.515900 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-94c8f7b0-9d2d-44ab-93e5-cc6946db1470 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/38eeaa6a-967e-4be2-8c94-a6f0217b1813 HTTP/1.1" status: 204  len: 168 time: 0.4214258
Jun 03 08:31:50.533313 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e129ec2d-31dc-4a89-b487-421996f67809 req-a48a6113-cfeb-4b71-83db-5bc096b8cda0 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:50.534428 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e129ec2d-31dc-4a89-b487-421996f67809 req-a48a6113-cfeb-4b71-83db-5bc096b8cda0 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/networks?id=f9db9a2a-942b-4a98-97ed-1896cb9158b4 HTTP/1.1" status: 200  len: 815 time: 0.2483630
Jun 03 08:31:50.550936 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e129ec2d-31dc-4a89-b487-421996f67809 req-d3c1774f-4d85-4c6a-ba34-9f6ac9839580 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/quotas/7bac6d994f4d49b292bc39fac07c0311 HTTP/1.1" status: 200  len: 375 time: 0.0100210
Jun 03 08:31:50.685028 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e129ec2d-31dc-4a89-b487-421996f67809 req-18f3a799-0333-4d24-8d10-019fe60cd17e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=7bac6d994f4d49b292bc39fac07c0311&fields=id HTTP/1.1" status: 200  len: 255 time: 0.1269155
Jun 03 08:31:50.852195 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e129ec2d-31dc-4a89-b487-421996f67809 req-45ba5f1d-da21-476a-aba9-35beac9745ee service neutron] 10.222.0.11 "GET /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1570320
Jun 03 08:31:50.995165 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e129ec2d-31dc-4a89-b487-421996f67809 req-34bfbe78-23b0-4d7c-b2a7-197f88955fb9 service neutron] 10.222.0.11 "GET /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1420262
Jun 03 08:31:51.171707 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 764aa3d0-d145-4744-9cb1-e9bdd5654748 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:31:51.212730 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] No Port match for: 764aa3d0-d145-4744-9cb1-e9bdd5654748 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:31:51.213243 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 764aa3d0-d145-4744-9cb1-e9bdd5654748 not bound to the agent host hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:31:51.332448 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-58b08e0a-89f4-4ff3-a82e-a83df3b8080f req-d42f6344-7655-4013-92bc-be97f05a1edd tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=1b72c068-99c2-4781-ad52-9c9c159b37ec HTTP/1.1" status: 200  len: 210 time: 0.0501626
Jun 03 08:31:52.303322 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8e5062b8-0430-4843-9470-0e316ff9e20b req-4a1211fd-f9fd-44b1-b5e7-c4bb6aab2e07 service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1061027
Jun 03 08:31:52.533614 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4d455253-6508-4117-b5fa-5d2ebdc30cef req-3d2fb2b0-4def-425c-96c8-f1a93af1ad98 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=1b72c068-99c2-4781-ad52-9c9c159b37ec HTTP/1.1" status: 200  len: 210 time: 0.0522983
Jun 03 08:31:52.552784 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e5062b8-0430-4843-9470-0e316ff9e20b req-5c8a0977-b40d-4740-a105-eedab6f03e02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:52.555486 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8e5062b8-0430-4843-9470-0e316ff9e20b req-5c8a0977-b40d-4740-a105-eedab6f03e02 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=7bac6d994f4d49b292bc39fac07c0311&device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 1099 time: 0.1685340
Jun 03 08:31:52.716826 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e5062b8-0430-4843-9470-0e316ff9e20b req-b3d8bf3a-1725-4d16-962a-0040a7ae039b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:52.718330 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8e5062b8-0430-4843-9470-0e316ff9e20b req-b3d8bf3a-1725-4d16-962a-0040a7ae039b service neutron] 10.222.0.55 "GET /v2.0/networks?id=f9db9a2a-942b-4a98-97ed-1896cb9158b4 HTTP/1.1" status: 200  len: 916 time: 0.1388214
Jun 03 08:31:52.796240 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8e5062b8-0430-4843-9470-0e316ff9e20b req-0c4828af-85d2-4dcd-9b34-992184e735f3 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=24826ba2-ee17-4774-b5ca-2cd1675f325a HTTP/1.1" status: 200  len: 217 time: 0.0646193
Jun 03 08:31:52.862987 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e5062b8-0430-4843-9470-0e316ff9e20b req-0d19b4e5-bdba-4b99-b1b3-5c451cb349fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:52.864442 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8e5062b8-0430-4843-9470-0e316ff9e20b req-0d19b4e5-bdba-4b99-b1b3-5c451cb349fc service neutron] 10.222.0.55 "GET /v2.0/subnets?id=5f3b55e2-964f-4ce8-9d71-3ac11dc6ebf1 HTTP/1.1" status: 200  len: 855 time: 0.0659676
Jun 03 08:31:52.914045 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8e5062b8-0430-4843-9470-0e316ff9e20b req-dc062dcd-b0df-4251-941f-406e4f4f31af service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=f9db9a2a-942b-4a98-97ed-1896cb9158b4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0412509
Jun 03 08:31:53.129032 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8e5062b8-0430-4843-9470-0e316ff9e20b req-37b84274-e512-49ab-b2ac-66f14806640c service neutron] 10.222.0.55 "GET /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2049828
Jun 03 08:31:53.309723 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8e5062b8-0430-4843-9470-0e316ff9e20b req-e826273d-65f8-4599-8a6a-f4505c092051 service neutron] 10.222.0.55 "GET /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1627545
Jun 03 08:31:53.428173 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 47940) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:53.552351 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 47946) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:53.626766 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1e71a782-4276-4bee-80e7-0fb8fec0f292 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:53.652150 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-1e71a782-4276-4bee-80e7-0fb8fec0f292 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:53.660460 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_v2 [None req-5755aaff-bd55-46ef-a558-24a691beb528 admin admin] Deleting subnet 3c41763f-e17d-4df7-96ea-31656322a752 {{(pid=92323) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 03 08:31:53.662883 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-1e71a782-4276-4bee-80e7-0fb8fec0f292 admin admin] Usage tracker for resource:security_group_rule and tenant:5c6c90406c234751ba5edafcbc0600c1 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:53.668147 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-1e71a782-4276-4bee-80e7-0fb8fec0f292 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:53.671489 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-5755aaff-bd55-46ef-a558-24a691beb528 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:53.707810 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-1e71a782-4276-4bee-80e7-0fb8fec0f292 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:53.720712 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-552f87da-777d-4fdb-a0d1-0cd30310cb02 req-891ba581-8543-4c97-9b30-52051e0e8ce5 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=1b72c068-99c2-4781-ad52-9c9c159b37ec HTTP/1.1" status: 200  len: 210 time: 0.0491438
Jun 03 08:31:53.739844 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-5755aaff-bd55-46ef-a558-24a691beb528 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:53.763584 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-5755aaff-bd55-46ef-a558-24a691beb528 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-862421'] for subnet, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:54.023785 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1e71a782-4276-4bee-80e7-0fb8fec0f292 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:54.235410 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1e71a782-4276-4bee-80e7-0fb8fec0f292 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:54.342439 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-11660423-86df-46f7-b982-b007560a4bf5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:54.477471 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-1e71a782-4276-4bee-80e7-0fb8fec0f292 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=5c6c90406c234751ba5edafcbc0600c1&name=default HTTP/1.1" status: 200  len: 2979 time: 1.0480216
Jun 03 08:31:54.485772 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 47972) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:54.532763 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e71a782-4276-4bee-80e7-0fb8fec0f292 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88a5820a-737e-49a6-80dd-d3ca4548f453,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:54.540594 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-1e71a782-4276-4bee-80e7-0fb8fec0f292 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.200s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:54.566401 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-80ab399a-c71c-4238-8324-8774c963dc12 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:54.594775 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e129ec2d-31dc-4a89-b487-421996f67809 req-20ad4e6b-3d3f-4aef-acba-e407e96d1ed1 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:54.595974 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-80ab399a-c71c-4238-8324-8774c963dc12 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:54.596103 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e129ec2d-31dc-4a89-b487-421996f67809 req-20ad4e6b-3d3f-4aef-acba-e407e96d1ed1 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.55 "GET /v2.0/networks?id=f9db9a2a-942b-4a98-97ed-1896cb9158b4 HTTP/1.1" status: 200  len: 815 time: 0.2233994
Jun 03 08:31:54.597528 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-5755aaff-bd55-46ef-a558-24a691beb528 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-862434', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829'] for subnet, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:54.603196 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-db11737a-5dbc-4e47-9aed-39662ed0d3b4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:54.658486 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5755aaff-bd55-46ef-a558-24a691beb528 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3c41763f-e17d-4df7-96ea-31656322a752,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:54.662024 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-5755aaff-bd55-46ef-a558-24a691beb528 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:54.668369 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-e129ec2d-31dc-4a89-b487-421996f67809 req-9fb28111-39ee-47c2-becf-1535c92934ee tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Request body: {'port': {'device_id': '1b72c068-99c2-4781-ad52-9c9c159b37ec', 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4', 'admin_state_up': True, 'tenant_id': '7bac6d994f4d49b292bc39fac07c0311'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:31:54.697522 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-5755aaff-bd55-46ef-a558-24a691beb528 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:54.721151 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 47976) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:54.776367 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-5755aaff-bd55-46ef-a558-24a691beb528 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/3c41763f-e17d-4df7-96ea-31656322a752 HTTP/1.1" status: 204  len: 168 time: 1.2313261
Jun 03 08:31:54.776872 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 47982) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:54.838614 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-e129ec2d-31dc-4a89-b487-421996f67809 req-9fb28111-39ee-47c2-becf-1535c92934ee tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:54.849621 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-e129ec2d-31dc-4a89-b487-421996f67809 req-9fb28111-39ee-47c2-becf-1535c92934ee tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:54.898068 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e523445b-79bb-4ec4-90b9-24c63af9ad4f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:54.900705 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-54367ec0-59d7-47c9-8ae3-771254e22503 req-c2e5f8f6-ae28-450b-8bf0-1e30821cb3d0 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=1b72c068-99c2-4781-ad52-9c9c159b37ec HTTP/1.1" status: 200  len: 210 time: 0.0427344
Jun 03 08:31:54.921342 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-80ab399a-c71c-4238-8324-8774c963dc12 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:54.921342 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-529010'] for network, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:54.923749 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-cb30f695-3ced-4394-b684-02bb061147f6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:54.939860 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-e523445b-79bb-4ec4-90b9-24c63af9ad4f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:54.947295 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80ab399a-c71c-4238-8324-8774c963dc12 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88a5820a-737e-49a6-80dd-d3ca4548f453,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:54.949686 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-e523445b-79bb-4ec4-90b9-24c63af9ad4f admin admin] Usage tracker for resource:security_group_rule and tenant:2ded043d9e9a4ea9ae231219fced74fe is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:54.956207 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-e523445b-79bb-4ec4-90b9-24c63af9ad4f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:54.959084 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-80ab399a-c71c-4238-8324-8774c963dc12 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:54.968846 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-e523445b-79bb-4ec4-90b9-24c63af9ad4f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:55.001277 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-80ab399a-c71c-4238-8324-8774c963dc12 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:55.002394 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-80ab399a-c71c-4238-8324-8774c963dc12 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/88a5820a-737e-49a6-80dd-d3ca4548f453 HTTP/1.1" status: 204  len: 168 time: 0.5148599
Jun 03 08:31:55.053782 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e129ec2d-31dc-4a89-b487-421996f67809 req-9fb28111-39ee-47c2-becf-1535c92934ee tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Made reservation on behalf of 7bac6d994f4d49b292bc39fac07c0311 for: {'port': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:31:55.060608 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e129ec2d-31dc-4a89-b487-421996f67809 req-9fb28111-39ee-47c2-becf-1535c92934ee tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:55.076288 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 47988) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:55.115507 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-862046', 'neutron.services.segments.db._delete_segments_for_network-8774224358894'] for network, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:55.140173 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7fae86b2beb0>> segment before_delete 55550000 {{(pid=92324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:31:55.140533 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7fae86b2beb0>> subnet precommit_delete_associations 55550000 {{(pid=92324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:31:55.141422 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fae86d33ca0>> segment_host_mapping after_create 55550000 {{(pid=92324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:31:55.141777 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fae86d33ca0>> port after_create 55550000 {{(pid=92324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:31:55.142122 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fae86d33ca0>> port after_delete 55550000 {{(pid=92324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:31:55.143374 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fae86d33ca0>> port after_update 55550000 {{(pid=92324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:31:55.143374 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fae86d33ca0>> segment after_delete 55550000 {{(pid=92324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:31:55.143683 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fae86d33ca0>> subnet after_create 55550000 {{(pid=92324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:31:55.144037 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fae86d33ca0>> subnet after_delete 55550000 {{(pid=92324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:31:55.144363 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fae86d33ca0>> subnet after_update 55550000 {{(pid=92324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:31:55.280821 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7add626c-f2c0-459d-a543-85853f1a52ef admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:55.315222 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-7add626c-f2c0-459d-a543-85853f1a52ef admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:55.323625 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-7add626c-f2c0-459d-a543-85853f1a52ef admin admin] Usage tracker for resource:security_group_rule and tenant:7f8c88f4f89e4ab0a474fe1d1635f2cc is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:55.328037 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-7add626c-f2c0-459d-a543-85853f1a52ef admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:55.339587 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-7add626c-f2c0-459d-a543-85853f1a52ef admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:55.345293 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [req-e129ec2d-31dc-4a89-b487-421996f67809 req-9fb28111-39ee-47c2-becf-1535c92934ee tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Allocated IP 172.20.0.8 (f9db9a2a-942b-4a98-97ed-1896cb9158b4/5f3b55e2-964f-4ce8-9d71-3ac11dc6ebf1/a309b335-7644-4c59-8d6b-90e763827a25) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:31:55.351106 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fae861783d0>> subnet after_create 55550000 {{(pid=92324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:31:55.351454 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fae861783d0>> subnet after_delete 55550000 {{(pid=92324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:31:55.351815 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fae861783d0>> subnet before_create 55550000 {{(pid=92324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:31:55.352145 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fae861783d0>> subnet before_update 55550000 {{(pid=92324) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:31:55.353014 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fae86b2b6d0>,) {'filters': {'network_id': ['70332c9d-d098-4fc3-97a8-2773d2d72e48']}} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:31:55.373026 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fae86b2b6d0>, '5a5b66b5-9e55-4a2d-87ec-5d31f3999401') {'for_net_delete': True} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:31:55.373331 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fae86b2b6d0>, '5a5b66b5-9e55-4a2d-87ec-5d31f3999401') {} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:31:55.391414 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8774224362253', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-15250406'] for segment, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:55.420970 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:55.479302 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Releasing vlan 544 on physical network physnet1 to pool {{(pid=92324) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 03 08:31:55.479731 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15641405'] for segment, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:   from cryptography.utils import int_from_bytes
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:   from cryptography.utils import int_from_bytes
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]: Traceback (most recent call last):
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:     timer()
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:     cb(*args, **kw)
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:     return func(*args, **kwargs)
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:     self._notify()
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:     self.callback(batched_events)
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:     event.method(event)
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:     return f(self, *a, **k)
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self._get(url).json()
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self.request(url, 'GET', **kwargs)
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 03 08:31:55.531999 dv-cinder-787262-5-iscsi neutron-server[92324]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 03 08:31:55.640618 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e523445b-79bb-4ec4-90b9-24c63af9ad4f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:55.670457 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7add626c-f2c0-459d-a543-85853f1a52ef admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:55.720730 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e129ec2d-31dc-4a89-b487-421996f67809 req-9fb28111-39ee-47c2-becf-1535c92934ee tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:55.796781 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-862039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16327709'] for network, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:55.798152 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e523445b-79bb-4ec4-90b9-24c63af9ad4f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:55.808221 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e1987a09-1150-4f40-bf4d-c116444e9b6c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:55.840172 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:55.864786 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-e523445b-79bb-4ec4-90b9-24c63af9ad4f admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=2ded043d9e9a4ea9ae231219fced74fe&name=default HTTP/1.1" status: 200  len: 2979 time: 1.1425741
Jun 03 08:31:55.867995 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e523445b-79bb-4ec4-90b9-24c63af9ad4f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=53d87071-a9cc-48a8-b893-511e7e68c6bb,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:55.868293 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 48006) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:55.874100 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] 10.222.0.11 "DELETE /v2.0/networks/70332c9d-d098-4fc3-97a8-2773d2d72e48 HTTP/1.1" status: 204  len: 168 time: 1.0939860
Jun 03 08:31:55.874100 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e523445b-79bb-4ec4-90b9-24c63af9ad4f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:55.874100 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-be3ac6ab-e3bc-45c1-ab96-4fd267e08cd4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.037s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:55.894824 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Pushing event deleted for resources: {'Network': ['ID=70332c9d-d098-4fc3-97a8-2773d2d72e48,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:55.897147 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:55.933612 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f6ec2c66-6b35-439f-ad3f-ae457d1c5893 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:55.947908 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7add626c-f2c0-459d-a543-85853f1a52ef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:55.956430 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-d6434987-2370-4824-b328-c6885f538dfe admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:55.982941 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f6ec2c66-6b35-439f-ad3f-ae457d1c5893 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:56.014130 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e129ec2d-31dc-4a89-b487-421996f67809 req-9fb28111-39ee-47c2-becf-1535c92934ee tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:56.028775 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['24826ba2-ee17-4774-b5ca-2cd1675f325a'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:31:56.083568 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7add626c-f2c0-459d-a543-85853f1a52ef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f488be6e-d008-4c96-8e8e-9d9f53677a53,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:56.084421 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:56.088084 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-7add626c-f2c0-459d-a543-85853f1a52ef admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=7f8c88f4f89e4ab0a474fe1d1635f2cc&name=default HTTP/1.1" status: 200  len: 2979 time: 1.0076795
Jun 03 08:31:56.091030 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 48012) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:56.098232 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-7add626c-f2c0-459d-a543-85853f1a52ef admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:56.098837 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-7039ea7f-6981-4529-b1f5-004bee7e0853 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.016s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:56.152688 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 48014) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:56.180719 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cc3daab8-424e-49ee-92fd-f094aada55b1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:56.181237 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e129ec2d-31dc-4a89-b487-421996f67809 req-9fb28111-39ee-47c2-becf-1535c92934ee tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Network f9db9a2a-942b-4a98-97ed-1896cb9158b4 is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:31:56.189692 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [req-e129ec2d-31dc-4a89-b487-421996f67809 req-9fb28111-39ee-47c2-becf-1535c92934ee tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:31:56.194984 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-e129ec2d-31dc-4a89-b487-421996f67809 req-9fb28111-39ee-47c2-becf-1535c92934ee tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:31:56.200529 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e129ec2d-31dc-4a89-b487-421996f67809 req-9fb28111-39ee-47c2-becf-1535c92934ee tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:56.201176 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e129ec2d-31dc-4a89-b487-421996f67809 req-9fb28111-39ee-47c2-becf-1535c92934ee tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:56.203682 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5e421f21-2a79-4039-b216-fb3cfca2e57d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:56.205584 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-cc3daab8-424e-49ee-92fd-f094aada55b1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:56.216183 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-cc3daab8-424e-49ee-92fd-f094aada55b1 admin admin] Usage tracker for resource:security_group_rule and tenant:bed7c82e030a4f1ba1350235542fbbdb is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:56.221662 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fb28111-39ee-47c2-becf-1535c92934ee tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Pushing event updated for resources: {'Port': ['ID=a309b335-7644-4c59-8d6b-90e763827a25,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:56.221926 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-cc3daab8-424e-49ee-92fd-f094aada55b1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:56.231521 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-9fb28111-39ee-47c2-becf-1535c92934ee tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:56.245248 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-cc3daab8-424e-49ee-92fd-f094aada55b1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:56.255652 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5e421f21-2a79-4039-b216-fb3cfca2e57d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:56.268667 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cdaffbd-2e69-4022-a158-e4f1f9af488e req-5c20219b-fe64-462b-85af-e136e6b4bb52 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:56.269398 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-5cdaffbd-2e69-4022-a158-e4f1f9af488e req-5c20219b-fe64-462b-85af-e136e6b4bb52 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Synchronizing usage tracker for tenant:7bac6d994f4d49b292bc39fac07c0311 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:31:56.346531 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f6ec2c66-6b35-439f-ad3f-ae457d1c5893 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:56.348961 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f6ec2c66-6b35-439f-ad3f-ae457d1c5893 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:56.350169 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-f6ec2c66-6b35-439f-ad3f-ae457d1c5893 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/53d87071-a9cc-48a8-b893-511e7e68c6bb HTTP/1.1" status: 204  len: 168 time: 0.4808207
Jun 03 08:31:56.351006 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:56.358571 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e129ec2d-31dc-4a89-b487-421996f67809 req-9fb28111-39ee-47c2-becf-1535c92934ee tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.55 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.7015665
Jun 03 08:31:56.362373 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6ec2c66-6b35-439f-ad3f-ae457d1c5893 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=53d87071-a9cc-48a8-b893-511e7e68c6bb,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:56.364563 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f6ec2c66-6b35-439f-ad3f-ae457d1c5893 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:56.374047 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-e129ec2d-31dc-4a89-b487-421996f67809 req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Request body: {'port': {'device_id': '1b72c068-99c2-4781-ad52-9c9c159b37ec', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:31:56.445184 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5e421f21-2a79-4039-b216-fb3cfca2e57d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:56.452592 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:56.460698 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 48018) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:56.469634 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e421f21-2a79-4039-b216-fb3cfca2e57d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f488be6e-d008-4c96-8e8e-9d9f53677a53,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:56.476124 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-5e421f21-2a79-4039-b216-fb3cfca2e57d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:56.482207 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5e421f21-2a79-4039-b216-fb3cfca2e57d admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:56.483995 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-5cdaffbd-2e69-4022-a158-e4f1f9af488e req-5c20219b-fe64-462b-85af-e136e6b4bb52 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Unset dirty status for tenant:7bac6d994f4d49b292bc39fac07c0311 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:31:56.485146 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5cdaffbd-2e69-4022-a158-e4f1f9af488e req-5c20219b-fe64-462b-85af-e136e6b4bb52 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=1b72c068-99c2-4781-ad52-9c9c159b37ec HTTP/1.1" status: 200  len: 931 time: 0.4530818
Jun 03 08:31:56.486471 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-5e421f21-2a79-4039-b216-fb3cfca2e57d admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/f488be6e-d008-4c96-8e8e-9d9f53677a53 HTTP/1.1" status: 204  len: 168 time: 0.3942542
Jun 03 08:31:56.566411 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e129ec2d-31dc-4a89-b487-421996f67809 req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:56.572626 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cc3daab8-424e-49ee-92fd-f094aada55b1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:56.595647 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 48028) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:56.595865 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-cb9d7e1f-eb1a-42ca-a8ea-52827562fccd admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=52d59e3293254fcc85972c62e654f494&name=default HTTP/1.1" status: 200  len: 2975 time: 0.1292040
Jun 03 08:31:56.629475 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5cdaffbd-2e69-4022-a158-e4f1f9af488e req-1984884c-a388-4a72-b389-41054b86e956 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1312191
Jun 03 08:31:56.713917 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-4daad0ad-2ae5-43cc-8c4d-68ea4c3e015c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:56.742296 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cc3daab8-424e-49ee-92fd-f094aada55b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:56.752565 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-4daad0ad-2ae5-43cc-8c4d-68ea4c3e015c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:56.762057 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-5c69a3a9-2004-47d9-b23a-7b8277437548 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:56.828099 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-cc3daab8-424e-49ee-92fd-f094aada55b1 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=bed7c82e030a4f1ba1350235542fbbdb&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6733978
Jun 03 08:31:56.832700 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 48032) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:56.835370 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc3daab8-424e-49ee-92fd-f094aada55b1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f4db584a-5d50-415a-8025-4b7448736d59,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:56.862006 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-cc3daab8-424e-49ee-92fd-f094aada55b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:57.003023 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-4daad0ad-2ae5-43cc-8c4d-68ea4c3e015c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:57.021162 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-23b0ae51-1d8e-4eb9-bc55-9a238fe2a364 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:57.034999 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4daad0ad-2ae5-43cc-8c4d-68ea4c3e015c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=12cbc694-d459-4366-b758-44d0f16106cd,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:57.038897 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-4daad0ad-2ae5-43cc-8c4d-68ea4c3e015c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:57.069341 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-655a5cfd-a17b-4bc2-a52d-eb24d913243f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:57.123761 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-4daad0ad-2ae5-43cc-8c4d-68ea4c3e015c admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:57.127624 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-4daad0ad-2ae5-43cc-8c4d-68ea4c3e015c admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/12cbc694-d459-4366-b758-44d0f16106cd HTTP/1.1" status: 204  len: 168 time: 0.5283527
Jun 03 08:31:57.172841 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-655a5cfd-a17b-4bc2-a52d-eb24d913243f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:57.180822 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [req-e129ec2d-31dc-4a89-b487-421996f67809 req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a309b335-7644-4c59-8d6b-90e763827a25 {{(pid=92323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:31:57.193002 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e129ec2d-31dc-4a89-b487-421996f67809 req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:57.233851 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-e129ec2d-31dc-4a89-b487-421996f67809 req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Transition to ACTIVE for port object a309b335-7644-4c59-8d6b-90e763827a25 will not be triggered until provisioned by entity L2. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:31:57.366804 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-655a5cfd-a17b-4bc2-a52d-eb24d913243f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:57.372601 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:57.379028 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e129ec2d-31dc-4a89-b487-421996f67809 req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:57.391448 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-655a5cfd-a17b-4bc2-a52d-eb24d913243f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f4db584a-5d50-415a-8025-4b7448736d59,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:57.400651 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-655a5cfd-a17b-4bc2-a52d-eb24d913243f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:57.400651 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.006s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:57.506480 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-655a5cfd-a17b-4bc2-a52d-eb24d913243f admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:57.507622 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-655a5cfd-a17b-4bc2-a52d-eb24d913243f admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/f4db584a-5d50-415a-8025-4b7448736d59 HTTP/1.1" status: 204  len: 168 time: 0.6739347
Jun 03 08:31:57.557401 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Pushing event updated for resources: {'Port': ['ID=a309b335-7644-4c59-8d6b-90e763827a25,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:57.564629 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:57.580662 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-e129ec2d-31dc-4a89-b487-421996f67809 req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Attempting to bind port a309b335-7644-4c59-8d6b-90e763827a25 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:31:57.580994 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-e129ec2d-31dc-4a89-b487-421996f67809 req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Attempting to bind port a309b335-7644-4c59-8d6b-90e763827a25 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '9923ac74-9556-45ec-9044-43728d2a8ec3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4'}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:31:57.581321 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e129ec2d-31dc-4a89-b487-421996f67809 req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Attempting to bind port a309b335-7644-4c59-8d6b-90e763827a25 on network f9db9a2a-942b-4a98-97ed-1896cb9158b4 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:31:57.586691 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e129ec2d-31dc-4a89-b487-421996f67809 req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Port a309b335-7644-4c59-8d6b-90e763827a25 on network f9db9a2a-942b-4a98-97ed-1896cb9158b4 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 03 08:31:57.586990 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e129ec2d-31dc-4a89-b487-421996f67809 req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Attempting to bind port a309b335-7644-4c59-8d6b-90e763827a25 on network f9db9a2a-942b-4a98-97ed-1896cb9158b4 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:31:57.592570 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e129ec2d-31dc-4a89-b487-421996f67809 req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Checking agent: {'id': '181c5753-100b-4f03-bda8-e34279b057f4', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'started_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 31, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:31:57.593063 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e129ec2d-31dc-4a89-b487-421996f67809 req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Checking segment: {'id': '9923ac74-9556-45ec-9044-43728d2a8ec3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:31:57.593448 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e129ec2d-31dc-4a89-b487-421996f67809 req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Bound using segment: {'id': '9923ac74-9556-45ec-9044-43728d2a8ec3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4'} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:31:57.593872 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-e129ec2d-31dc-4a89-b487-421996f67809 req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Bound port: a309b335-7644-4c59-8d6b-90e763827a25, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9923ac74-9556-45ec-9044-43728d2a8ec3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4'}}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:31:57.594215 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e129ec2d-31dc-4a89-b487-421996f67809 req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:57.647004 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 48046) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:57.667514 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0612db9d-8627-4498-95f0-99560c6d74a8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:57.685396 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-0612db9d-8627-4498-95f0-99560c6d74a8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:57.691015 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-0612db9d-8627-4498-95f0-99560c6d74a8 admin admin] Usage tracker for resource:security_group_rule and tenant:9e5ee5513d004bbda8d8b20d176d8a69 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:57.694370 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-0612db9d-8627-4498-95f0-99560c6d74a8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:57.700980 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-0612db9d-8627-4498-95f0-99560c6d74a8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:57.702545 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-e129ec2d-31dc-4a89-b487-421996f67809 req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] For port a309b335-7644-4c59-8d6b-90e763827a25, host hv-cinder-78726, cleared binding levels {{(pid=92323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:31:57.706147 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-e129ec2d-31dc-4a89-b487-421996f67809 req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] For port a309b335-7644-4c59-8d6b-90e763827a25, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=a309b335-7644-4c59-8d6b-90e763827a25,segment=NetworkSegment(9923ac74-9556-45ec-9044-43728d2a8ec3),segment_id=9923ac74-9556-45ec-9044-43728d2a8ec3)] {{(pid=92323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:31:57.845809 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0612db9d-8627-4498-95f0-99560c6d74a8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:57.876452 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e129ec2d-31dc-4a89-b487-421996f67809 req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:57.880595 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:57.881632 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc5ab36d-9e31-41bd-9298-b3a74a99d51a req-d394d996-3006-4425-bd88-bd5909718f90 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:57.883708 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-bc5ab36d-9e31-41bd-9298-b3a74a99d51a req-d394d996-3006-4425-bd88-bd5909718f90 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=1b72c068-99c2-4781-ad52-9c9c159b37ec HTTP/1.1" status: 200  len: 943 time: 0.0987656
Jun 03 08:31:57.932363 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-bc5ab36d-9e31-41bd-9298-b3a74a99d51a req-9b9c2855-f27a-4c77-bc42-dd5cac3e4554 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427837
Jun 03 08:31:57.938829 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e129ec2d-31dc-4a89-b487-421996f67809 req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:31:57.939472 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e129ec2d-31dc-4a89-b487-421996f67809 req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:57.940869 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e129ec2d-31dc-4a89-b487-421996f67809 req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] 10.222.0.55 "PUT /v2.0/ports/a309b335-7644-4c59-8d6b-90e763827a25 HTTP/1.1" status: 200  len: 1093 time: 1.5719147
Jun 03 08:31:57.944642 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1b72c068-99c2-4781-ad52-9c9c159b37ec', 'tag': 'a309b335-7644-4c59-8d6b-90e763827a25'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:31:57.947760 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c0c78f67-224c-4b08-8a32-bdb7863bf7f9" -d '{"events": [{"name": "network-changed", "server_uuid": "1b72c068-99c2-4781-ad52-9c9c159b37ec", "tag": "a309b335-7644-4c59-8d6b-90e763827a25"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:31:57.967014 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Pushing event updated for resources: {'Port': ['ID=a309b335-7644-4c59-8d6b-90e763827a25,revision_number=3']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:57.970382 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:57.984592 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0612db9d-8627-4498-95f0-99560c6d74a8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:57.993679 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e523445b-79bb-4ec4-90b9-24c63af9ad4f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:58.036573 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-0612db9d-8627-4498-95f0-99560c6d74a8 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=9e5ee5513d004bbda8d8b20d176d8a69&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3887639
Jun 03 08:31:58.038143 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0612db9d-8627-4498-95f0-99560c6d74a8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cc117fa2-6a17-4002-b332-6b5053bb5ff8,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:58.039469 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 48056) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:58.041646 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-0612db9d-8627-4498-95f0-99560c6d74a8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:58.102893 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-ce5a7ac0-cdab-458f-a357-ac5bfa1b8c9e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:58.138229 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-ce5a7ac0-cdab-458f-a357-ac5bfa1b8c9e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:58.322177 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 48068) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:58.338163 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-ce5a7ac0-cdab-458f-a357-ac5bfa1b8c9e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:58.347865 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b3c68e00-e145-4be7-af90-0e6c11c19664 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:58.355531 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-3db5cb50-035a-47a3-8bb1-586fc36ee063 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:58.364823 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce5a7ac0-cdab-458f-a357-ac5bfa1b8c9e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc117fa2-6a17-4002-b332-6b5053bb5ff8,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:58.370955 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-ce5a7ac0-cdab-458f-a357-ac5bfa1b8c9e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:58.390447 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-ce5a7ac0-cdab-458f-a357-ac5bfa1b8c9e admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:58.394674 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-ce5a7ac0-cdab-458f-a357-ac5bfa1b8c9e admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/cc117fa2-6a17-4002-b332-6b5053bb5ff8 HTTP/1.1" status: 204  len: 168 time: 0.3511214
Jun 03 08:31:58.394674 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-3db5cb50-035a-47a3-8bb1-586fc36ee063 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:31:58.396907 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-3db5cb50-035a-47a3-8bb1-586fc36ee063 admin admin] Usage tracker for resource:security_group_rule and tenant:9fc5091d7f974c0a9a61dc21b5d72d0f is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:31:58.400517 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-3db5cb50-035a-47a3-8bb1-586fc36ee063 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:31:58.406677 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-3db5cb50-035a-47a3-8bb1-586fc36ee063 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:31:58.502721 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-3db5cb50-035a-47a3-8bb1-586fc36ee063 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:58.579205 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-3db5cb50-035a-47a3-8bb1-586fc36ee063 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:58.588340 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-1b5b8ac8-62fe-4eef-a2f6-0d55c579b2d2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:58.633465 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-3db5cb50-035a-47a3-8bb1-586fc36ee063 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=9fc5091d7f974c0a9a61dc21b5d72d0f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3071034
Jun 03 08:31:58.633465 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3db5cb50-035a-47a3-8bb1-586fc36ee063 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cd4719b2-0441-4644-8c7a-ee4bfdfd4830,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:58.633990 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 48080) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:31:58.647531 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-3db5cb50-035a-47a3-8bb1-586fc36ee063 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:58.707356 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1bdba9a0-0892-4a29-a3d5-db8583dbdf92 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:58.736108 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1bdba9a0-0892-4a29-a3d5-db8583dbdf92 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:58.917065 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1bdba9a0-0892-4a29-a3d5-db8583dbdf92 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:58.924377 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:31:58.945604 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bdba9a0-0892-4a29-a3d5-db8583dbdf92 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cd4719b2-0441-4644-8c7a-ee4bfdfd4830,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:31:58.970546 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-1bdba9a0-0892-4a29-a3d5-db8583dbdf92 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:31:58.983725 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1bdba9a0-0892-4a29-a3d5-db8583dbdf92 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:31:58.985878 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-1bdba9a0-0892-4a29-a3d5-db8583dbdf92 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/cd4719b2-0441-4644-8c7a-ee4bfdfd4830 HTTP/1.1" status: 204  len: 168 time: 0.3505833
Jun 03 08:31:59.708530 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 48120) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:00.031417 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1863482925-network', 'tenant_id': 'b9cf7834ca79439981d1f8e77b89daed'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:32:00.039785 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:00.045184 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Usage tracker for resource:network and tenant:b9cf7834ca79439981d1f8e77b89daed is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:00.049476 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:00.057548 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:00.150847 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Made reservation on behalf of b9cf7834ca79439981d1f8e77b89daed for: {'network': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:32:00.155459 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-676039'] for network, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:00.171232 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:00.186769 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:00.190724 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Usage tracker for resource:security_group_rule and tenant:b9cf7834ca79439981d1f8e77b89daed is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:00.193579 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:00.199773 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:00.359267 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:00.470380 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:00.473517 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-992275c7-34ec-468a-988d-52ce0bc09734 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:00.501631 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] vlan segment allocate from pool success with {'vlan_id': 518, 'physical_network': 'physnet1'}  {{(pid=92324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 03 08:32:00.510020 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b20b0dee-1798-4811-81d5-712ca54f9835,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:00.513478 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:00.515879 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:00.516216 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.segments_db [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Added segment 1b8fb38d-ade8-4355-bd2b-f2b171f31184 of type vlan for network 6861b4db-6cd2-4a5b-bf02-87826345c933
Jun 03 08:32:00.542756 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8774223827658'] for network, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:00.790178 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820'] for network, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:00.790178 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:00.790178 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:00.793094 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:00.795097 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:31:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fd40fbc2-6bbb-498e-9e25-89c17ad90ed3 x-openstack-request-id: req-fd40fbc2-6bbb-498e-9e25-89c17ad90ed3 {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:32:00.795573 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1b72c068-99c2-4781-ad52-9c9c159b37ec", "tag": "a309b335-7644-4c59-8d6b-90e763827a25", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:32:00.796971 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-fd40fbc2-6bbb-498e-9e25-89c17ad90ed3 {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:32:00.798168 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1b72c068-99c2-4781-ad52-9c9c159b37ec', 'tag': 'a309b335-7644-4c59-8d6b-90e763827a25', 'status': 'completed', 'code': 200}
Jun 03 08:32:00.906136 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Pushing event updated for resources: {'Network': ['ID=6861b4db-6cd2-4a5b-bf02-87826345c933,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:00.908771 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:00.923954 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Network 6861b4db-6cd2-4a5b-bf02-87826345c933 details requested by agent ovs-agent-dv-cinder-787262-5-iscsi with host dv-cinder-787262-5-iscsi {{(pid=92325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 03 08:32:00.994936 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0c78f67-224c-4b08-8a32-bdb7863bf7f9 req-1df3f5cd-00bd-40c3-9f1a-f50d70fb546a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:00.996435 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c0c78f67-224c-4b08-8a32-bdb7863bf7f9 req-1df3f5cd-00bd-40c3-9f1a-f50d70fb546a service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=7bac6d994f4d49b292bc39fac07c0311&device_id=1b72c068-99c2-4781-ad52-9c9c159b37ec HTTP/1.1" status: 200  len: 1096 time: 0.1503053
Jun 03 08:32:01.010992 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201  len: 892 time: 1.2970743
Jun 03 08:32:01.010992 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 48158) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:01.011285 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5472c76-8d2b-43cb-830b-f30bcd6dc601 req-f4d4716d-6229-4699-9ea0-4a46eea4ab92 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:01.012789 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d5472c76-8d2b-43cb-830b-f30bcd6dc601 req-f4d4716d-6229-4699-9ea0-4a46eea4ab92 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=1b72c068-99c2-4781-ad52-9c9c159b37ec HTTP/1.1" status: 200  len: 943 time: 0.1270800
Jun 03 08:32:01.015368 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-8c12192f-c486-4b1d-98dc-f0150e2e9e81 admin admin] Request body: {'subnet': {'network_id': '6861b4db-6cd2-4a5b-bf02-87826345c933', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1863482925-subnet', 'tenant_id': 'b9cf7834ca79439981d1f8e77b89daed', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:32:01.020274 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-8c12192f-c486-4b1d-98dc-f0150e2e9e81 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:01.028830 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-8c12192f-c486-4b1d-98dc-f0150e2e9e81 admin admin] Usage tracker for resource:subnet and tenant:b9cf7834ca79439981d1f8e77b89daed is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:01.032633 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-8c12192f-c486-4b1d-98dc-f0150e2e9e81 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:01.045544 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-8c12192f-c486-4b1d-98dc-f0150e2e9e81 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:01.160266 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8c12192f-c486-4b1d-98dc-f0150e2e9e81 admin admin] Made reservation on behalf of b9cf7834ca79439981d1f8e77b89daed for: {'subnet': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:32:01.163038 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8c12192f-c486-4b1d-98dc-f0150e2e9e81 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14870279'] for subnet, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:01.172764 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d5472c76-8d2b-43cb-830b-f30bcd6dc601 req-3f9ee9ed-fcba-4876-acb1-0945ca2a1b4e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1352286
Jun 03 08:32:01.212955 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0c78f67-224c-4b08-8a32-bdb7863bf7f9 req-0dc9dec2-6f59-4bb4-8b00-e87231dc9514 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:01.214557 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c0c78f67-224c-4b08-8a32-bdb7863bf7f9 req-0dc9dec2-6f59-4bb4-8b00-e87231dc9514 service neutron] 10.222.0.55 "GET /v2.0/networks?tenant_id=7bac6d994f4d49b292bc39fac07c0311&shared=False HTTP/1.1" status: 200  len: 916 time: 0.2006989
Jun 03 08:32:01.385774 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0c78f67-224c-4b08-8a32-bdb7863bf7f9 req-52da7c32-bb0c-4dc6-999f-bf2b6046f6e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:01.386456 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c0c78f67-224c-4b08-8a32-bdb7863bf7f9 req-52da7c32-bb0c-4dc6-999f-bf2b6046f6e2 service neutron] 10.222.0.55 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1649408
Jun 03 08:32:01.512698 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e129ec2d-31dc-4a89-b487-421996f67809 req-d679be55-92f9-48ce-8a36-208dc5de0cbe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:01.514325 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e129ec2d-31dc-4a89-b487-421996f67809 req-d679be55-92f9-48ce-8a36-208dc5de0cbe service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=7bac6d994f4d49b292bc39fac07c0311&device_id=1b72c068-99c2-4781-ad52-9c9c159b37ec HTTP/1.1" status: 200  len: 1096 time: 0.0786383
Jun 03 08:32:01.584284 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e129ec2d-31dc-4a89-b487-421996f67809 req-195fe297-4933-49c9-b027-2b3fc2f05c52 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=a309b335-7644-4c59-8d6b-90e763827a25 HTTP/1.1" status: 200  len: 217 time: 0.0620656
Jun 03 08:32:01.662431 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e129ec2d-31dc-4a89-b487-421996f67809 req-ab4fdbe9-5234-4bad-9b13-5eac6f8bc29a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:01.664536 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e129ec2d-31dc-4a89-b487-421996f67809 req-ab4fdbe9-5234-4bad-9b13-5eac6f8bc29a service neutron] 10.222.0.55 "GET /v2.0/subnets?id=5f3b55e2-964f-4ce8-9d71-3ac11dc6ebf1 HTTP/1.1" status: 200  len: 855 time: 0.0729733
Jun 03 08:32:01.722892 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e129ec2d-31dc-4a89-b487-421996f67809 req-5949e378-8c57-4836-8c8c-7c18717f6c75 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=f9db9a2a-942b-4a98-97ed-1896cb9158b4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0501304
Jun 03 08:32:01.799128 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8c12192f-c486-4b1d-98dc-f0150e2e9e81 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15641492', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14870385'] for subnet, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:01.806767 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-1921c93a-8713-41b7-8764-939b30bad98e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:01.870886 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c12192f-c486-4b1d-98dc-f0150e2e9e81 admin admin] Pushing event updated for resources: {'Subnet': ['ID=0ea4966f-f9de-4d69-a774-7746b1ee12ee,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:01.874217 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-8c12192f-c486-4b1d-98dc-f0150e2e9e81 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:01.899899 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e129ec2d-31dc-4a89-b487-421996f67809 req-d91ae83a-0243-445c-94c4-8183998d68ab service neutron] 10.222.0.55 "GET /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1691425
Jun 03 08:32:01.903082 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c12192f-c486-4b1d-98dc-f0150e2e9e81 admin admin] Checking segment: {'id': '1b8fb38d-ade8-4355-bd2b-f2b171f31184', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 518, 'network_id': '6861b4db-6cd2-4a5b-bf02-87826345c933'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:32:01.903371 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c12192f-c486-4b1d-98dc-f0150e2e9e81 admin admin] Network hostable DHCP agents. Network: 6861b4db-6cd2-4a5b-bf02-87826345c933, hostable agents: ['07372699-02ac-4239-816f-84b3a5b0eff9'], hosted agents: [] {{(pid=92324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 03 08:32:02.053374 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c12192f-c486-4b1d-98dc-f0150e2e9e81 admin admin] Network 6861b4db-6cd2-4a5b-bf02-87826345c933 is scheduled to be hosted by DHCP agent 07372699-02ac-4239-816f-84b3a5b0eff9 with binding_index 1 {{(pid=92324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 03 08:32:02.163220 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e129ec2d-31dc-4a89-b487-421996f67809 req-bb4858f5-4a38-4d8c-9308-95b48923c0ef service neutron] 10.222.0.55 "GET /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2451274
Jun 03 08:32:02.249249 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-8c12192f-c486-4b1d-98dc-f0150e2e9e81 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-5-iscsi, 6861b4db-6cd2-4a5b-bf02-87826345c933) {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:32:02.260359 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c12192f-c486-4b1d-98dc-f0150e2e9e81 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:02.261206 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8c12192f-c486-4b1d-98dc-f0150e2e9e81 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:02.263203 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-adb07554-f161-4796-afd8-31992a33b17e None None] Network 6861b4db-6cd2-4a5b-bf02-87826345c933 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:32:02.319997 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:32:02.406904 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-8c12192f-c486-4b1d-98dc-f0150e2e9e81 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 856 time: 1.3952610
Jun 03 08:32:02.410136 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 48208) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:02.415513 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1863482925-router', 'tenant_id': 'b9cf7834ca79439981d1f8e77b89daed', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:32:02.422010 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:02.437353 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Usage tracker for resource:router and tenant:b9cf7834ca79439981d1f8e77b89daed is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:02.445508 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:02.454879 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e561848-413e-48be-b16b-9797822b302a req-fa4fb503-4978-4b6f-b2c1-46027538e463 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:02.456805 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3e561848-413e-48be-b16b-9797822b302a req-fa4fb503-4978-4b6f-b2c1-46027538e463 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=1b72c068-99c2-4781-ad52-9c9c159b37ec HTTP/1.1" status: 200  len: 943 time: 0.1490200
Jun 03 08:32:02.460259 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:02.516422 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3e561848-413e-48be-b16b-9797822b302a req-976f56a9-d7a8-4302-831a-774655fba04a tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0512793
Jun 03 08:32:02.575962 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3612d4bd-6f67-41cd-b896-98e486fc7c8c None None] Network 6861b4db-6cd2-4a5b-bf02-87826345c933 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:32:02.598923 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-16388154', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2397'] for router, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:02.599992 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-16389011', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-16327785', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-16383573', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2340'] for router, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:02.640798 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:02.688748 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4059d237-e933-424d-87a6-91d3c25897ca None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:03.138082 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-16327803', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-16388116', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2358'] for router, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:03.576502 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:03.608528 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:03.816908 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 48262) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:03.818449 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4605ac38-4ef3-4cca-bb88-26456fcaf942 req-b85ae7e8-6b85-44a9-ad2e-e2c031806315 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:03.820155 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4605ac38-4ef3-4cca-bb88-26456fcaf942 req-b85ae7e8-6b85-44a9-ad2e-e2c031806315 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=1b72c068-99c2-4781-ad52-9c9c159b37ec HTTP/1.1" status: 200  len: 943 time: 0.1722720
Jun 03 08:32:03.867586 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Allocated IP 172.27.0.52 (684ef871-89aa-450d-ae0d-e232bfaf51fb/e7b58fba-1ed5-483b-b341-7736b2ffb853/e13a1db6-df45-45c7-a102-bed3e3054729) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:32:03.922709 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4605ac38-4ef3-4cca-bb88-26456fcaf942 req-ae6855f6-cfe2-49f2-99a3-83f2ad3ec63d tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0942624
Jun 03 08:32:04.068173 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:04.128617 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-dc750f27-d0c7-4ab0-bd7a-1fc07c3d7565 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:04.148087 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-dc750f27-d0c7-4ab0-bd7a-1fc07c3d7565 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:04.154040 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-dc750f27-d0c7-4ab0-bd7a-1fc07c3d7565 admin admin] Usage tracker for resource:security_group_rule and tenant:13fe137bee5b4062ad03998c8e56f1af is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:04.171909 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-dc750f27-d0c7-4ab0-bd7a-1fc07c3d7565 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:04.175214 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:04.181343 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-dc750f27-d0c7-4ab0-bd7a-1fc07c3d7565 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:04.193913 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f8549f22-ed83-45ec-a36d-9f4c21a67184 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:04.245657 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:32:04.253792 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:32:04.259721 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:32:04.302197 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-dc750f27-d0c7-4ab0-bd7a-1fc07c3d7565 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:04.373968 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-dc750f27-d0c7-4ab0-bd7a-1fc07c3d7565 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:04.388223 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-5e421f21-2a79-4039-b216-fb3cfca2e57d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:04.441447 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-dc750f27-d0c7-4ab0-bd7a-1fc07c3d7565 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=13fe137bee5b4062ad03998c8e56f1af&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6227376
Jun 03 08:32:04.442457 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc750f27-d0c7-4ab0-bd7a-1fc07c3d7565 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a6621f7d-1ddc-49d8-8492-10c1743a476c,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:04.445224 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 48284) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:04.459334 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-dc750f27-d0c7-4ab0-bd7a-1fc07c3d7565 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:04.503063 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Pushing event updated for resources: {'Port': ['ID=e13a1db6-df45-45c7-a102-bed3e3054729,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:04.519742 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-4454e041-df2b-444e-a4ab-bfe9ef6e4a7a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:04.534253 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.344s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:04.547984 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-4454e041-df2b-444e-a4ab-bfe9ef6e4a7a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:04.750897 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-4454e041-df2b-444e-a4ab-bfe9ef6e4a7a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:04.754759 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:04.765736 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4454e041-df2b-444e-a4ab-bfe9ef6e4a7a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a6621f7d-1ddc-49d8-8492-10c1743a476c,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:04.769552 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-4454e041-df2b-444e-a4ab-bfe9ef6e4a7a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:04.777878 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-4454e041-df2b-444e-a4ab-bfe9ef6e4a7a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:04.781740 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-4454e041-df2b-444e-a4ab-bfe9ef6e4a7a admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/a6621f7d-1ddc-49d8-8492-10c1743a476c HTTP/1.1" status: 204  len: 168 time: 0.3325768
Jun 03 08:32:04.871371 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:04.933543 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:05.235463 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-509376ae-8811-421b-8f6e-a3a1a1e5d06d req-3839cc42-a79f-455a-97ad-9d3318c9bd89 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:05.238687 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-509376ae-8811-421b-8f6e-a3a1a1e5d06d req-3839cc42-a79f-455a-97ad-9d3318c9bd89 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=1b72c068-99c2-4781-ad52-9c9c159b37ec HTTP/1.1" status: 200  len: 943 time: 0.1500487
Jun 03 08:32:05.297464 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-509376ae-8811-421b-8f6e-a3a1a1e5d06d req-e8535250-d6d4-4caf-94c1-1275a8e65f7b tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0480561
Jun 03 08:32:05.327408 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-00a8b38e-0c1b-492f-8b52-b92f375276ef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:05.373041 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-16388099', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-16327774'] for router, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:05.667673 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device a309b335-7644-4c59-8d6b-90e763827a25 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:32:05.708451 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 48306) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:05.728750 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-4268e012-54da-4e8f-95f8-82c54fef205e admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:05.743936 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-4268e012-54da-4e8f-95f8-82c54fef205e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:05.748188 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-4268e012-54da-4e8f-95f8-82c54fef205e admin admin] Usage tracker for resource:security_group_rule and tenant:1686d81a60094948b87dda4755dd318b is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:05.751323 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-4268e012-54da-4e8f-95f8-82c54fef205e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:05.757126 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-4268e012-54da-4e8f-95f8-82c54fef205e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:05.760820 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Router 195a7c09-ac04-4351-bdeb-7bc97d7d574d is scheduled to L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 with binding_index 1 {{(pid=92323) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 03 08:32:05.808479 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port a309b335-7644-4c59-8d6b-90e763827a25, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=a309b335-7644-4c59-8d6b-90e763827a25,segment=NetworkSegment(9923ac74-9556-45ec-9044-43728d2a8ec3),segment_id=9923ac74-9556-45ec-9044-43728d2a8ec3)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:32:05.823731 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': 'a309b335-7644-4c59-8d6b-90e763827a25', 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4', 'port_id': 'a309b335-7644-4c59-8d6b-90e763827a25', 'mac_address': 'fa:16:3e:0d:8a:bb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 511, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5f3b55e2-964f-4ce8-9d71-3ac11dc6ebf1', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:32:05.854291 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-4268e012-54da-4e8f-95f8-82c54fef205e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:05.883768 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:05.901170 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a309b335-7644-4c59-8d6b-90e763827a25 {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:32:05.918008 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port a309b335-7644-4c59-8d6b-90e763827a25, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=a309b335-7644-4c59-8d6b-90e763827a25,segment=NetworkSegment(9923ac74-9556-45ec-9044-43728d2a8ec3),segment_id=9923ac74-9556-45ec-9044-43728d2a8ec3)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:32:05.959333 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:32:05.968503 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] Sync routers for ids ['195a7c09-ac04-4351-bdeb-7bc97d7d574d'] in dv-cinder-787262-5-iscsi {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:32:05.980236 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] Routers {'195a7c09-ac04-4351-bdeb-7bc97d7d574d'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:32:05.981207 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86dd66a0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:32:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['195a7c09-ac04-4351-bdeb-7bc97d7d574d'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:32:05.984636 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-4268e012-54da-4e8f-95f8-82c54fef205e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:06.013482 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e0919908-1da6-48bb-868c-7eb21e34a12e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:06.043984 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-4268e012-54da-4e8f-95f8-82c54fef205e admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=1686d81a60094948b87dda4755dd318b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3318686
Jun 03 08:32:06.044546 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 48310) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:06.061001 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4268e012-54da-4e8f-95f8-82c54fef205e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0b71892f-8eb6-49d6-9056-908d3beb9d21,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:06.068696 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-4268e012-54da-4e8f-95f8-82c54fef205e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:06.093682 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:06.095602 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:06.131257 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Notify callbacks [] for router, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:06.140480 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201  len: 930 time: 3.7233064
Jun 03 08:32:06.141658 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 48318) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:06.151839 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1783dfc4-c4b9-434c-b6dd-823602125a23 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:06.188253 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=a309b335-7644-4c59-8d6b-90e763827a25,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:06.196724 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:06.197339 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:06.197830 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:06.198312 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:06.198854 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:06.199341 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:06.199821 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:06.200298 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:06.200797 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:06.201310 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:06.202091 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:06.202683 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:06.212850 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:06.222124 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1783dfc4-c4b9-434c-b6dd-823602125a23 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:06.280680 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] Set router 195a7c09-ac04-4351-bdeb-7bc97d7d574d gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:32:06.305559 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:06.376007 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['a309b335-7644-4c59-8d6b-90e763827a25'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:32:06.471312 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1783dfc4-c4b9-434c-b6dd-823602125a23 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:06.477755 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-a79a0304-261f-4d16-b382-793f46687b81 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:06.491348 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1783dfc4-c4b9-434c-b6dd-823602125a23 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0b71892f-8eb6-49d6-9056-908d3beb9d21,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:06.495862 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-1783dfc4-c4b9-434c-b6dd-823602125a23 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:06.499960 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1783dfc4-c4b9-434c-b6dd-823602125a23 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:06.501069 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-1783dfc4-c4b9-434c-b6dd-823602125a23 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/0b71892f-8eb6-49d6-9056-908d3beb9d21 HTTP/1.1" status: 204  len: 168 time: 0.4551904
Jun 03 08:32:06.688216 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86dd66a0>, [{'id': '195a7c09-ac04-4351-bdeb-7bc97d7d574d', 'name': 'tempest-ServerRescueNegativeTestJSON-1863482925-router', 'tenant_id': 'b9cf7834ca79439981d1f8e77b89daed', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.52'}], 'enable_snat': True}, 'gw_port_id': 'e13a1db6-df45-45c7-a102-bed3e3054729', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:02Z', 'updated_at': '2021-06-03T08:32:04Z', 'revision_number': 3, 'project_id': 'b9cf7834ca79439981d1f8e77b89daed', 'gw_port': {'id': 'e13a1db6-df45-45c7-a102-bed3e3054729', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:11:f9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '195a7c09-ac04-4351-bdeb-7bc97d7d574d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 234, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:03Z', 'updated_at': '2021-06-03T08:32:03Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:32:06.692728 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] Checking router: 195a7c09-ac04-4351-bdeb-7bc97d7d574d for host: dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:32:06.693369 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] Updating router 195a7c09-ac04-4351-bdeb-7bc97d7d574d port e13a1db6-df45-45c7-a102-bed3e3054729 binding host dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 03 08:32:06.751649 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:07.026427 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-362d694d-aa92-476e-b22e-4308cd2a7bc3 req-284dd61d-e202-40d3-8349-b7b3d08729cc tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:07.027854 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-362d694d-aa92-476e-b22e-4308cd2a7bc3 req-284dd61d-e202-40d3-8349-b7b3d08729cc tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=1b72c068-99c2-4781-ad52-9c9c159b37ec HTTP/1.1" status: 200  len: 944 time: 0.4073679
Jun 03 08:32:07.141962 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] Notify callbacks [] for port, precommit_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:07.155901 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.provisioning_blocks [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] Transition to ACTIVE for port object e13a1db6-df45-45c7-a102-bed3e3054729 will not be triggered until provisioned by entity L2. {{(pid=92326) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:32:07.160826 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-362d694d-aa92-476e-b22e-4308cd2a7bc3 req-e564c57d-9ed0-4f4e-b0b6-0941ba9b6cdb tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1236651
Jun 03 08:32:07.311014 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:07.315214 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:07.357293 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:07.422323 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bce8eae0-16f6-4ddd-9809-76c8dc5e970d None None] Pushing event updated for resources: {'Port': ['ID=e13a1db6-df45-45c7-a102-bed3e3054729,revision_number=2']} {{(pid=92326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:07.438331 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce8eae0-16f6-4ddd-9809-76c8dc5e970d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:07.438905 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce8eae0-16f6-4ddd-9809-76c8dc5e970d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:07.439476 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce8eae0-16f6-4ddd-9809-76c8dc5e970d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:07.440017 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce8eae0-16f6-4ddd-9809-76c8dc5e970d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:07.440522 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce8eae0-16f6-4ddd-9809-76c8dc5e970d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:07.444712 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce8eae0-16f6-4ddd-9809-76c8dc5e970d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:07.444712 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce8eae0-16f6-4ddd-9809-76c8dc5e970d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:07.444712 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce8eae0-16f6-4ddd-9809-76c8dc5e970d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:07.444712 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce8eae0-16f6-4ddd-9809-76c8dc5e970d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:07.444712 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce8eae0-16f6-4ddd-9809-76c8dc5e970d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:07.444712 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce8eae0-16f6-4ddd-9809-76c8dc5e970d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:07.444712 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce8eae0-16f6-4ddd-9809-76c8dc5e970d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:07.456121 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-bce8eae0-16f6-4ddd-9809-76c8dc5e970d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:07.457245 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] Attempting to bind port e13a1db6-df45-45c7-a102-bed3e3054729 on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:32:07.457866 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] Attempting to bind port e13a1db6-df45-45c7-a102-bed3e3054729 by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}] {{(pid=92326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:32:07.458563 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] Attempting to bind port e13a1db6-df45-45c7-a102-bed3e3054729 on network 684ef871-89aa-450d-ae0d-e232bfaf51fb {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:32:07.465516 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 32, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:32:07.465896 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] Checking segment: {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92326) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:32:07.466357 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:07.466732 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] Bound using segment: {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'} {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:32:07.467264 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] Bound port: e13a1db6-df45-45c7-a102-bed3e3054729, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}}] {{(pid=92326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:32:07.467641 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:07.552518 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.db [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] For port e13a1db6-df45-45c7-a102-bed3e3054729, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92326) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:32:07.556095 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.db [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] For port e13a1db6-df45-45c7-a102-bed3e3054729, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=e13a1db6-df45-45c7-a102-bed3e3054729,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92326) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:32:07.605569 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] Allocated IP 172.20.0.1 (6861b4db-6cd2-4a5b-bf02-87826345c933/0ea4966f-f9de-4d69-a774-7746b1ee12ee/4bcbfa9c-b0be-4036-a7ea-53eec8e82b52) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:32:07.678312 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device a309b335-7644-4c59-8d6b-90e763827a25 up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:32:07.721346 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:07.738606 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-f4606a4e-37e4-4641-88dd-ceff1af5ca43 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:07.772204 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:07.828237 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] Routers {'195a7c09-ac04-4351-bdeb-7bc97d7d574d'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:32:07.828878 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86dd66a0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:32:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['195a7c09-ac04-4351-bdeb-7bc97d7d574d'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:32:07.870333 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning for port a309b335-7644-4c59-8d6b-90e763827a25 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:32:07.875827 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port a309b335-7644-4c59-8d6b-90e763827a25 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:32:07.876286 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:07.909003 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bce8eae0-16f6-4ddd-9809-76c8dc5e970d None None] Pushing event updated for resources: {'Port': ['ID=e13a1db6-df45-45c7-a102-bed3e3054729,revision_number=3']} {{(pid=92326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:07.920770 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-bce8eae0-16f6-4ddd-9809-76c8dc5e970d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.192s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:08.020131 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:08.032605 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] Set router 195a7c09-ac04-4351-bdeb-7bc97d7d574d gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:32:08.047130 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:08.052085 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-9fb28111-39ee-47c2-becf-1535c92934ee tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:08.053710 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1b72c068-99c2-4781-ad52-9c9c159b37ec', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a309b335-7644-4c59-8d6b-90e763827a25'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:32:08.056725 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b247936e-c0e4-4d59-92d1-04e0dbd72834" -d '{"events": [{"server_uuid": "1b72c068-99c2-4781-ad52-9c9c159b37ec", "name": "network-vif-plugged", "status": "completed", "tag": "a309b335-7644-4c59-8d6b-90e763827a25"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:32:08.068265 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port a309b335-7644-4c59-8d6b-90e763827a25, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=a309b335-7644-4c59-8d6b-90e763827a25,segment=NetworkSegment(9923ac74-9556-45ec-9044-43728d2a8ec3),segment_id=9923ac74-9556-45ec-9044-43728d2a8ec3)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:32:08.104647 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:32:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b773fd81-b7f3-45cd-ad96-9181136ece08 x-openstack-request-id: req-b773fd81-b7f3-45cd-ad96-9181136ece08 {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:32:08.104986 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1b72c068-99c2-4781-ad52-9c9c159b37ec", "name": "network-vif-plugged", "status": "completed", "tag": "a309b335-7644-4c59-8d6b-90e763827a25", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:32:08.105443 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-b773fd81-b7f3-45cd-ad96-9181136ece08 {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:32:08.105985 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1b72c068-99c2-4781-ad52-9c9c159b37ec', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a309b335-7644-4c59-8d6b-90e763827a25', 'code': 200}
Jun 03 08:32:08.121625 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] Network 6861b4db-6cd2-4a5b-bf02-87826345c933 is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:32:08.125045 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:32:08.129279 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:32:08.129754 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-16328800'] for router_interface, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:08.141810 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] Pushing event updated for resources: {'Port': ['ID=4bcbfa9c-b0be-4036-a7ea-53eec8e82b52,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:08.151411 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:08.292241 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:08.293365 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:08.295527 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:08.403430 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=a309b335-7644-4c59-8d6b-90e763827a25,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:08.415949 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:08.427958 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a21fae8f-638e-471e-8052-08db24d1d63b req-18d5ff64-81eb-4c39-a175-b9649e1e0eaa tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:08.429658 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a21fae8f-638e-471e-8052-08db24d1d63b req-18d5ff64-81eb-4c39-a175-b9649e1e0eaa tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=1b72c068-99c2-4781-ad52-9c9c159b37ec HTTP/1.1" status: 200  len: 945 time: 0.1057906
Jun 03 08:32:08.490311 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a21fae8f-638e-471e-8052-08db24d1d63b req-a1490042-832f-4491-91aa-a54201d77a92 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0525622
Jun 03 08:32:08.520177 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86dd66a0>, [{'id': '195a7c09-ac04-4351-bdeb-7bc97d7d574d', 'name': 'tempest-ServerRescueNegativeTestJSON-1863482925-router', 'tenant_id': 'b9cf7834ca79439981d1f8e77b89daed', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.52'}], 'enable_snat': True}, 'gw_port_id': 'e13a1db6-df45-45c7-a102-bed3e3054729', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:02Z', 'updated_at': '2021-06-03T08:32:04Z', 'revision_number': 3, 'project_id': 'b9cf7834ca79439981d1f8e77b89daed', 'gw_port': {'id': 'e13a1db6-df45-45c7-a102-bed3e3054729', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:11:f9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '195a7c09-ac04-4351-bdeb-7bc97d7d574d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 234, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:03Z', 'updated_at': '2021-06-03T08:32:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:32:08.527701 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5be7c9c-4d93-4865-b9e1-76e5a8b43fcd None None] The sync data for ids ['195a7c09-ac04-4351-bdeb-7bc97d7d574d'] in dv-cinder-787262-5-iscsi is: [{'id': '195a7c09-ac04-4351-bdeb-7bc97d7d574d', 'name': 'tempest-ServerRescueNegativeTestJSON-1863482925-router', 'tenant_id': 'b9cf7834ca79439981d1f8e77b89daed', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.52'}], 'enable_snat': True}, 'gw_port_id': 'e13a1db6-df45-45c7-a102-bed3e3054729', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:02Z', 'updated_at': '2021-06-03T08:32:04Z', 'revision_number': 3, 'project_id': 'b9cf7834ca79439981d1f8e77b89daed', 'gw_port': {'id': 'e13a1db6-df45-45c7-a102-bed3e3054729', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:11:f9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '195a7c09-ac04-4351-bdeb-7bc97d7d574d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 234, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:03Z', 'updated_at': '2021-06-03T08:32:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}] {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:32:08.579168 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:08.725452 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 48392) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:08.870933 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-125ec331-2899-4ce2-9a2b-caf4d11b7b37 req-946d6d8d-0299-44b6-8605-a8b0458b4fbf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:08.873952 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-125ec331-2899-4ce2-9a2b-caf4d11b7b37 req-946d6d8d-0299-44b6-8605-a8b0458b4fbf service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=1b72c068-99c2-4781-ad52-9c9c159b37ec HTTP/1.1" status: 200  len: 1098 time: 0.1412237
Jun 03 08:32:09.058614 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4c6a2c7b-08af-4c80-99a4-39b1b30aa090 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:09.074675 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-125ec331-2899-4ce2-9a2b-caf4d11b7b37 req-4a85cf71-384a-459b-a36e-a072bb196233 service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1919441
Jun 03 08:32:09.088758 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-4c6a2c7b-08af-4c80-99a4-39b1b30aa090 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:09.097272 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-4c6a2c7b-08af-4c80-99a4-39b1b30aa090 admin admin] Usage tracker for resource:security_group_rule and tenant:c9df7983bd8a4bd19be5951496f4644c is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:09.125510 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-4c6a2c7b-08af-4c80-99a4-39b1b30aa090 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:09.139924 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-4c6a2c7b-08af-4c80-99a4-39b1b30aa090 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:09.210831 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:09.279378 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4c6a2c7b-08af-4c80-99a4-39b1b30aa090 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:09.293979 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:09.295274 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-16344774', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-16328707'] for router_interface, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:09.303278 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:09.411048 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4c6a2c7b-08af-4c80-99a4-39b1b30aa090 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:09.624219 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] Pushing event updated for resources: {'Port': ['ID=4bcbfa9c-b0be-4036-a7ea-53eec8e82b52,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:09.631248 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.328s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:09.631902 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c79cd8ab-4844-4080-bf1a-ce5e54b3dbcb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.049s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:09.649262 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-4c6a2c7b-08af-4c80-99a4-39b1b30aa090 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=c9df7983bd8a4bd19be5951496f4644c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9194381
Jun 03 08:32:09.655407 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 48436) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:09.712873 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c6a2c7b-08af-4c80-99a4-39b1b30aa090 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cc9e5c03-1bf3-45ea-8e10-bd06a798158a,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:09.722866 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-4c6a2c7b-08af-4c80-99a4-39b1b30aa090 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:09.761010 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] Network 6861b4db-6cd2-4a5b-bf02-87826345c933 is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:32:09.764436 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:32:09.776433 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf201d3a-b8e6-4e29-9732-5d6b926d1234 req-4b27b066-47bd-4c70-b3bd-ebf0f235ef08 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:09.781070 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-cf201d3a-b8e6-4e29-9732-5d6b926d1234 req-4b27b066-47bd-4c70-b3bd-ebf0f235ef08 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=1b72c068-99c2-4781-ad52-9c9c159b37ec HTTP/1.1" status: 200  len: 945 time: 0.1571562
Jun 03 08:32:09.865684 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-cf201d3a-b8e6-4e29-9732-5d6b926d1234 req-3fbbbb0e-465f-4801-94f6-ec01e9f4565a tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0761259
Jun 03 08:32:09.900829 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-87c44f03-016e-4b07-9f32-4273747eed7b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:09.987181 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device e13a1db6-df45-45c7-a102-bed3e3054729 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:32:10.001854 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-87c44f03-016e-4b07-9f32-4273747eed7b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:10.082482 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] Router 195a7c09-ac04-4351-bdeb-7bc97d7d574d has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:32:10.225087 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port e13a1db6-df45-45c7-a102-bed3e3054729 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:32:10.244491 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port e13a1db6-df45-45c7-a102-bed3e3054729 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:32:10.245460 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:10.274895 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-87c44f03-016e-4b07-9f32-4273747eed7b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:10.306765 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:10.311946 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87c44f03-016e-4b07-9f32-4273747eed7b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc9e5c03-1bf3-45ea-8e10-bd06a798158a,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:10.319317 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-87c44f03-016e-4b07-9f32-4273747eed7b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:10.330423 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:32:10.669092 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-87c44f03-016e-4b07-9f32-4273747eed7b admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:10.669092 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-87c44f03-016e-4b07-9f32-4273747eed7b admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/cc9e5c03-1bf3-45ea-8e10-bd06a798158a HTTP/1.1" status: 204  len: 168 time: 0.6867146
Jun 03 08:32:10.669092 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] 10.222.0.11 "PUT /v2.0/routers/195a7c09-ac04-4351-bdeb-7bc97d7d574d/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.2042055
Jun 03 08:32:10.672821 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:10.672821 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port e13a1db6-df45-45c7-a102-bed3e3054729, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=e13a1db6-df45-45c7-a102-bed3e3054729,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:32:10.693341 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] Sync routers for ids ['195a7c09-ac04-4351-bdeb-7bc97d7d574d'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:32:10.707382 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] Routers {'195a7c09-ac04-4351-bdeb-7bc97d7d574d'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:32:10.724351 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae870fd160>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:32:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['195a7c09-ac04-4351-bdeb-7bc97d7d574d'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:32:10.939549 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:10.951158 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:11.049032 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] Set router 195a7c09-ac04-4351-bdeb-7bc97d7d574d gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:32:11.091571 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=e13a1db6-df45-45c7-a102-bed3e3054729,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:11.108532 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:11.109437 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-193d8af2-e50b-490f-b20d-91fd1aba4aee req-c994d5fb-fcca-4127-a15c-82f600be8ee7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:11.111567 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-193d8af2-e50b-490f-b20d-91fd1aba4aee req-c994d5fb-fcca-4127-a15c-82f600be8ee7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=1b72c068-99c2-4781-ad52-9c9c159b37ec HTTP/1.1" status: 200  len: 945 time: 0.0920746
Jun 03 08:32:11.153475 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-75498b67-7f56-4c0a-9f23-da044c638b26 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:11.154976 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-75498b67-7f56-4c0a-9f23-da044c638b26 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/networks?id=6861b4db-6cd2-4a5b-bf02-87826345c933 HTTP/1.1" status: 200  len: 819 time: 0.2307420
Jun 03 08:32:11.178472 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-9b71c695-edc2-45e6-9445-f65d3748fbcf tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/quotas/b9cf7834ca79439981d1f8e77b89daed HTTP/1.1" status: 200  len: 375 time: 0.0170870
Jun 03 08:32:11.178900 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-193d8af2-e50b-490f-b20d-91fd1aba4aee req-1156d076-0ba0-4052-b264-81860af08343 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0583446
Jun 03 08:32:11.265357 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-03cbf21c-d0db-46c5-8765-2f51dd9dd00d tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Synchronizing usage tracker for tenant:b9cf7834ca79439981d1f8e77b89daed on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:32:11.413488 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-03cbf21c-d0db-46c5-8765-2f51dd9dd00d tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Unset dirty status for tenant:b9cf7834ca79439981d1f8e77b89daed on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:32:11.418919 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-03cbf21c-d0db-46c5-8765-2f51dd9dd00d tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=b9cf7834ca79439981d1f8e77b89daed&fields=id HTTP/1.1" status: 200  len: 255 time: 0.2335823
Jun 03 08:32:11.431449 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae870fd160>, [{'id': '195a7c09-ac04-4351-bdeb-7bc97d7d574d', 'name': 'tempest-ServerRescueNegativeTestJSON-1863482925-router', 'tenant_id': 'b9cf7834ca79439981d1f8e77b89daed', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.52'}], 'enable_snat': True}, 'gw_port_id': 'e13a1db6-df45-45c7-a102-bed3e3054729', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:02Z', 'updated_at': '2021-06-03T08:32:08Z', 'revision_number': 4, 'project_id': 'b9cf7834ca79439981d1f8e77b89daed', 'gw_port': {'id': 'e13a1db6-df45-45c7-a102-bed3e3054729', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:11:f9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '195a7c09-ac04-4351-bdeb-7bc97d7d574d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 234, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:03Z', 'updated_at': '2021-06-03T08:32:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '4bcbfa9c-b0be-4036-a7ea-53eec8e82b52', 'name': '', 'network_id': '6861b4db-6cd2-4a5b-bf02-87826345c933', 'tenant_id': 'b9cf7834ca79439981d1f8e77b89daed', 'mac_address': 'fa:16:3e:58:63:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '195a7c09-ac04-4351-bdeb-7bc97d7d574d', 'device_owner': 'network:router_interface', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': '0ea4966f-f9de-4d69-a774-7746b1ee12ee', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:07Z', 'updated_at': '2021-06-03T08:32:08Z', 'revision_number': 2, 'project_id': 'b9cf7834ca79439981d1f8e77b89daed', 'subnets': [{'id': '0ea4966f-f9de-4d69-a774-7746b1ee12ee', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:32:11.436877 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] Checking router: 195a7c09-ac04-4351-bdeb-7bc97d7d574d for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:32:11.438072 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] Updating router 195a7c09-ac04-4351-bdeb-7bc97d7d574d port 4bcbfa9c-b0be-4036-a7ea-53eec8e82b52 binding host dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 03 08:32:11.500059 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:11.568417 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-3dc3f7d1-a121-4af7-bca7-4bc5ec174cbf service neutron] 10.222.0.11 "GET /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1452882
Jun 03 08:32:11.732303 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-488c4443-6b78-4497-9115-3f314fbb33df service neutron] 10.222.0.11 "GET /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1625867
Jun 03 08:32:11.877350 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device e13a1db6-df45-45c7-a102-bed3e3054729 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:32:12.017919 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 48500) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:12.043350 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port e13a1db6-df45-45c7-a102-bed3e3054729 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:32:12.043995 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:12.077839 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f062e2a0-2f4e-46e5-a97b-98c38b489eb4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:12.141865 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] Notify callbacks [] for port, precommit_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:12.148934 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-f062e2a0-2f4e-46e5-a97b-98c38b489eb4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:12.161233 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-f062e2a0-2f4e-46e5-a97b-98c38b489eb4 admin admin] Usage tracker for resource:security_group_rule and tenant:2b0b2b431c3e4355bf653cb4fc453590 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:12.167298 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-f062e2a0-2f4e-46e5-a97b-98c38b489eb4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:12.177201 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-f062e2a0-2f4e-46e5-a97b-98c38b489eb4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:12.179962 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] Transition to ACTIVE for port object 4bcbfa9c-b0be-4036-a7ea-53eec8e82b52 will not be triggered until provisioned by entity L2. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:32:12.301482 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:12.314043 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-9aa17e64-7bdc-403f-a2a6-15165334ff3e req-9ca3f95d-c55b-457c-a12c-56c4e1c542e0 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 210 time: 0.1609149
Jun 03 08:32:12.327608 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:12.349624 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f062e2a0-2f4e-46e5-a97b-98c38b489eb4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:12.442087 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f062e2a0-2f4e-46e5-a97b-98c38b489eb4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:12.462735 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:12.547306 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f062e2a0-2f4e-46e5-a97b-98c38b489eb4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3173c0e6-50d9-4433-aed5-380c9a16a7f3,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:12.570575 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-f062e2a0-2f4e-46e5-a97b-98c38b489eb4 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=2b0b2b431c3e4355bf653cb4fc453590&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5485425
Jun 03 08:32:12.571719 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 48522) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:12.581675 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f062e2a0-2f4e-46e5-a97b-98c38b489eb4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:12.622918 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20577996-cc94-44e8-8114-647485d5ac28 None None] Pushing event updated for resources: {'Port': ['ID=4bcbfa9c-b0be-4036-a7ea-53eec8e82b52,revision_number=3']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:12.626351 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-20577996-cc94-44e8-8114-647485d5ac28 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.299s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:12.704420 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-41186bd6-ec3b-44b0-95f6-19b18eb85b6a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:12.742262 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] Attempting to bind port 4bcbfa9c-b0be-4036-a7ea-53eec8e82b52 on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:32:12.743025 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] Attempting to bind port 4bcbfa9c-b0be-4036-a7ea-53eec8e82b52 by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '1b8fb38d-ade8-4355-bd2b-f2b171f31184', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 518, 'network_id': '6861b4db-6cd2-4a5b-bf02-87826345c933'}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:32:12.743571 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] Attempting to bind port 4bcbfa9c-b0be-4036-a7ea-53eec8e82b52 on network 6861b4db-6cd2-4a5b-bf02-87826345c933 {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:32:12.750354 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 32, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:32:12.751075 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] Checking segment: {'id': '1b8fb38d-ade8-4355-bd2b-f2b171f31184', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 518, 'network_id': '6861b4db-6cd2-4a5b-bf02-87826345c933'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:32:12.751481 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:12.751976 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] Bound using segment: {'id': '1b8fb38d-ade8-4355-bd2b-f2b171f31184', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 518, 'network_id': '6861b4db-6cd2-4a5b-bf02-87826345c933'} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:32:12.752420 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] Bound port: 4bcbfa9c-b0be-4036-a7ea-53eec8e82b52, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1b8fb38d-ade8-4355-bd2b-f2b171f31184', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 518, 'network_id': '6861b4db-6cd2-4a5b-bf02-87826345c933'}}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:32:12.752812 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:12.788524 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-41186bd6-ec3b-44b0-95f6-19b18eb85b6a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:12.839068 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 48544) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:12.861552 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] For port 4bcbfa9c-b0be-4036-a7ea-53eec8e82b52, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:32:12.866305 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] For port 4bcbfa9c-b0be-4036-a7ea-53eec8e82b52, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=4bcbfa9c-b0be-4036-a7ea-53eec8e82b52,segment=NetworkSegment(1b8fb38d-ade8-4355-bd2b-f2b171f31184),segment_id=1b8fb38d-ade8-4355-bd2b-f2b171f31184)] {{(pid=92325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:32:12.983339 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-17caceba-6077-4742-a561-8c6c36b98e77 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:13.000459 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-17caceba-6077-4742-a561-8c6c36b98e77 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:13.004717 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-17caceba-6077-4742-a561-8c6c36b98e77 admin admin] Usage tracker for resource:security_group_rule and tenant:4f66e59beefc481d8f4bb724f8225e31 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:13.008857 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-17caceba-6077-4742-a561-8c6c36b98e77 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:13.015161 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-17caceba-6077-4742-a561-8c6c36b98e77 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:13.024519 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:13.029763 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:13.032586 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-8defb4ba-cb9d-41c6-9eec-bd67c0167ea3 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:13.033253 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-8defb4ba-cb9d-41c6-9eec-bd67c0167ea3 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Synchronizing usage tracker for tenant:b9cf7834ca79439981d1f8e77b89daed on resource:network {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:32:13.135365 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-17caceba-6077-4742-a561-8c6c36b98e77 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:13.142695 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] Routers {'195a7c09-ac04-4351-bdeb-7bc97d7d574d'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:32:13.142695 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae870fd160>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:32:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['195a7c09-ac04-4351-bdeb-7bc97d7d574d'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:32:13.220492 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-41186bd6-ec3b-44b0-95f6-19b18eb85b6a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:13.223689 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20577996-cc94-44e8-8114-647485d5ac28 None None] Pushing event updated for resources: {'Port': ['ID=4bcbfa9c-b0be-4036-a7ea-53eec8e82b52,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:13.228290 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-8defb4ba-cb9d-41c6-9eec-bd67c0167ea3 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Unset dirty status for tenant:b9cf7834ca79439981d1f8e77b89daed on resource:network {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:32:13.236278 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-20577996-cc94-44e8-8114-647485d5ac28 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.206s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:13.244020 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-8defb4ba-cb9d-41c6-9eec-bd67c0167ea3 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/networks?id=6861b4db-6cd2-4a5b-bf02-87826345c933 HTTP/1.1" status: 200  len: 819 time: 0.5245948
Jun 03 08:32:13.246676 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-1bdba9a0-0892-4a29-a3d5-db8583dbdf92 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:13.250224 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-17caceba-6077-4742-a561-8c6c36b98e77 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:13.261121 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:13.286657 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41186bd6-ec3b-44b0-95f6-19b18eb85b6a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3173c0e6-50d9-4433-aed5-380c9a16a7f3,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:13.291634 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-41186bd6-ec3b-44b0-95f6-19b18eb85b6a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:13.309508 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-17caceba-6077-4742-a561-8c6c36b98e77 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=4f66e59beefc481d8f4bb724f8225e31&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4687095
Jun 03 08:32:13.310540 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 48556) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:13.310719 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-a02fc520-0413-412a-9166-dee0049d603e tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/quotas/b9cf7834ca79439981d1f8e77b89daed HTTP/1.1" status: 200  len: 375 time: 0.0506189
Jun 03 08:32:13.311527 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17caceba-6077-4742-a561-8c6c36b98e77 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a22767d8-d117-485b-8ca1-1c786adda2ca,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:13.313529 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-41186bd6-ec3b-44b0-95f6-19b18eb85b6a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:13.314633 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-41186bd6-ec3b-44b0-95f6-19b18eb85b6a admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/3173c0e6-50d9-4433-aed5-380c9a16a7f3 HTTP/1.1" status: 204  len: 168 time: 0.7415099
Jun 03 08:32:13.331020 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-17caceba-6077-4742-a561-8c6c36b98e77 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:13.413207 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7e214a40-0b4a-4256-8ff4-5db1c9f1162a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:13.471860 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] Set router 195a7c09-ac04-4351-bdeb-7bc97d7d574d gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:32:13.477772 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7e214a40-0b4a-4256-8ff4-5db1c9f1162a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:13.501232 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-3a26cbc9-31d8-4474-9bc6-559840acfab5 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=b9cf7834ca79439981d1f8e77b89daed&fields=id HTTP/1.1" status: 200  len: 255 time: 0.1895475
Jun 03 08:32:13.653692 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7e214a40-0b4a-4256-8ff4-5db1c9f1162a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:13.665660 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:13.712807 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e214a40-0b4a-4256-8ff4-5db1c9f1162a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a22767d8-d117-485b-8ca1-1c786adda2ca,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:13.720795 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-7e214a40-0b4a-4256-8ff4-5db1c9f1162a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:13.727174 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7e214a40-0b4a-4256-8ff4-5db1c9f1162a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:13.730592 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-7e214a40-0b4a-4256-8ff4-5db1c9f1162a admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/a22767d8-d117-485b-8ca1-1c786adda2ca HTTP/1.1" status: 204  len: 168 time: 0.4136355
Jun 03 08:32:13.812310 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-78611070-bddb-4d31-81dd-eef97b7a3a03 service neutron] 10.222.0.11 "GET /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3089194
Jun 03 08:32:13.921904 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae870fd160>, [{'id': '195a7c09-ac04-4351-bdeb-7bc97d7d574d', 'name': 'tempest-ServerRescueNegativeTestJSON-1863482925-router', 'tenant_id': 'b9cf7834ca79439981d1f8e77b89daed', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.52'}], 'enable_snat': True}, 'gw_port_id': 'e13a1db6-df45-45c7-a102-bed3e3054729', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:02Z', 'updated_at': '2021-06-03T08:32:08Z', 'revision_number': 4, 'project_id': 'b9cf7834ca79439981d1f8e77b89daed', 'gw_port': {'id': 'e13a1db6-df45-45c7-a102-bed3e3054729', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:11:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '195a7c09-ac04-4351-bdeb-7bc97d7d574d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 234, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:03Z', 'updated_at': '2021-06-03T08:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '4bcbfa9c-b0be-4036-a7ea-53eec8e82b52', 'name': '', 'network_id': '6861b4db-6cd2-4a5b-bf02-87826345c933', 'tenant_id': 'b9cf7834ca79439981d1f8e77b89daed', 'mac_address': 'fa:16:3e:58:63:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '195a7c09-ac04-4351-bdeb-7bc97d7d574d', 'device_owner': 'network:router_interface', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': '0ea4966f-f9de-4d69-a774-7746b1ee12ee', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:07Z', 'updated_at': '2021-06-03T08:32:12Z', 'revision_number': 4, 'project_id': 'b9cf7834ca79439981d1f8e77b89daed', 'subnets': [{'id': '0ea4966f-f9de-4d69-a774-7746b1ee12ee', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:32:13.926091 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4045a03e-5cab-4ec5-8fc7-5318e65488a8 None None] The sync data for ids ['195a7c09-ac04-4351-bdeb-7bc97d7d574d'] in dv-cinder-787262-5-iscsi is: [{'id': '195a7c09-ac04-4351-bdeb-7bc97d7d574d', 'name': 'tempest-ServerRescueNegativeTestJSON-1863482925-router', 'tenant_id': 'b9cf7834ca79439981d1f8e77b89daed', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.52'}], 'enable_snat': True}, 'gw_port_id': 'e13a1db6-df45-45c7-a102-bed3e3054729', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:02Z', 'updated_at': '2021-06-03T08:32:08Z', 'revision_number': 4, 'project_id': 'b9cf7834ca79439981d1f8e77b89daed', 'gw_port': {'id': 'e13a1db6-df45-45c7-a102-bed3e3054729', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:11:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '195a7c09-ac04-4351-bdeb-7bc97d7d574d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 234, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:03Z', 'updated_at': '2021-06-03T08:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '4bcbfa9c-b0be-4036-a7ea-53eec8e82b52', 'name': '', 'network_id': '6861b4db-6cd2-4a5b-bf02-87826345c933', 'tenant_id': 'b9cf7834ca79439981d1f8e77b89daed', 'mac_address': 'fa:16:3e:58:63:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '195a7c09-ac04-4351-bdeb-7bc97d7d574d', 'device_owner': 'network:router_interface', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': '0ea4966f-f9de-4d69-a774-7746b1ee12ee', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:07Z', 'updated_at': '2021-06-03T08:32:12Z', 'revision_number': 4, 'project_id': 'b9cf7834ca79439981d1f8e77b89daed', 'subnets': [{'id': '0ea4966f-f9de-4d69-a774-7746b1ee12ee', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:32:14.058939 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-ecebe776-e7d5-470b-9009-358ff3baddb9 service neutron] 10.222.0.11 "GET /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2418790
Jun 03 08:32:14.487960 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1b481b72-e04e-4734-9374-412f464fb23e req-0996eee7-a095-43c1-8bd0-ff91dbd03281 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 210 time: 0.0970640
Jun 03 08:32:14.609599 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 48600) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:14.618726 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-bd495bda-dc24-463f-b85f-7a38804bd9ba admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:14.635635 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-bd495bda-dc24-463f-b85f-7a38804bd9ba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:14.641264 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-bd495bda-dc24-463f-b85f-7a38804bd9ba admin admin] Usage tracker for resource:security_group_rule and tenant:50dba46086c34d149596ef11b20cbb1e is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:14.644883 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-bd495bda-dc24-463f-b85f-7a38804bd9ba admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:14.656979 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-bd495bda-dc24-463f-b85f-7a38804bd9ba admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:14.770367 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-bd495bda-dc24-463f-b85f-7a38804bd9ba admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:14.985275 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-bd495bda-dc24-463f-b85f-7a38804bd9ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:14.993596 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-41186bd6-ec3b-44b0-95f6-19b18eb85b6a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:15.046655 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-bd495bda-dc24-463f-b85f-7a38804bd9ba admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=50dba46086c34d149596ef11b20cbb1e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4500258
Jun 03 08:32:15.048230 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd495bda-dc24-463f-b85f-7a38804bd9ba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=81235f8e-a5cd-4dec-ae30-930b868d231c,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:15.049305 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 48612) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:15.051866 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-bd495bda-dc24-463f-b85f-7a38804bd9ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:15.138312 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f1702bbc-2719-4292-8c0d-88e734a49997 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:15.177550 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f1702bbc-2719-4292-8c0d-88e734a49997 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:15.403334 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f1702bbc-2719-4292-8c0d-88e734a49997 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:15.424965 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b6d3b5fe-d40e-42bc-9d5f-6898af3643cc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:15.438820 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1702bbc-2719-4292-8c0d-88e734a49997 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=81235f8e-a5cd-4dec-ae30-930b868d231c,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:15.448387 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f1702bbc-2719-4292-8c0d-88e734a49997 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:15.448847 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f1702bbc-2719-4292-8c0d-88e734a49997 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:15.450374 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-f1702bbc-2719-4292-8c0d-88e734a49997 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/81235f8e-a5cd-4dec-ae30-930b868d231c HTTP/1.1" status: 204  len: 168 time: 0.4000773
Jun 03 08:32:15.604433 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c871d5c1-32f2-4941-8c11-f1e8d648b7c9 req-d104ca46-a1b2-405f-a630-3ac40d319e42 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 210 time: 0.0521493
Jun 03 08:32:15.857374 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 4bcbfa9c-b0be-4036-a7ea-53eec8e82b52 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:32:15.996191 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port 4bcbfa9c-b0be-4036-a7ea-53eec8e82b52 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:32:16.001450 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 4bcbfa9c-b0be-4036-a7ea-53eec8e82b52 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:32:16.001922 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:16.156614 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:16.196028 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port 4bcbfa9c-b0be-4036-a7ea-53eec8e82b52, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=4bcbfa9c-b0be-4036-a7ea-53eec8e82b52,segment=NetworkSegment(1b8fb38d-ade8-4355-bd2b-f2b171f31184),segment_id=1b8fb38d-ade8-4355-bd2b-f2b171f31184)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:32:16.293693 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:16.297152 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:16.379473 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=4bcbfa9c-b0be-4036-a7ea-53eec8e82b52,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:16.382995 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:16.454353 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 48662) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:16.520701 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-75f8e263-fa2f-41f4-855c-201b1267bb88 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:16.522336 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-75f8e263-fa2f-41f4-855c-201b1267bb88 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.55 "GET /v2.0/networks?id=6861b4db-6cd2-4a5b-bf02-87826345c933 HTTP/1.1" status: 200  len: 819 time: 0.3571939
Jun 03 08:32:16.555489 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-e2fb12e7-3cf9-43ae-8a33-427283df1769 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Request body: {'port': {'device_id': 'fdc4e210-a267-4553-8e0c-701eb8001997', 'network_id': '6861b4db-6cd2-4a5b-bf02-87826345c933', 'admin_state_up': True, 'tenant_id': 'b9cf7834ca79439981d1f8e77b89daed'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:32:16.583615 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716bc020-a678-4841-af96-16af99662374 req-5791e8a8-0952-4176-889b-d4fe4f5e59fe tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:16.585187 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-716bc020-a678-4841-af96-16af99662374 req-5791e8a8-0952-4176-889b-d4fe4f5e59fe tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/networks?id=f9db9a2a-942b-4a98-97ed-1896cb9158b4 HTTP/1.1" status: 200  len: 815 time: 0.2774014
Jun 03 08:32:16.672140 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-716bc020-a678-4841-af96-16af99662374 req-6cab9999-6767-44e0-a2cd-d76072ce3ee6 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/quotas/7bac6d994f4d49b292bc39fac07c0311 HTTP/1.1" status: 200  len: 375 time: 0.0664151
Jun 03 08:32:16.779578 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-e2fb12e7-3cf9-43ae-8a33-427283df1769 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:16.797708 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-716bc020-a678-4841-af96-16af99662374 req-7afa46b0-5f2f-4cae-9714-dd75a6254ed8 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=7bac6d994f4d49b292bc39fac07c0311&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1235003
Jun 03 08:32:16.798449 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 48674) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:16.808308 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-e2fb12e7-3cf9-43ae-8a33-427283df1769 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:16.815675 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7f5b5b40-12da-4652-8245-abeabf4ec387 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:16.834208 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c168bf7f-0bbd-4560-87b4-d9179aec20c0 req-850ca412-5e6d-4749-a84d-560379283c3a tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 210 time: 0.1157422
Jun 03 08:32:16.839349 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-7f5b5b40-12da-4652-8245-abeabf4ec387 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:16.843916 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-7f5b5b40-12da-4652-8245-abeabf4ec387 admin admin] Usage tracker for resource:security_group_rule and tenant:22f57b99d9424cfd89309dd0aafec216 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:16.847712 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-7f5b5b40-12da-4652-8245-abeabf4ec387 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:16.875965 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-7f5b5b40-12da-4652-8245-abeabf4ec387 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:16.965759 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-716bc020-a678-4841-af96-16af99662374 req-b48c622d-4b3a-42eb-98b8-29cec7d03362 service neutron] 10.222.0.11 "GET /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1539285
Jun 03 08:32:16.979826 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7f5b5b40-12da-4652-8245-abeabf4ec387 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:17.015454 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-e2fb12e7-3cf9-43ae-8a33-427283df1769 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Made reservation on behalf of b9cf7834ca79439981d1f8e77b89daed for: {'port': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:32:17.018896 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-e2fb12e7-3cf9-43ae-8a33-427283df1769 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:17.089730 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 48684) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:17.115368 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-04f77f6a-307d-4525-b8fe-493f8856ae2a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:17.137592 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-04f77f6a-307d-4525-b8fe-493f8856ae2a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:17.142770 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-04f77f6a-307d-4525-b8fe-493f8856ae2a admin admin] Usage tracker for resource:security_group_rule and tenant:8b286b3cb63f4f7f979207ebe8e3bf9d is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:17.146561 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-04f77f6a-307d-4525-b8fe-493f8856ae2a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:17.153866 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-04f77f6a-307d-4525-b8fe-493f8856ae2a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:17.159864 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7f5b5b40-12da-4652-8245-abeabf4ec387 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:17.173311 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9eee7d41-2650-43c0-837a-ef2169256ce3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:17.226336 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-716bc020-a678-4841-af96-16af99662374 req-5946b99a-1541-4368-8cfc-c5a3aa00eddc service neutron] 10.222.0.11 "GET /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2484131
Jun 03 08:32:17.240273 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-7f5b5b40-12da-4652-8245-abeabf4ec387 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=22f57b99d9424cfd89309dd0aafec216&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7847097
Jun 03 08:32:17.245190 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 48690) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:17.247340 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f5b5b40-12da-4652-8245-abeabf4ec387 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c913aade-d2ea-4282-9f3e-7a1b3dacec33,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:17.269327 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-7f5b5b40-12da-4652-8245-abeabf4ec387 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:17.364849 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-e2fb12e7-3cf9-43ae-8a33-427283df1769 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Allocated IP 172.20.0.14 (6861b4db-6cd2-4a5b-bf02-87826345c933/0ea4966f-f9de-4d69-a774-7746b1ee12ee/716f2131-2965-4ead-984f-8ccfcadea071) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:32:17.370284 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-202e6673-e86c-4590-aec4-dee27d1e9d21 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:17.395615 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-04f77f6a-307d-4525-b8fe-493f8856ae2a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:17.409760 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-0a2b35e3-af11-48b6-89f7-e41d7dfa2712 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:17.413653 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-202e6673-e86c-4590-aec4-dee27d1e9d21 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:17.456500 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-0a2b35e3-af11-48b6-89f7-e41d7dfa2712 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:17.469248 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-0a2b35e3-af11-48b6-89f7-e41d7dfa2712 admin admin] Usage tracker for resource:security_group_rule and tenant:9164de6d30ac45779ba24fd81e0cf16e is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:17.474816 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-0a2b35e3-af11-48b6-89f7-e41d7dfa2712 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:17.484919 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-0a2b35e3-af11-48b6-89f7-e41d7dfa2712 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:17.597395 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-feb74bc7-03c1-4e6d-86c2-26affda83907 req-2ff0b9f5-8b90-40c4-ba2b-0c63989ad410 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 210 time: 0.0499415
Jun 03 08:32:17.606304 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-04f77f6a-307d-4525-b8fe-493f8856ae2a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:17.623243 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-72df29fc-25cc-4447-a7ec-3d9fde145373 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:17.656090 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-202e6673-e86c-4590-aec4-dee27d1e9d21 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:17.677646 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-04f77f6a-307d-4525-b8fe-493f8856ae2a admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=8b286b3cb63f4f7f979207ebe8e3bf9d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5858467
Jun 03 08:32:17.683551 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 48702) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:17.700883 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04f77f6a-307d-4525-b8fe-493f8856ae2a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2c7c01cc-8e67-4512-a9ad-5c8ed2fcd3af,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:17.707114 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-04f77f6a-307d-4525-b8fe-493f8856ae2a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:17.712984 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-0612db9d-8627-4498-95f0-99560c6d74a8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.041s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:17.727772 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-202e6673-e86c-4590-aec4-dee27d1e9d21 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c913aade-d2ea-4282-9f3e-7a1b3dacec33,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:17.729829 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-202e6673-e86c-4590-aec4-dee27d1e9d21 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:17.731309 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-202e6673-e86c-4590-aec4-dee27d1e9d21 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/c913aade-d2ea-4282-9f3e-7a1b3dacec33 HTTP/1.1" status: 204  len: 168 time: 0.4850090
Jun 03 08:32:17.740559 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-202e6673-e86c-4590-aec4-dee27d1e9d21 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:17.783894 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8d11c416-76f7-467c-b9df-b59949408b3b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:17.816949 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8d11c416-76f7-467c-b9df-b59949408b3b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:17.863489 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 4bcbfa9c-b0be-4036-a7ea-53eec8e82b52 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:32:17.971268 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 4bcbfa9c-b0be-4036-a7ea-53eec8e82b52 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:32:17.972356 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:18.057772 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-cc091c54-7f81-4d3d-8b33-aa6afb42dd6f req-efcbdef8-e745-49c0-b04e-040f66ffa5ac tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 210 time: 0.0752347
Jun 03 08:32:18.073943 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-fee684f5-b135-4f72-86cf-8c1faa032b86 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:18.075433 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-fee684f5-b135-4f72-86cf-8c1faa032b86 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.55 "GET /v2.0/networks?id=6861b4db-6cd2-4a5b-bf02-87826345c933 HTTP/1.1" status: 200  len: 819 time: 0.3873234
Jun 03 08:32:18.095291 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-f5e8e1ee-423f-4610-9fe0-3f6ba3760d38 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Request body: {'port': {'device_id': 'a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7', 'network_id': '6861b4db-6cd2-4a5b-bf02-87826345c933', 'admin_state_up': True, 'tenant_id': 'b9cf7834ca79439981d1f8e77b89daed'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:32:18.113118 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-0a2b35e3-af11-48b6-89f7-e41d7dfa2712 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:18.153674 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-e2fb12e7-3cf9-43ae-8a33-427283df1769 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:18.265049 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-f5e8e1ee-423f-4610-9fe0-3f6ba3760d38 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:18.270640 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-f5e8e1ee-423f-4610-9fe0-3f6ba3760d38 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Usage tracker for resource:port and tenant:b9cf7834ca79439981d1f8e77b89daed is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:18.275039 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-f5e8e1ee-423f-4610-9fe0-3f6ba3760d38 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Quota usage for port was recalculated. Used quota:1. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:18.281679 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-f5e8e1ee-423f-4610-9fe0-3f6ba3760d38 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:18.356501 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8d11c416-76f7-467c-b9df-b59949408b3b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:18.360893 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-7f5b5b40-12da-4652-8245-abeabf4ec387 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:18.373688 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d11c416-76f7-467c-b9df-b59949408b3b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2c7c01cc-8e67-4512-a9ad-5c8ed2fcd3af,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:18.382428 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-8d11c416-76f7-467c-b9df-b59949408b3b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:18.384566 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8d11c416-76f7-467c-b9df-b59949408b3b admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:18.385689 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-8d11c416-76f7-467c-b9df-b59949408b3b admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/2c7c01cc-8e67-4512-a9ad-5c8ed2fcd3af HTTP/1.1" status: 204  len: 168 time: 0.7006466
Jun 03 08:32:18.398204 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-0a2b35e3-af11-48b6-89f7-e41d7dfa2712 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:18.414134 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:18.449790 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a2b35e3-af11-48b6-89f7-e41d7dfa2712 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2e86418e-fa28-44dc-a29a-a0996f0c6218,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:18.454234 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-0a2b35e3-af11-48b6-89f7-e41d7dfa2712 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=9164de6d30ac45779ba24fd81e0cf16e&name=default HTTP/1.1" status: 200  len: 2979 time: 1.6514080
Jun 03 08:32:18.455210 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-0a2b35e3-af11-48b6-89f7-e41d7dfa2712 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:18.456839 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 48720) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:18.475525 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-e2fb12e7-3cf9-43ae-8a33-427283df1769 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:18.481480 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:18.572725 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2b94e5c8-9ea9-4887-8c91-9b6640295c5b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:18.612668 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2b94e5c8-9ea9-4887-8c91-9b6640295c5b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:18.652207 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-f5e8e1ee-423f-4610-9fe0-3f6ba3760d38 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Made reservation on behalf of b9cf7834ca79439981d1f8e77b89daed for: {'port': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:32:18.656062 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-f5e8e1ee-423f-4610-9fe0-3f6ba3760d38 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:18.693562 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-e2fb12e7-3cf9-43ae-8a33-427283df1769 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Network 6861b4db-6cd2-4a5b-bf02-87826345c933 is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:32:18.710057 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-e2fb12e7-3cf9-43ae-8a33-427283df1769 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:32:18.710057 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-e2fb12e7-3cf9-43ae-8a33-427283df1769 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:32:18.729238 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-e2fb12e7-3cf9-43ae-8a33-427283df1769 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:18.729921 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-e2fb12e7-3cf9-43ae-8a33-427283df1769 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:18.763386 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f126b42b-c7bd-4bd9-9478-97ffab013cf5 req-9e6ed27d-fae0-4473-ba6d-9a3d0f0b1793 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 210 time: 0.0483868
Jun 03 08:32:18.793152 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2fb12e7-3cf9-43ae-8a33-427283df1769 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Pushing event updated for resources: {'Port': ['ID=716f2131-2965-4ead-984f-8ccfcadea071,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:18.798382 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-e2fb12e7-3cf9-43ae-8a33-427283df1769 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.317s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:18.899647 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2b94e5c8-9ea9-4887-8c91-9b6640295c5b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:18.909706 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e75da396-1ca8-4425-bffc-67c0c05a1faa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:18.924695 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b94e5c8-9ea9-4887-8c91-9b6640295c5b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2e86418e-fa28-44dc-a29a-a0996f0c6218,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:18.926997 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2b94e5c8-9ea9-4887-8c91-9b6640295c5b admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:18.928120 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-2b94e5c8-9ea9-4887-8c91-9b6640295c5b admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/2e86418e-fa28-44dc-a29a-a0996f0c6218 HTTP/1.1" status: 204  len: 168 time: 0.4703057
Jun 03 08:32:18.930004 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-2b94e5c8-9ea9-4887-8c91-9b6640295c5b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:19.025170 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-e2fb12e7-3cf9-43ae-8a33-427283df1769 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.55 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 2.4767954
Jun 03 08:32:19.048539 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Request body: {'port': {'device_id': 'fdc4e210-a267-4553-8e0c-701eb8001997', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:32:19.150135 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 48750) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:19.168675 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-62f146d9-5c95-4deb-af73-714ebd2dd435 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:19.188674 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-62f146d9-5c95-4deb-af73-714ebd2dd435 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:19.193957 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-62f146d9-5c95-4deb-af73-714ebd2dd435 admin admin] Usage tracker for resource:security_group_rule and tenant:04ae693ea6e1465fa25ee6640872a7f9 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:19.198689 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-62f146d9-5c95-4deb-af73-714ebd2dd435 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:19.202224 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-f5e8e1ee-423f-4610-9fe0-3f6ba3760d38 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Allocated IP 172.20.0.11 (6861b4db-6cd2-4a5b-bf02-87826345c933/0ea4966f-f9de-4d69-a774-7746b1ee12ee/63dd5c57-8935-4b18-94f8-737a7f6e3e1b) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:32:19.204613 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:19.206587 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-62f146d9-5c95-4deb-af73-714ebd2dd435 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:19.420038 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-62f146d9-5c95-4deb-af73-714ebd2dd435 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:19.434786 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-80abfab5-42c7-49ad-ba06-041a20a2af9e req-378117a3-3a3d-4b93-80e5-1b36b9db29d4 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Synchronizing usage tracker for tenant:b9cf7834ca79439981d1f8e77b89daed on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:32:19.561959 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-62f146d9-5c95-4deb-af73-714ebd2dd435 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:19.569650 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-729c07f7-8df2-4eb4-84fa-503ace08b7fc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:19.617428 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-62f146d9-5c95-4deb-af73-714ebd2dd435 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=04ae693ea6e1465fa25ee6640872a7f9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4671500
Jun 03 08:32:19.618544 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 48766) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:19.619359 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62f146d9-5c95-4deb-af73-714ebd2dd435 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ea4ed285-f24c-459c-8b81-af9384a196d0,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:19.623529 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-62f146d9-5c95-4deb-af73-714ebd2dd435 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:19.637120 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-80abfab5-42c7-49ad-ba06-041a20a2af9e req-378117a3-3a3d-4b93-80e5-1b36b9db29d4 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Unset dirty status for tenant:b9cf7834ca79439981d1f8e77b89daed on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:32:19.639511 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-80abfab5-42c7-49ad-ba06-041a20a2af9e req-378117a3-3a3d-4b93-80e5-1b36b9db29d4 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 210 time: 0.3141627
Jun 03 08:32:19.705732 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f67e73ac-b7fe-46d4-92e7-cebf7b5107db admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:19.741185 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f67e73ac-b7fe-46d4-92e7-cebf7b5107db admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:19.748468 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-f5e8e1ee-423f-4610-9fe0-3f6ba3760d38 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:19.926300 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-aa561086-44ef-405d-82f5-217a964f27cd req-33fd5739-5175-4789-b05e-f2038d8f6c7c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 210 time: 0.0532904
Jun 03 08:32:19.953706 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-f5e8e1ee-423f-4610-9fe0-3f6ba3760d38 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:19.969477 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:19.971356 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f67e73ac-b7fe-46d4-92e7-cebf7b5107db admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:19.992537 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-04f77f6a-307d-4525-b8fe-493f8856ae2a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:20.019030 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f67e73ac-b7fe-46d4-92e7-cebf7b5107db admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ea4ed285-f24c-459c-8b81-af9384a196d0,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:20.038130 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 48782) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:20.042669 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f67e73ac-b7fe-46d4-92e7-cebf7b5107db admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:20.044678 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f67e73ac-b7fe-46d4-92e7-cebf7b5107db admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:20.049076 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-f67e73ac-b7fe-46d4-92e7-cebf7b5107db admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/ea4ed285-f24c-459c-8b81-af9384a196d0 HTTP/1.1" status: 204  len: 168 time: 0.4266031
Jun 03 08:32:20.068910 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-f5e8e1ee-423f-4610-9fe0-3f6ba3760d38 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Network 6861b4db-6cd2-4a5b-bf02-87826345c933 is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:32:20.156099 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-f5e8e1ee-423f-4610-9fe0-3f6ba3760d38 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:32:20.174084 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-f5e8e1ee-423f-4610-9fe0-3f6ba3760d38 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:32:20.180008 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-f5e8e1ee-423f-4610-9fe0-3f6ba3760d38 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:20.180693 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-f5e8e1ee-423f-4610-9fe0-3f6ba3760d38 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:20.189253 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-de7a72f0-815d-468b-a158-df8e5f4d3923 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:20.238916 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-de7a72f0-815d-468b-a158-df8e5f4d3923 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:20.241068 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5e8e1ee-423f-4610-9fe0-3f6ba3760d38 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Pushing event updated for resources: {'Port': ['ID=63dd5c57-8935-4b18-94f8-737a7f6e3e1b,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:20.246311 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f5e8e1ee-423f-4610-9fe0-3f6ba3760d38 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.277s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:20.249889 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-de7a72f0-815d-468b-a158-df8e5f4d3923 admin admin] Usage tracker for resource:security_group_rule and tenant:4a5c4683c5f247ce8a6a4a3df1d5569f is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:20.261316 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-de7a72f0-815d-468b-a158-df8e5f4d3923 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:20.270956 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-de7a72f0-815d-468b-a158-df8e5f4d3923 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:20.320791 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-f5e8e1ee-423f-4610-9fe0-3f6ba3760d38 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.55 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 2.2325523
Jun 03 08:32:20.378931 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Request body: {'port': {'device_id': 'a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:32:20.450591 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 716f2131-2965-4ead-984f-8ccfcadea071 {{(pid=92323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:32:20.461828 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:20.545769 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Transition to ACTIVE for port object 716f2131-2965-4ead-984f-8ccfcadea071 will not be triggered until provisioned by entity L2. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:32:20.583130 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-de7a72f0-815d-468b-a158-df8e5f4d3923 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:20.593663 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:20.653710 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:20.665367 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:20.732257 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-de7a72f0-815d-468b-a158-df8e5f4d3923 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:20.918725 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Pushing event updated for resources: {'Port': ['ID=716f2131-2965-4ead-984f-8ccfcadea071,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:21.045867 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.380s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:21.054018 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-de7a72f0-815d-468b-a158-df8e5f4d3923 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=4a5c4683c5f247ce8a6a4a3df1d5569f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9880116
Jun 03 08:32:21.055256 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-94c8f7b0-9d2d-44ab-93e5-cc6946db1470 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.269s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:21.068341 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 48816) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:21.120535 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Attempting to bind port 716f2131-2965-4ead-984f-8ccfcadea071 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:32:21.120869 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Attempting to bind port 716f2131-2965-4ead-984f-8ccfcadea071 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '1b8fb38d-ade8-4355-bd2b-f2b171f31184', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 518, 'network_id': '6861b4db-6cd2-4a5b-bf02-87826345c933'}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:32:21.121204 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Attempting to bind port 716f2131-2965-4ead-984f-8ccfcadea071 on network 6861b4db-6cd2-4a5b-bf02-87826345c933 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:32:21.141759 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Port 716f2131-2965-4ead-984f-8ccfcadea071 on network 6861b4db-6cd2-4a5b-bf02-87826345c933 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 03 08:32:21.142181 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Attempting to bind port 716f2131-2965-4ead-984f-8ccfcadea071 on network 6861b4db-6cd2-4a5b-bf02-87826345c933 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:32:21.144136 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de7a72f0-815d-468b-a158-df8e5f4d3923 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e7cfcfd5-c36f-4a4e-8327-1c0cdfad260f,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:21.170214 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-de7a72f0-815d-468b-a158-df8e5f4d3923 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:21.187911 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Checking agent: {'id': '181c5753-100b-4f03-bda8-e34279b057f4', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'started_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 31, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:32:21.188259 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Checking segment: {'id': '1b8fb38d-ade8-4355-bd2b-f2b171f31184', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 518, 'network_id': '6861b4db-6cd2-4a5b-bf02-87826345c933'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:32:21.188644 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Bound using segment: {'id': '1b8fb38d-ade8-4355-bd2b-f2b171f31184', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 518, 'network_id': '6861b4db-6cd2-4a5b-bf02-87826345c933'} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:32:21.189097 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Bound port: 716f2131-2965-4ead-984f-8ccfcadea071, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1b8fb38d-ade8-4355-bd2b-f2b171f31184', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 518, 'network_id': '6861b4db-6cd2-4a5b-bf02-87826345c933'}}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:32:21.189616 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:21.236370 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-9670ae85-60f0-40dd-8cc2-5a82ba296ed4 req-af038764-c592-46bd-98c4-592f3515a47c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 210 time: 0.1670315
Jun 03 08:32:21.249689 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2cf70a1f-1b84-446e-b47d-f5f9b3d5efda admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:21.275850 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbc1afaa-555f-44aa-9fc2-f434f4cc0a3f req-6272afd0-e01d-45cb-9f3a-cbbf013b4897 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:21.277420 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-cbc1afaa-555f-44aa-9fc2-f434f4cc0a3f req-6272afd0-e01d-45cb-9f3a-cbbf013b4897 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 932 time: 0.4904809
Jun 03 08:32:21.377193 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2cf70a1f-1b84-446e-b47d-f5f9b3d5efda admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:21.408020 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-cbc1afaa-555f-44aa-9fc2-f434f4cc0a3f req-4a9e36be-20fe-423c-8761-42b9007a2a68 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0910757
Jun 03 08:32:21.431315 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716bc020-a678-4841-af96-16af99662374 req-aa1ea673-f50c-425c-bba1-3603829817a4 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:21.432901 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-716bc020-a678-4841-af96-16af99662374 req-aa1ea673-f50c-425c-bba1-3603829817a4 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.55 "GET /v2.0/networks?id=f9db9a2a-942b-4a98-97ed-1896cb9158b4 HTTP/1.1" status: 200  len: 815 time: 0.4784005
Jun 03 08:32:21.449348 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] For port 716f2131-2965-4ead-984f-8ccfcadea071, host hv-cinder-78726, cleared binding levels {{(pid=92323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:32:21.457430 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [req-716bc020-a678-4841-af96-16af99662374 req-f6e6cee1-83ef-477b-b5ed-ebb0ce62493c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Request body: {'port': {'device_id': '5377bc09-faa4-4050-8213-109ccb227085', 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4', 'admin_state_up': True, 'tenant_id': '7bac6d994f4d49b292bc39fac07c0311'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:32:21.503329 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] For port 716f2131-2965-4ead-984f-8ccfcadea071, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=716f2131-2965-4ead-984f-8ccfcadea071,segment=NetworkSegment(1b8fb38d-ade8-4355-bd2b-f2b171f31184),segment_id=1b8fb38d-ade8-4355-bd2b-f2b171f31184)] {{(pid=92323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:32:21.521011 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 63dd5c57-8935-4b18-94f8-737a7f6e3e1b {{(pid=92323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:32:21.530524 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:21.547033 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Transition to ACTIVE for port object 63dd5c57-8935-4b18-94f8-737a7f6e3e1b will not be triggered until provisioned by entity L2. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:32:21.568514 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 48832) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:21.612519 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [req-716bc020-a678-4841-af96-16af99662374 req-f6e6cee1-83ef-477b-b5ed-ebb0ce62493c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:21.623403 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-716bc020-a678-4841-af96-16af99662374 req-f6e6cee1-83ef-477b-b5ed-ebb0ce62493c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Usage tracker for resource:port and tenant:7bac6d994f4d49b292bc39fac07c0311 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:21.627654 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-716bc020-a678-4841-af96-16af99662374 req-f6e6cee1-83ef-477b-b5ed-ebb0ce62493c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Quota usage for port was recalculated. Used quota:2. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:21.634661 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:21.641020 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:21.643001 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [req-716bc020-a678-4841-af96-16af99662374 req-f6e6cee1-83ef-477b-b5ed-ebb0ce62493c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:21.652697 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:21.703292 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2cf70a1f-1b84-446e-b47d-f5f9b3d5efda admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:21.707087 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-cc223374-fd33-464d-83c2-d3cb6fa06cfc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:21.735370 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cf70a1f-1b84-446e-b47d-f5f9b3d5efda admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e7cfcfd5-c36f-4a4e-8327-1c0cdfad260f,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:21.739069 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-2cf70a1f-1b84-446e-b47d-f5f9b3d5efda admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:21.747252 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2cf70a1f-1b84-446e-b47d-f5f9b3d5efda admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:21.748806 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-2cf70a1f-1b84-446e-b47d-f5f9b3d5efda admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/e7cfcfd5-c36f-4a4e-8327-1c0cdfad260f HTTP/1.1" status: 204  len: 168 time: 0.6780918
Jun 03 08:32:21.750316 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-716bc020-a678-4841-af96-16af99662374 req-f6e6cee1-83ef-477b-b5ed-ebb0ce62493c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Made reservation on behalf of 7bac6d994f4d49b292bc39fac07c0311 for: {'port': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:32:21.755419 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-716bc020-a678-4841-af96-16af99662374 req-f6e6cee1-83ef-477b-b5ed-ebb0ce62493c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:21.812314 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:21.812938 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:21.814341 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] 10.222.0.55 "PUT /v2.0/ports/716f2131-2965-4ead-984f-8ccfcadea071 HTTP/1.1" status: 200  len: 1094 time: 2.7735755
Jun 03 08:32:21.845551 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fdc4e210-a267-4553-8e0c-701eb8001997', 'tag': '716f2131-2965-4ead-984f-8ccfcadea071'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:32:21.847933 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3c11f2f8-33b9-4e45-9b37-70ea56871466" -d '{"events": [{"name": "network-changed", "server_uuid": "fdc4e210-a267-4553-8e0c-701eb8001997", "tag": "716f2131-2965-4ead-984f-8ccfcadea071"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:32:21.923874 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Attempting to bind port 63dd5c57-8935-4b18-94f8-737a7f6e3e1b on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:32:21.924223 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Attempting to bind port 63dd5c57-8935-4b18-94f8-737a7f6e3e1b by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '1b8fb38d-ade8-4355-bd2b-f2b171f31184', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 518, 'network_id': '6861b4db-6cd2-4a5b-bf02-87826345c933'}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:32:21.924557 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Attempting to bind port 63dd5c57-8935-4b18-94f8-737a7f6e3e1b on network 6861b4db-6cd2-4a5b-bf02-87826345c933 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:32:21.930130 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Pushing event updated for resources: {'Port': ['ID=63dd5c57-8935-4b18-94f8-737a7f6e3e1b,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:21.934728 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Port 63dd5c57-8935-4b18-94f8-737a7f6e3e1b on network 6861b4db-6cd2-4a5b-bf02-87826345c933 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 03 08:32:21.935064 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Attempting to bind port 63dd5c57-8935-4b18-94f8-737a7f6e3e1b on network 6861b4db-6cd2-4a5b-bf02-87826345c933 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:32:21.941435 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:32:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-44d8f9ea-fb93-4a62-bc01-c8b8a3c0bec4 x-openstack-request-id: req-44d8f9ea-fb93-4a62-bc01-c8b8a3c0bec4 {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:32:21.941435 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fdc4e210-a267-4553-8e0c-701eb8001997", "tag": "716f2131-2965-4ead-984f-8ccfcadea071", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:32:21.941435 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-44d8f9ea-fb93-4a62-bc01-c8b8a3c0bec4 {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:32:21.941682 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fdc4e210-a267-4553-8e0c-701eb8001997', 'tag': '716f2131-2965-4ead-984f-8ccfcadea071', 'status': 'completed', 'code': 200}
Jun 03 08:32:21.984677 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-fb1c566e-08c8-4c3c-bade-9a7c6429a6fc admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:22.024152 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.db_base_plugin_common [req-716bc020-a678-4841-af96-16af99662374 req-f6e6cee1-83ef-477b-b5ed-ebb0ce62493c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Allocated IP 172.20.0.3 (f9db9a2a-942b-4a98-97ed-1896cb9158b4/5f3b55e2-964f-4ce8-9d71-3ac11dc6ebf1/4da2f73c-9644-4280-92c1-e0be72f1fdad) {{(pid=92324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:32:22.047036 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Checking agent: {'id': '181c5753-100b-4f03-bda8-e34279b057f4', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'started_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 31, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:32:22.047226 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Checking segment: {'id': '1b8fb38d-ade8-4355-bd2b-f2b171f31184', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 518, 'network_id': '6861b4db-6cd2-4a5b-bf02-87826345c933'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:32:22.047604 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Bound using segment: {'id': '1b8fb38d-ade8-4355-bd2b-f2b171f31184', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 518, 'network_id': '6861b4db-6cd2-4a5b-bf02-87826345c933'} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:32:22.048057 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Bound port: 63dd5c57-8935-4b18-94f8-737a7f6e3e1b, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1b8fb38d-ade8-4355-bd2b-f2b171f31184', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 518, 'network_id': '6861b4db-6cd2-4a5b-bf02-87826345c933'}}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:32:22.048413 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:22.078822 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-fb1c566e-08c8-4c3c-bade-9a7c6429a6fc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:22.118515 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-fb1c566e-08c8-4c3c-bade-9a7c6429a6fc admin admin] Usage tracker for resource:security_group_rule and tenant:727db00549e1411080f0e0b87e558aa6 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:22.123850 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-fb1c566e-08c8-4c3c-bade-9a7c6429a6fc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:22.154031 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-fb1c566e-08c8-4c3c-bade-9a7c6429a6fc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:22.159127 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Pushing event updated for resources: {'Port': ['ID=716f2131-2965-4ead-984f-8ccfcadea071,revision_number=3']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:22.175379 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.523s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:22.175810 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.476s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:22.176105 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:22.235772 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] For port 63dd5c57-8935-4b18-94f8-737a7f6e3e1b, host hv-cinder-78726, cleared binding levels {{(pid=92323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:32:22.241472 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] For port 63dd5c57-8935-4b18-94f8-737a7f6e3e1b, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=63dd5c57-8935-4b18-94f8-737a7f6e3e1b,segment=NetworkSegment(1b8fb38d-ade8-4355-bd2b-f2b171f31184),segment_id=1b8fb38d-ade8-4355-bd2b-f2b171f31184)] {{(pid=92323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:32:22.253049 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-bd4f5956-a6ec-4bae-8447-8973950c53b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:22.254924 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-bd4f5956-a6ec-4bae-8447-8973950c53b3 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=b9cf7834ca79439981d1f8e77b89daed&device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 1097 time: 0.2611420
Jun 03 08:32:22.334829 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-716bc020-a678-4841-af96-16af99662374 req-f6e6cee1-83ef-477b-b5ed-ebb0ce62493c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks [] for port, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:22.335578 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-15568e3f-17ae-4cd2-8f9e-3c5e98d71bab service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=716f2131-2965-4ead-984f-8ccfcadea071 HTTP/1.1" status: 200  len: 217 time: 0.0715365
Jun 03 08:32:22.401862 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:22.418018 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:22.436341 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-716bc020-a678-4841-af96-16af99662374 req-f6e6cee1-83ef-477b-b5ed-ebb0ce62493c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:22.454033 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:22.460379 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['24826ba2-ee17-4774-b5ca-2cd1675f325a', 'a309b335-7644-4c59-8d6b-90e763827a25'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:32:22.565303 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-716bc020-a678-4841-af96-16af99662374 req-f6e6cee1-83ef-477b-b5ed-ebb0ce62493c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Network f9db9a2a-942b-4a98-97ed-1896cb9158b4 is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:32:22.574631 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [req-716bc020-a678-4841-af96-16af99662374 req-f6e6cee1-83ef-477b-b5ed-ebb0ce62493c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:32:22.580133 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [req-716bc020-a678-4841-af96-16af99662374 req-f6e6cee1-83ef-477b-b5ed-ebb0ce62493c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Received port after_create {{(pid=92324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:32:22.641722 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-52c7da01-3f44-4f66-a1a0-a8f7db50a6dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:22.647006 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-52c7da01-3f44-4f66-a1a0-a8f7db50a6dc service neutron] 10.222.0.55 "GET /v2.0/subnets?id=0ea4966f-f9de-4d69-a774-7746b1ee12ee HTTP/1.1" status: 200  len: 859 time: 0.3011827
Jun 03 08:32:22.647006 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Pushing event updated for resources: {'Port': ['ID=63dd5c57-8935-4b18-94f8-737a7f6e3e1b,revision_number=3']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:22.673054 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.255s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:22.676074 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:22.676890 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:22.678582 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] 10.222.0.55 "PUT /v2.0/ports/63dd5c57-8935-4b18-94f8-737a7f6e3e1b HTTP/1.1" status: 200  len: 1094 time: 2.3107479
Jun 03 08:32:22.760735 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-fb1c566e-08c8-4c3c-bade-9a7c6429a6fc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:22.779460 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6e6cee1-83ef-477b-b5ed-ebb0ce62493c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Pushing event updated for resources: {'Port': ['ID=4da2f73c-9644-4280-92c1-e0be72f1fdad,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:22.780407 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-4cb0931b-7865-43ce-8193-ab94ba94e077 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=6861b4db-6cd2-4a5b-bf02-87826345c933&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1064689
Jun 03 08:32:22.817938 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f6e6cee1-83ef-477b-b5ed-ebb0ce62493c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.364s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:22.858103 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716bc020-a678-4841-af96-16af99662374 req-f6e6cee1-83ef-477b-b5ed-ebb0ce62493c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:22.862116 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-716bc020-a678-4841-af96-16af99662374 req-f6e6cee1-83ef-477b-b5ed-ebb0ce62493c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for port, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:22.923929 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc557cca-43de-4382-a245-733c31d52a6f req-68f28860-91a2-42a1-b36a-7c929e93b12f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:22.933282 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-cc557cca-43de-4382-a245-733c31d52a6f req-68f28860-91a2-42a1-b36a-7c929e93b12f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 944 time: 0.2718542
Jun 03 08:32:22.983927 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-fb1c566e-08c8-4c3c-bade-9a7c6429a6fc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:22.984649 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-cc557cca-43de-4382-a245-733c31d52a6f req-fe530760-353f-4bc9-bcea-14d899ad296a tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Synchronizing usage tracker for tenant:b9cf7834ca79439981d1f8e77b89daed on resource:security_group {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:32:22.998466 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-87c44f03-016e-4b07-9f32-4273747eed7b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:23.009342 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-78d0d2ea-58d2-4c04-8fd3-57f8d0b0def5 service neutron] 10.222.0.55 "GET /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2185659
Jun 03 08:32:23.025019 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-716bc020-a678-4841-af96-16af99662374 req-f6e6cee1-83ef-477b-b5ed-ebb0ce62493c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.55 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.5789368
Jun 03 08:32:23.039165 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [req-716bc020-a678-4841-af96-16af99662374 req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Request body: {'port': {'device_id': '5377bc09-faa4-4050-8213-109ccb227085', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:32:23.099179 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1695abcc-bb5f-4c7f-92da-6aae90e174c3 req-29f32396-9d62-4215-baff-903d509ca107 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:23.101273 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1695abcc-bb5f-4c7f-92da-6aae90e174c3 req-29f32396-9d62-4215-baff-903d509ca107 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 931 time: 0.6535835
Jun 03 08:32:23.174433 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-cc557cca-43de-4382-a245-733c31d52a6f req-fe530760-353f-4bc9-bcea-14d899ad296a tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Unset dirty status for tenant:b9cf7834ca79439981d1f8e77b89daed on resource:security_group {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:32:23.175722 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-cc557cca-43de-4382-a245-733c31d52a6f req-fe530760-353f-4bc9-bcea-14d899ad296a tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2409425
Jun 03 08:32:23.199900 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-716bc020-a678-4841-af96-16af99662374 req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:23.294061 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb1c566e-08c8-4c3c-bade-9a7c6429a6fc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=065d73ac-635d-48cd-b90e-7d42fd53de0e,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:23.308728 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-fb1c566e-08c8-4c3c-bade-9a7c6429a6fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.310s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:23.311634 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-fb1c566e-08c8-4c3c-bade-9a7c6429a6fc admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=727db00549e1411080f0e0b87e558aa6&name=default HTTP/1.1" status: 200  len: 2979 time: 1.7406733
Jun 03 08:32:23.317331 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 48888) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:23.404459 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1695abcc-bb5f-4c7f-92da-6aae90e174c3 req-deec6b1a-ac66-41cc-9cf0-0dbdbe3401f3 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2297270
Jun 03 08:32:23.423988 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-88994f46-671a-40d6-9ed5-8d07982783f2 req-398a9967-d970-4bc7-b4d9-d41993a375fc service neutron] 10.222.0.55 "GET /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4045055
Jun 03 08:32:23.468825 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-2151d9f7-a105-4e64-b486-35bcb9bec644 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:23.472252 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-2151d9f7-a105-4e64-b486-35bcb9bec644 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=b9cf7834ca79439981d1f8e77b89daed&device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 1097 time: 0.5222197
Jun 03 08:32:23.671241 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-1491cb62-5920-453b-8236-8d3e26b91ac1 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=63dd5c57-8935-4b18-94f8-737a7f6e3e1b HTTP/1.1" status: 200  len: 217 time: 0.1818907
Jun 03 08:32:23.676489 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7ef0ae56-9ce6-43ca-86ac-f449d6dc25e1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:23.724356 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.notifiers.nova [req-716bc020-a678-4841-af96-16af99662374 req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4da2f73c-9644-4280-92c1-e0be72f1fdad {{(pid=92324) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:32:23.732878 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-716bc020-a678-4841-af96-16af99662374 req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:23.751549 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.provisioning_blocks [req-716bc020-a678-4841-af96-16af99662374 req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Transition to ACTIVE for port object 4da2f73c-9644-4280-92c1-e0be72f1fdad will not be triggered until provisioned by entity L2. {{(pid=92324) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:32:23.759767 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7ef0ae56-9ce6-43ca-86ac-f449d6dc25e1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:23.816740 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-0775e403-8595-43f3-afca-ec990bfcf53e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:23.818210 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-0775e403-8595-43f3-afca-ec990bfcf53e service neutron] 10.222.0.55 "GET /v2.0/subnets?id=0ea4966f-f9de-4d69-a774-7746b1ee12ee HTTP/1.1" status: 200  len: 859 time: 0.1213880
Jun 03 08:32:23.861197 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c11f2f8-33b9-4e45-9b37-70ea56871466 req-fd38aa7c-b575-4ca4-9eb8-83a3ed64b30d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:23.871543 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3c11f2f8-33b9-4e45-9b37-70ea56871466 req-fd38aa7c-b575-4ca4-9eb8-83a3ed64b30d service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=b9cf7834ca79439981d1f8e77b89daed&device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 1097 time: 0.2383628
Jun 03 08:32:23.877439 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-3b1a2a4e-5667-4c8a-80c4-34fef4e0d019 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=6861b4db-6cd2-4a5b-bf02-87826345c933&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0497048
Jun 03 08:32:23.904375 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-716bc020-a678-4841-af96-16af99662374 req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15641369'] for port, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:23.918868 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:23.944059 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7', 'tag': '63dd5c57-8935-4b18-94f8-737a7f6e3e1b'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:32:23.947474 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ea8e2ea5-f965-4de0-be47-d99857e20656" -d '{"events": [{"name": "network-changed", "server_uuid": "a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7", "tag": "63dd5c57-8935-4b18-94f8-737a7f6e3e1b"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:32:24.056161 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:32:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-346cd726-aec8-4966-8c6a-caaa71c30d40 x-openstack-request-id: req-346cd726-aec8-4966-8c6a-caaa71c30d40 {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:32:24.056578 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7", "tag": "63dd5c57-8935-4b18-94f8-737a7f6e3e1b", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:32:24.056912 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-346cd726-aec8-4966-8c6a-caaa71c30d40 {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:32:24.057720 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7', 'tag': '63dd5c57-8935-4b18-94f8-737a7f6e3e1b', 'status': 'completed', 'code': 200}
Jun 03 08:32:24.134661 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7ef0ae56-9ce6-43ca-86ac-f449d6dc25e1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:24.147079 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-0a2b35e3-af11-48b6-89f7-e41d7dfa2712 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:24.176277 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ef0ae56-9ce6-43ca-86ac-f449d6dc25e1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=065d73ac-635d-48cd-b90e-7d42fd53de0e,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:24.193858 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-7ef0ae56-9ce6-43ca-86ac-f449d6dc25e1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:24.228175 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c11f2f8-33b9-4e45-9b37-70ea56871466 req-f6caf146-9c04-4fc3-9801-0a6da20feda1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:24.230023 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3c11f2f8-33b9-4e45-9b37-70ea56871466 req-f6caf146-9c04-4fc3-9801-0a6da20feda1 service neutron] 10.222.0.55 "GET /v2.0/networks?id=6861b4db-6cd2-4a5b-bf02-87826345c933 HTTP/1.1" status: 200  len: 920 time: 0.3551509
Jun 03 08:32:24.235778 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7ef0ae56-9ce6-43ca-86ac-f449d6dc25e1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:24.239826 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-7ef0ae56-9ce6-43ca-86ac-f449d6dc25e1 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/065d73ac-635d-48cd-b90e-7d42fd53de0e HTTP/1.1" status: 204  len: 168 time: 0.9179027
Jun 03 08:32:24.297386 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Pushing event updated for resources: {'Port': ['ID=4da2f73c-9644-4280-92c1-e0be72f1fdad,revision_number=2']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:24.306382 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.386s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:24.354046 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3c11f2f8-33b9-4e45-9b37-70ea56871466 req-ddbdd37c-305c-44d9-947c-ce97f0930581 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=716f2131-2965-4ead-984f-8ccfcadea071 HTTP/1.1" status: 200  len: 217 time: 0.1067336
Jun 03 08:32:24.358766 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-fcccc386-622e-4629-be5a-ffc51b962312 service neutron] 10.222.0.55 "GET /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4593782
Jun 03 08:32:24.476822 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c11f2f8-33b9-4e45-9b37-70ea56871466 req-a6ca86c3-cd17-439c-9662-53be26647719 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:24.478692 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3c11f2f8-33b9-4e45-9b37-70ea56871466 req-a6ca86c3-cd17-439c-9662-53be26647719 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=0ea4966f-f9de-4d69-a774-7746b1ee12ee HTTP/1.1" status: 200  len: 859 time: 0.1065388
Jun 03 08:32:24.512867 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.managers [req-716bc020-a678-4841-af96-16af99662374 req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Attempting to bind port 4da2f73c-9644-4280-92c1-e0be72f1fdad on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92324) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:32:24.513234 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.managers [req-716bc020-a678-4841-af96-16af99662374 req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Attempting to bind port 4da2f73c-9644-4280-92c1-e0be72f1fdad by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '9923ac74-9556-45ec-9044-43728d2a8ec3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4'}] {{(pid=92324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:32:24.513570 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-716bc020-a678-4841-af96-16af99662374 req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Attempting to bind port 4da2f73c-9644-4280-92c1-e0be72f1fdad on network f9db9a2a-942b-4a98-97ed-1896cb9158b4 {{(pid=92324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:32:24.520854 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-716bc020-a678-4841-af96-16af99662374 req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Port 4da2f73c-9644-4280-92c1-e0be72f1fdad on network f9db9a2a-942b-4a98-97ed-1896cb9158b4 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 03 08:32:24.521177 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-716bc020-a678-4841-af96-16af99662374 req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Attempting to bind port 4da2f73c-9644-4280-92c1-e0be72f1fdad on network f9db9a2a-942b-4a98-97ed-1896cb9158b4 {{(pid=92324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:32:24.530228 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-716bc020-a678-4841-af96-16af99662374 req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Checking agent: {'id': '181c5753-100b-4f03-bda8-e34279b057f4', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'started_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 31, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:32:24.530625 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-716bc020-a678-4841-af96-16af99662374 req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Checking segment: {'id': '9923ac74-9556-45ec-9044-43728d2a8ec3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:32:24.531172 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-716bc020-a678-4841-af96-16af99662374 req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Bound using segment: {'id': '9923ac74-9556-45ec-9044-43728d2a8ec3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4'} {{(pid=92324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:32:24.531968 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.managers [req-716bc020-a678-4841-af96-16af99662374 req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Bound port: 4da2f73c-9644-4280-92c1-e0be72f1fdad, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9923ac74-9556-45ec-9044-43728d2a8ec3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4'}}] {{(pid=92324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:32:24.532125 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-716bc020-a678-4841-af96-16af99662374 req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:24.556853 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3c11f2f8-33b9-4e45-9b37-70ea56871466 req-9b52d3d6-607d-4e5e-992e-b0b761e99305 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=6861b4db-6cd2-4a5b-bf02-87826345c933&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0545571
Jun 03 08:32:24.609315 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-062b3051-d2cf-420b-b5c4-360a69bc982d req-da513ae0-e060-43dc-bd27-293192e14856 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:24.610869 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-062b3051-d2cf-420b-b5c4-360a69bc982d req-da513ae0-e060-43dc-bd27-293192e14856 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 944 time: 0.2756195
Jun 03 08:32:24.685457 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.db [req-716bc020-a678-4841-af96-16af99662374 req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] For port 4da2f73c-9644-4280-92c1-e0be72f1fdad, host hv-cinder-78726, cleared binding levels {{(pid=92324) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:32:24.706227 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-062b3051-d2cf-420b-b5c4-360a69bc982d req-ad449b67-b73f-4ce7-bf2b-fe3e5a3f9232 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0833099
Jun 03 08:32:24.710109 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.db [req-716bc020-a678-4841-af96-16af99662374 req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] For port 4da2f73c-9644-4280-92c1-e0be72f1fdad, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=4da2f73c-9644-4280-92c1-e0be72f1fdad,segment=NetworkSegment(9923ac74-9556-45ec-9044-43728d2a8ec3),segment_id=9923ac74-9556-45ec-9044-43728d2a8ec3)] {{(pid=92324) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:32:24.830734 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-116e5d42-9d8d-4b3c-9115-d4c67f8ba22d req-994b8dab-45f8-4963-97e1-7d8341e660d2 service neutron] 10.222.0.55 "GET /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4575355
Jun 03 08:32:24.859376 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18af8748-56b9-4b32-93dd-f4fe4d2cf026 req-8a20f26f-5214-40ad-8e23-574de52263ed tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:24.860835 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-18af8748-56b9-4b32-93dd-f4fe4d2cf026 req-8a20f26f-5214-40ad-8e23-574de52263ed tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 943 time: 0.3011382
Jun 03 08:32:24.862873 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3c11f2f8-33b9-4e45-9b37-70ea56871466 req-add386e9-cfd8-4a7d-912c-1dd334776570 service neutron] 10.222.0.55 "GET /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2585595
Jun 03 08:32:24.899033 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-716bc020-a678-4841-af96-16af99662374 req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15641369'] for port, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:24.909698 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:25.012035 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-18af8748-56b9-4b32-93dd-f4fe4d2cf026 req-ede59d47-fdfb-47fb-8c20-b4bfdacdeeae tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1445622
Jun 03 08:32:25.064240 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3c11f2f8-33b9-4e45-9b37-70ea56871466 req-afd9993e-c791-46ee-8944-57ef6181ca07 service neutron] 10.222.0.55 "GET /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1837213
Jun 03 08:32:25.132734 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716bc020-a678-4841-af96-16af99662374 req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:25.133547 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-716bc020-a678-4841-af96-16af99662374 req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for port, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:25.135042 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-716bc020-a678-4841-af96-16af99662374 req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] 10.222.0.55 "PUT /v2.0/ports/4da2f73c-9644-4280-92c1-e0be72f1fdad HTTP/1.1" status: 200  len: 1093 time: 2.1025498
Jun 03 08:32:25.135477 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5377bc09-faa4-4050-8213-109ccb227085', 'tag': '4da2f73c-9644-4280-92c1-e0be72f1fdad'}] {{(pid=92324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:32:25.138333 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}25ad023063ed160b339e2d2d51ef3e5c51250aece1f4db0a35843dff1b64291a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a386c05e-f38c-4b4c-b7ea-b2ed619cc918" -d '{"events": [{"name": "network-changed", "server_uuid": "5377bc09-faa4-4050-8213-109ccb227085", "tag": "4da2f73c-9644-4280-92c1-e0be72f1fdad"}]}' {{(pid=92324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:32:25.160324 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Pushing event updated for resources: {'Port': ['ID=4da2f73c-9644-4280-92c1-e0be72f1fdad,revision_number=3']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:25.239527 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:32:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bf49a8aa-a644-46eb-8247-94322c94f577 x-openstack-request-id: req-bf49a8aa-a644-46eb-8247-94322c94f577 {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:32:25.239770 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5377bc09-faa4-4050-8213-109ccb227085", "tag": "4da2f73c-9644-4280-92c1-e0be72f1fdad", "status": "completed", "code": 200}]} {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:32:25.240050 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-bf49a8aa-a644-46eb-8247-94322c94f577 {{(pid=92324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:32:25.241846 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5377bc09-faa4-4050-8213-109ccb227085', 'tag': '4da2f73c-9644-4280-92c1-e0be72f1fdad', 'status': 'completed', 'code': 200}
Jun 03 08:32:25.242867 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.333s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:25.338860 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea8e2ea5-f965-4de0-be47-d99857e20656 req-754cc489-17ae-4cf0-9b64-380ae8cbf733 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:25.341199 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ea8e2ea5-f965-4de0-be47-d99857e20656 req-754cc489-17ae-4cf0-9b64-380ae8cbf733 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=b9cf7834ca79439981d1f8e77b89daed&device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 1097 time: 0.1824183
Jun 03 08:32:25.370340 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a386c05e-f38c-4b4c-b7ea-b2ed619cc918 req-3abfa6cc-15f0-4d14-9e42-6abdb74532e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:25.372079 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a386c05e-f38c-4b4c-b7ea-b2ed619cc918 req-3abfa6cc-15f0-4d14-9e42-6abdb74532e7 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=7bac6d994f4d49b292bc39fac07c0311&device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 1096 time: 0.1169269
Jun 03 08:32:25.497243 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea8e2ea5-f965-4de0-be47-d99857e20656 req-87a85f42-9a66-410c-94da-b247438d1ac0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:25.498723 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ea8e2ea5-f965-4de0-be47-d99857e20656 req-87a85f42-9a66-410c-94da-b247438d1ac0 service neutron] 10.222.0.55 "GET /v2.0/networks?id=6861b4db-6cd2-4a5b-bf02-87826345c933 HTTP/1.1" status: 200  len: 920 time: 0.1506965
Jun 03 08:32:25.593143 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ea8e2ea5-f965-4de0-be47-d99857e20656 req-5f1ed41a-54c9-4b65-b1e3-0855e3954535 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=63dd5c57-8935-4b18-94f8-737a7f6e3e1b HTTP/1.1" status: 200  len: 217 time: 0.0855248
Jun 03 08:32:25.640233 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a386c05e-f38c-4b4c-b7ea-b2ed619cc918 req-2ccd9533-03cf-4d66-b583-18ed6137f44e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:25.641873 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a386c05e-f38c-4b4c-b7ea-b2ed619cc918 req-2ccd9533-03cf-4d66-b583-18ed6137f44e service neutron] 10.222.0.55 "GET /v2.0/networks?tenant_id=7bac6d994f4d49b292bc39fac07c0311&shared=False HTTP/1.1" status: 200  len: 916 time: 0.2608113
Jun 03 08:32:25.687455 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea8e2ea5-f965-4de0-be47-d99857e20656 req-c5084e00-dda4-4111-a9a9-3543c32d03e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:25.688509 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ea8e2ea5-f965-4de0-be47-d99857e20656 req-c5084e00-dda4-4111-a9a9-3543c32d03e9 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=0ea4966f-f9de-4d69-a774-7746b1ee12ee HTTP/1.1" status: 200  len: 859 time: 0.0868566
Jun 03 08:32:25.784343 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ea8e2ea5-f965-4de0-be47-d99857e20656 req-f67a0d0e-4f76-472e-94ee-9a173fb52afb service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=6861b4db-6cd2-4a5b-bf02-87826345c933&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0877504
Jun 03 08:32:25.827208 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a386c05e-f38c-4b4c-b7ea-b2ed619cc918 req-2f3cac71-d1c5-4bba-aeb2-3b06df5065b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:25.829397 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a386c05e-f38c-4b4c-b7ea-b2ed619cc918 req-2f3cac71-d1c5-4bba-aeb2-3b06df5065b7 service neutron] 10.222.0.55 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1786978
Jun 03 08:32:25.999540 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 48968) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:26.020664 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ea8e2ea5-f965-4de0-be47-d99857e20656 req-344b08e9-cd3f-463f-a780-b7c768ddfe28 service neutron] 10.222.0.55 "GET /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2256021
Jun 03 08:32:26.030519 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-db74bb44-dbb5-4bff-8ecf-4f0bab4561d9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:26.056688 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-db74bb44-dbb5-4bff-8ecf-4f0bab4561d9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:26.063179 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-db74bb44-dbb5-4bff-8ecf-4f0bab4561d9 admin admin] Usage tracker for resource:security_group_rule and tenant:324327e05a8149da842c7db93f3d088b is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:26.066656 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-db74bb44-dbb5-4bff-8ecf-4f0bab4561d9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:26.077944 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-db74bb44-dbb5-4bff-8ecf-4f0bab4561d9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:26.086984 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716bc020-a678-4841-af96-16af99662374 req-9c0b2acd-2d09-43b4-bdd6-56432824f854 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:26.099253 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-716bc020-a678-4841-af96-16af99662374 req-9c0b2acd-2d09-43b4-bdd6-56432824f854 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=7bac6d994f4d49b292bc39fac07c0311&device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 1096 time: 0.2117252
Jun 03 08:32:26.162860 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:26.185581 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7a549e8-df4d-4fef-99a0-5229b58d627c req-ac216a76-bcc5-4cd6-bb49-7475c2059f3a tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:26.187233 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b7a549e8-df4d-4fef-99a0-5229b58d627c req-ac216a76-bcc5-4cd6-bb49-7475c2059f3a tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 944 time: 0.2478733
Jun 03 08:32:26.188821 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-716bc020-a678-4841-af96-16af99662374 req-7302174f-9b39-4c24-b58b-0b208b6f78ee service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4da2f73c-9644-4280-92c1-e0be72f1fdad HTTP/1.1" status: 200  len: 217 time: 0.0905874
Jun 03 08:32:26.193972 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ea8e2ea5-f965-4de0-be47-d99857e20656 req-857ca971-b3f1-4323-ac94-c515eda7a235 service neutron] 10.222.0.55 "GET /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1690185
Jun 03 08:32:26.239507 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ac2f5f8-74b4-4ce2-81b3-57f07410c8fc req-570d39e5-8328-4f81-b448-88d3a30746cd tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:26.240229 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-2ac2f5f8-74b4-4ce2-81b3-57f07410c8fc req-570d39e5-8328-4f81-b448-88d3a30746cd tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Synchronizing usage tracker for tenant:7bac6d994f4d49b292bc39fac07c0311 on resource:port {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:32:26.303546 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b7a549e8-df4d-4fef-99a0-5229b58d627c req-5c92087c-852b-4c54-ba5b-9de480a48e4e tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1101258
Jun 03 08:32:26.314457 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716bc020-a678-4841-af96-16af99662374 req-d74ff684-da3b-42c7-aefd-88456f795e1b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:26.318925 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-716bc020-a678-4841-af96-16af99662374 req-d74ff684-da3b-42c7-aefd-88456f795e1b service neutron] 10.222.0.55 "GET /v2.0/subnets?id=5f3b55e2-964f-4ce8-9d71-3ac11dc6ebf1 HTTP/1.1" status: 200  len: 855 time: 0.1166000
Jun 03 08:32:26.367777 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-2ac2f5f8-74b4-4ce2-81b3-57f07410c8fc req-570d39e5-8328-4f81-b448-88d3a30746cd tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Unset dirty status for tenant:7bac6d994f4d49b292bc39fac07c0311 on resource:port {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:32:26.369123 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2ac2f5f8-74b4-4ce2-81b3-57f07410c8fc req-570d39e5-8328-4f81-b448-88d3a30746cd tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 943 time: 0.2176533
Jun 03 08:32:26.370992 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-716bc020-a678-4841-af96-16af99662374 req-e5d90cbe-2374-44b3-bd69-41e311b8bfc1 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=f9db9a2a-942b-4a98-97ed-1896cb9158b4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0476806
Jun 03 08:32:26.426301 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2ac2f5f8-74b4-4ce2-81b3-57f07410c8fc req-6518b70f-4e39-47f4-97bc-b8d92a5a81ed tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0510392
Jun 03 08:32:26.434611 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-db74bb44-dbb5-4bff-8ecf-4f0bab4561d9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:26.524507 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-db74bb44-dbb5-4bff-8ecf-4f0bab4561d9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:26.532786 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f6ec2c66-6b35-439f-ad3f-ae457d1c5893 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:26.540710 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-716bc020-a678-4841-af96-16af99662374 req-e783e1fb-5951-481b-a87e-b0f018d57d01 service neutron] 10.222.0.55 "GET /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1590350
Jun 03 08:32:26.617493 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-db74bb44-dbb5-4bff-8ecf-4f0bab4561d9 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=324327e05a8149da842c7db93f3d088b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6134439
Jun 03 08:32:26.617493 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db74bb44-dbb5-4bff-8ecf-4f0bab4561d9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a58cb9fe-ab13-4e7c-8bfd-3edff4f30cb9,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:26.621202 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 48976) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:26.622204 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-db74bb44-dbb5-4bff-8ecf-4f0bab4561d9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:26.763046 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-716bc020-a678-4841-af96-16af99662374 req-1b6ff5c1-39dc-4e23-bc43-5ba71a1965d5 service neutron] 10.222.0.55 "GET /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2142353
Jun 03 08:32:26.767417 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8925de43-f7f7-40fc-8811-231b065a524f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:26.795937 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8925de43-f7f7-40fc-8811-231b065a524f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:27.049052 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8925de43-f7f7-40fc-8811-231b065a524f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:27.053001 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-1e71a782-4276-4bee-80e7-0fb8fec0f292 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:27.068550 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8925de43-f7f7-40fc-8811-231b065a524f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a58cb9fe-ab13-4e7c-8bfd-3edff4f30cb9,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:27.072277 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-8925de43-f7f7-40fc-8811-231b065a524f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:27.074841 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8925de43-f7f7-40fc-8811-231b065a524f admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:27.076027 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-8925de43-f7f7-40fc-8811-231b065a524f admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/a58cb9fe-ab13-4e7c-8bfd-3edff4f30cb9 HTTP/1.1" status: 204  len: 168 time: 0.4529011
Jun 03 08:32:27.499067 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-124727bd-a180-4f78-8cb0-4c48c098b7bc req-dec30a38-5651-4f9f-a59c-74a8553c48bf tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:27.501958 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-124727bd-a180-4f78-8cb0-4c48c098b7bc req-dec30a38-5651-4f9f-a59c-74a8553c48bf tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 944 time: 0.0826828
Jun 03 08:32:27.551542 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-124727bd-a180-4f78-8cb0-4c48c098b7bc req-85255fae-69fd-4b6e-b460-be453f8a79e3 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0451422
Jun 03 08:32:27.639292 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5992a4ba-0245-40a4-b3b0-3fef657e0bb7 req-4a9d9f6d-deba-4215-ae44-81d4d4cd21cf tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:27.648001 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-5992a4ba-0245-40a4-b3b0-3fef657e0bb7 req-4a9d9f6d-deba-4215-ae44-81d4d4cd21cf tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 943 time: 0.0998473
Jun 03 08:32:27.698810 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-5992a4ba-0245-40a4-b3b0-3fef657e0bb7 req-1b21bf2b-b805-4808-9a06-2cceb23cad3c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0497742
Jun 03 08:32:27.832515 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 716f2131-2965-4ead-984f-8ccfcadea071 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:32:27.981865 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 716f2131-2965-4ead-984f-8ccfcadea071, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=716f2131-2965-4ead-984f-8ccfcadea071,segment=NetworkSegment(1b8fb38d-ade8-4355-bd2b-f2b171f31184),segment_id=1b8fb38d-ade8-4355-bd2b-f2b171f31184)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:32:27.996079 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': '716f2131-2965-4ead-984f-8ccfcadea071', 'network_id': '6861b4db-6cd2-4a5b-bf02-87826345c933', 'port_id': '716f2131-2965-4ead-984f-8ccfcadea071', 'mac_address': 'fa:16:3e:b3:a6:e1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 518, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0ea4966f-f9de-4d69-a774-7746b1ee12ee', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:32:28.061526 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:28.088326 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 716f2131-2965-4ead-984f-8ccfcadea071 {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:32:28.107482 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 716f2131-2965-4ead-984f-8ccfcadea071, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=716f2131-2965-4ead-984f-8ccfcadea071,segment=NetworkSegment(1b8fb38d-ade8-4355-bd2b-f2b171f31184),segment_id=1b8fb38d-ade8-4355-bd2b-f2b171f31184)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:32:28.273904 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:28.275029 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 63dd5c57-8935-4b18-94f8-737a7f6e3e1b details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:32:28.295966 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:28.347558 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 63dd5c57-8935-4b18-94f8-737a7f6e3e1b, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=63dd5c57-8935-4b18-94f8-737a7f6e3e1b,segment=NetworkSegment(1b8fb38d-ade8-4355-bd2b-f2b171f31184),segment_id=1b8fb38d-ade8-4355-bd2b-f2b171f31184)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:32:28.368993 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': '63dd5c57-8935-4b18-94f8-737a7f6e3e1b', 'network_id': '6861b4db-6cd2-4a5b-bf02-87826345c933', 'port_id': '63dd5c57-8935-4b18-94f8-737a7f6e3e1b', 'mac_address': 'fa:16:3e:75:2c:9b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 518, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0ea4966f-f9de-4d69-a774-7746b1ee12ee', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:32:28.417392 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=716f2131-2965-4ead-984f-8ccfcadea071,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:28.426281 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:28.440163 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:28.458166 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 63dd5c57-8935-4b18-94f8-737a7f6e3e1b {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:32:28.474467 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 63dd5c57-8935-4b18-94f8-737a7f6e3e1b, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=63dd5c57-8935-4b18-94f8-737a7f6e3e1b,segment=NetworkSegment(1b8fb38d-ade8-4355-bd2b-f2b171f31184),segment_id=1b8fb38d-ade8-4355-bd2b-f2b171f31184)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:32:28.618744 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:28.623749 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-9f4c1b82-d779-497b-89d7-fb246ab60fa1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:28.701593 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=63dd5c57-8935-4b18-94f8-737a7f6e3e1b,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:28.705005 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:28.798911 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27115e70-1e21-4939-8668-6705118c2cee req-3c6f14ca-d53f-419c-93c8-e72070bdf602 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:28.800616 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-27115e70-1e21-4939-8668-6705118c2cee req-3c6f14ca-d53f-419c-93c8-e72070bdf602 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 945 time: 0.1231198
Jun 03 08:32:28.854704 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-27115e70-1e21-4939-8668-6705118c2cee req-9dcaf85a-1aae-4105-b57e-70f36a228bb8 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0469110
Jun 03 08:32:28.892376 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab2af4c2-ea74-4644-a475-55c34ec31b72 req-e633afb0-9c85-4379-a6d1-5d5c5adf9dce tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:28.893991 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ab2af4c2-ea74-4644-a475-55c34ec31b72 req-e633afb0-9c85-4379-a6d1-5d5c5adf9dce tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.0873163
Jun 03 08:32:28.923288 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['63dd5c57-8935-4b18-94f8-737a7f6e3e1b'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:32:28.943151 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ab2af4c2-ea74-4644-a475-55c34ec31b72 req-71621f3b-1d84-440e-b1d0-c3679cf54490 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0421612
Jun 03 08:32:28.983156 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['716f2131-2965-4ead-984f-8ccfcadea071'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:32:29.039589 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69adc2a0-b7f2-4770-8051-94a7345bb872 req-272a0492-5545-4596-ad86-28550dbccc54 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:29.041069 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-69adc2a0-b7f2-4770-8051-94a7345bb872 req-272a0492-5545-4596-ad86-28550dbccc54 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 943 time: 0.0827503
Jun 03 08:32:29.099125 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-69adc2a0-b7f2-4770-8051-94a7345bb872 req-89fc15b6-380d-4cf3-8293-6a3aa505140c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0520027
Jun 03 08:32:30.062793 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44af1aec-f942-4067-a0a1-5cdbb6740243 req-77eded11-59f7-47ba-b698-2175383a0057 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:30.064436 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-44af1aec-f942-4067-a0a1-5cdbb6740243 req-77eded11-59f7-47ba-b698-2175383a0057 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 945 time: 0.0980527
Jun 03 08:32:30.116371 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-44af1aec-f942-4067-a0a1-5cdbb6740243 req-8e1ed863-7eba-43c6-ad28-7ab7cf97415a tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0456269
Jun 03 08:32:30.168291 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ec0469d-af61-4282-b6bf-62e2e1cbc5d7 req-bf1fb78f-3a94-4421-8ff8-8028cc03178a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:30.171993 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-5ec0469d-af61-4282-b6bf-62e2e1cbc5d7 req-bf1fb78f-3a94-4421-8ff8-8028cc03178a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.1017084
Jun 03 08:32:30.217069 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-5ec0469d-af61-4282-b6bf-62e2e1cbc5d7 req-a506faa1-ca21-4d84-aac2-ca0bbcd606fc tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0401070
Jun 03 08:32:30.302570 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c550acee-7b78-437f-8cb3-e283d90e3768 req-f0f3bcba-f48c-4b5d-8e88-0b719976e2a5 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:30.304135 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c550acee-7b78-437f-8cb3-e283d90e3768 req-f0f3bcba-f48c-4b5d-8e88-0b719976e2a5 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 943 time: 0.0804179
Jun 03 08:32:30.361013 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c550acee-7b78-437f-8cb3-e283d90e3768 req-6336f40d-c912-4a08-90a0-734ee763c2f7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0505369
Jun 03 08:32:30.442588 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 49088) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:30.559927 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4d189df6-03b2-4e9e-b7f9-ca2f0d4a8b7d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:30.579259 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-4d189df6-03b2-4e9e-b7f9-ca2f0d4a8b7d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:30.583745 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-4d189df6-03b2-4e9e-b7f9-ca2f0d4a8b7d admin admin] Usage tracker for resource:security_group_rule and tenant:a8bcb6c76774477cb417e093b11f48f0 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:30.587307 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-4d189df6-03b2-4e9e-b7f9-ca2f0d4a8b7d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:30.593718 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-4d189df6-03b2-4e9e-b7f9-ca2f0d4a8b7d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:30.677203 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4d189df6-03b2-4e9e-b7f9-ca2f0d4a8b7d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:30.927775 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4d189df6-03b2-4e9e-b7f9-ca2f0d4a8b7d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:30.951023 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-4c6a2c7b-08af-4c80-99a4-39b1b30aa090 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:30.967944 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-4d189df6-03b2-4e9e-b7f9-ca2f0d4a8b7d admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=a8bcb6c76774477cb417e093b11f48f0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5242965
Jun 03 08:32:30.974075 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 49098) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:30.981759 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d189df6-03b2-4e9e-b7f9-ca2f0d4a8b7d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4924507c-a3f5-491d-ac0d-c076f5aaad63,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:30.984747 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-4d189df6-03b2-4e9e-b7f9-ca2f0d4a8b7d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:31.032565 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e3e74759-f691-4313-b037-bb40bc56b290 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:31.060123 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e3e74759-f691-4313-b037-bb40bc56b290 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:31.273651 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e3e74759-f691-4313-b037-bb40bc56b290 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:31.281822 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-1783dfc4-c4b9-434c-b6dd-823602125a23 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:31.295494 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3e74759-f691-4313-b037-bb40bc56b290 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4924507c-a3f5-491d-ac0d-c076f5aaad63,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:31.299600 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e3e74759-f691-4313-b037-bb40bc56b290 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:31.313066 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e3e74759-f691-4313-b037-bb40bc56b290 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:31.314183 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-e3e74759-f691-4313-b037-bb40bc56b290 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/4924507c-a3f5-491d-ac0d-c076f5aaad63 HTTP/1.1" status: 204  len: 168 time: 0.3390205
Jun 03 08:32:31.342247 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67ec337b-a5bb-4272-b55f-7254df7ff6ef req-65fbc891-2685-4ba2-a79e-4e91741ed5a7 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:31.344017 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-67ec337b-a5bb-4272-b55f-7254df7ff6ef req-65fbc891-2685-4ba2-a79e-4e91741ed5a7 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 945 time: 0.1102371
Jun 03 08:32:31.399127 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-67ec337b-a5bb-4272-b55f-7254df7ff6ef req-629187e1-8ae6-43cc-9eec-b5e35a6615fe tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0489595
Jun 03 08:32:31.419695 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d48fcb7-b617-4a29-b62e-aa434ff61002 req-76629733-4b82-459e-9d64-df62ead9f880 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:31.423020 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3d48fcb7-b617-4a29-b62e-aa434ff61002 req-76629733-4b82-459e-9d64-df62ead9f880 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.0858581
Jun 03 08:32:31.469518 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3d48fcb7-b617-4a29-b62e-aa434ff61002 req-fbf0fb44-d92a-467d-9233-917f4051edde tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0425179
Jun 03 08:32:31.576295 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-491377fb-6e82-4b5d-9361-f5cf4fdf2b0c req-92a9f7ec-b0b2-4ce6-bedb-bb9f728ab345 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:31.577870 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-491377fb-6e82-4b5d-9361-f5cf4fdf2b0c req-92a9f7ec-b0b2-4ce6-bedb-bb9f728ab345 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 943 time: 0.0852461
Jun 03 08:32:31.632830 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-491377fb-6e82-4b5d-9361-f5cf4fdf2b0c req-6c2a361d-5f54-48c1-aae0-9583c8be43b0 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0468714
Jun 03 08:32:32.120344 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 4da2f73c-9644-4280-92c1-e0be72f1fdad details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:32:32.268728 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 4da2f73c-9644-4280-92c1-e0be72f1fdad, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=4da2f73c-9644-4280-92c1-e0be72f1fdad,segment=NetworkSegment(9923ac74-9556-45ec-9044-43728d2a8ec3),segment_id=9923ac74-9556-45ec-9044-43728d2a8ec3)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:32:32.286750 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': '4da2f73c-9644-4280-92c1-e0be72f1fdad', 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4', 'port_id': '4da2f73c-9644-4280-92c1-e0be72f1fdad', 'mac_address': 'fa:16:3e:6a:7f:e9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 511, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5f3b55e2-964f-4ce8-9d71-3ac11dc6ebf1', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:32:32.361582 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:32.380807 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4da2f73c-9644-4280-92c1-e0be72f1fdad {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:32:32.399641 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 4da2f73c-9644-4280-92c1-e0be72f1fdad, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=4da2f73c-9644-4280-92c1-e0be72f1fdad,segment=NetworkSegment(9923ac74-9556-45ec-9044-43728d2a8ec3),segment_id=9923ac74-9556-45ec-9044-43728d2a8ec3)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:32:32.430475 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 49136) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:32.504694 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:32.506598 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:32.563837 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-312790305-network', 'tenant_id': '96ee04709f4540ee8818120a88291b46'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:32:32.570011 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:32.575117 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Usage tracker for resource:network and tenant:96ee04709f4540ee8818120a88291b46 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:32.578528 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:32.581813 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-e89a713f-8949-457a-8612-54784467d2b8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:32.586861 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:32.594362 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=4da2f73c-9644-4280-92c1-e0be72f1fdad,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:32.597996 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:32.681843 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b2c3cf8-ce0e-42de-92f3-4db1f0414e28 req-045a59f6-c475-47b5-80ac-b36e8265d652 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:32.683380 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3b2c3cf8-ce0e-42de-92f3-4db1f0414e28 req-045a59f6-c475-47b5-80ac-b36e8265d652 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.0863609
Jun 03 08:32:32.691212 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40c4e9fc-7b0b-46ea-b3ec-4603507e06d3 req-ab11f3a6-c29d-4025-a404-3a07ab74b583 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:32.692951 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-40c4e9fc-7b0b-46ea-b3ec-4603507e06d3 req-ab11f3a6-c29d-4025-a404-3a07ab74b583 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 945 time: 0.1826627
Jun 03 08:32:32.732509 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3b2c3cf8-ce0e-42de-92f3-4db1f0414e28 req-87f391be-91e7-4ce2-851a-7caffd2d9cfe tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0425942
Jun 03 08:32:32.745061 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-40c4e9fc-7b0b-46ea-b3ec-4603507e06d3 req-f3394ff3-8162-4270-95cb-189a626543ec tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0418658
Jun 03 08:32:32.773216 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Made reservation on behalf of 96ee04709f4540ee8818120a88291b46 for: {'network': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:32:32.775863 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-676039'] for network, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:32.795665 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:32.920368 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:32.929853 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Usage tracker for resource:security_group_rule and tenant:96ee04709f4540ee8818120a88291b46 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:32.935917 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['4da2f73c-9644-4280-92c1-e0be72f1fdad'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:32:32.936068 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:32.947711 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:33.009408 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff43ffe2-a2d2-4ad9-af69-1ccc1bf3e198 req-ef888360-d713-4603-9b67-c815c1d12b98 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:33.010965 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ff43ffe2-a2d2-4ad9-af69-1ccc1bf3e198 req-ef888360-d713-4603-9b67-c815c1d12b98 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 944 time: 0.1306551
Jun 03 08:32:33.090475 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ff43ffe2-a2d2-4ad9-af69-1ccc1bf3e198 req-01f35c65-505b-480a-88a7-6b0b3d36b3f9 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0722783
Jun 03 08:32:33.097842 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:33.270381 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:33.274938 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-202e6673-e86c-4590-aec4-dee27d1e9d21 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:33.304896 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] vlan segment allocate from pool success with {'vlan_id': 513, 'physical_network': 'physnet1'}  {{(pid=92324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 03 08:32:33.314978 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:33.326581 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:33.326931 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.segments_db [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Added segment 9559424d-973e-4a97-92a4-8a446b0a62b5 of type vlan for network 9fa75ad7-a669-4187-8c25-4bc1ee5a9f55
Jun 03 08:32:33.333508 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:33.361161 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8774223827658'] for network, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:33.499036 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820'] for network, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:33.509357 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:33.509357 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:33.509357 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:33.612246 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Pushing event updated for resources: {'Network': ['ID=9fa75ad7-a669-4187-8c25-4bc1ee5a9f55,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:33.614819 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:33.623545 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Network 9fa75ad7-a669-4187-8c25-4bc1ee5a9f55 details requested by agent ovs-agent-dv-cinder-787262-5-iscsi with host dv-cinder-787262-5-iscsi {{(pid=92325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 03 08:32:33.680917 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 1.2463665
Jun 03 08:32:33.681255 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 49172) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:33.689634 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-913c16c9-426f-47a9-b2de-fbcb60140070 admin admin] Request body: {'subnet': {'network_id': '9fa75ad7-a669-4187-8c25-4bc1ee5a9f55', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-312790305-subnet', 'tenant_id': '96ee04709f4540ee8818120a88291b46', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:32:33.700354 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-913c16c9-426f-47a9-b2de-fbcb60140070 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:33.707023 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-913c16c9-426f-47a9-b2de-fbcb60140070 admin admin] Usage tracker for resource:subnet and tenant:96ee04709f4540ee8818120a88291b46 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:33.711717 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-913c16c9-426f-47a9-b2de-fbcb60140070 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:33.737955 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-913c16c9-426f-47a9-b2de-fbcb60140070 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:33.949308 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1167438-47b3-4b06-b8b1-55c778207151 req-4cc0a86e-0604-4ad1-8af6-9acca9c8c0e4 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:33.950826 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f1167438-47b3-4b06-b8b1-55c778207151 req-4cc0a86e-0604-4ad1-8af6-9acca9c8c0e4 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.0928705
Jun 03 08:32:34.001702 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f1167438-47b3-4b06-b8b1-55c778207151 req-1df712c8-125b-4d07-a226-82da1b177d7b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0443797
Jun 03 08:32:34.002862 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-913c16c9-426f-47a9-b2de-fbcb60140070 admin admin] Made reservation on behalf of 96ee04709f4540ee8818120a88291b46 for: {'subnet': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:32:34.005299 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-913c16c9-426f-47a9-b2de-fbcb60140070 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14870279'] for subnet, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:34.129854 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 716f2131-2965-4ead-984f-8ccfcadea071 up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:32:34.267214 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4019ba0-010f-4633-a9ec-248d33a06114 req-a49ad800-990c-40a3-b48c-5ce837392dfd tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:34.268593 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c4019ba0-010f-4633-a9ec-248d33a06114 req-a49ad800-990c-40a3-b48c-5ce837392dfd tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 945 time: 0.1501873
Jun 03 08:32:34.336362 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c4019ba0-010f-4633-a9ec-248d33a06114 req-5c0907ea-2394-431f-8601-1b310db2b2a8 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0568302
Jun 03 08:32:34.338681 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning for port 716f2131-2965-4ead-984f-8ccfcadea071 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:32:34.346210 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port 716f2131-2965-4ead-984f-8ccfcadea071 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:32:34.346366 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:34.482794 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:34.514014 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fdc4e210-a267-4553-8e0c-701eb8001997', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '716f2131-2965-4ead-984f-8ccfcadea071'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:32:34.516532 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-10d57abb-7508-4793-bcfd-96442e528217" -d '{"events": [{"server_uuid": "fdc4e210-a267-4553-8e0c-701eb8001997", "name": "network-vif-plugged", "status": "completed", "tag": "716f2131-2965-4ead-984f-8ccfcadea071"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:32:34.526112 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 716f2131-2965-4ead-984f-8ccfcadea071, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=716f2131-2965-4ead-984f-8ccfcadea071,segment=NetworkSegment(1b8fb38d-ade8-4355-bd2b-f2b171f31184),segment_id=1b8fb38d-ade8-4355-bd2b-f2b171f31184)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:32:34.630111 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:34.631136 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 63dd5c57-8935-4b18-94f8-737a7f6e3e1b up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:32:34.658438 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54ba0742-9aa0-447e-9eff-b72029122d28 req-f12abac8-39d4-42a6-9950-03b17b12f78f tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:34.660036 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-54ba0742-9aa0-447e-9eff-b72029122d28 req-f12abac8-39d4-42a6-9950-03b17b12f78f tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 944 time: 0.1756065
Jun 03 08:32:34.668933 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:34.721321 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-54ba0742-9aa0-447e-9eff-b72029122d28 req-56b75163-72bb-4e61-a7ca-398e24b3f9f0 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0517688
Jun 03 08:32:34.775963 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=716f2131-2965-4ead-984f-8ccfcadea071,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:34.783757 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:34.797114 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-913c16c9-426f-47a9-b2de-fbcb60140070 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15641492', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14870385'] for subnet, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:34.803429 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-8c12192f-c486-4b1d-98dc-f0150e2e9e81 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:34.805089 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:32:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cfc4bc03-3f73-4429-b7e0-71796215d323 x-openstack-request-id: req-cfc4bc03-3f73-4429-b7e0-71796215d323 {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:32:34.805506 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fdc4e210-a267-4553-8e0c-701eb8001997", "name": "network-vif-plugged", "status": "completed", "tag": "716f2131-2965-4ead-984f-8ccfcadea071", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:32:34.805861 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-cfc4bc03-3f73-4429-b7e0-71796215d323 {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:32:34.806556 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fdc4e210-a267-4553-8e0c-701eb8001997', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '716f2131-2965-4ead-984f-8ccfcadea071', 'code': 200}
Jun 03 08:32:34.882596 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-913c16c9-426f-47a9-b2de-fbcb60140070 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4463a771-9390-43b9-805a-b4b8e5004e4c,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:34.886203 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-913c16c9-426f-47a9-b2de-fbcb60140070 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:34.893821 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-913c16c9-426f-47a9-b2de-fbcb60140070 admin admin] Checking segment: {'id': '9559424d-973e-4a97-92a4-8a446b0a62b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 513, 'network_id': '9fa75ad7-a669-4187-8c25-4bc1ee5a9f55'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:32:34.894170 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-913c16c9-426f-47a9-b2de-fbcb60140070 admin admin] Network hostable DHCP agents. Network: 9fa75ad7-a669-4187-8c25-4bc1ee5a9f55, hostable agents: ['07372699-02ac-4239-816f-84b3a5b0eff9'], hosted agents: [] {{(pid=92324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 03 08:32:35.012570 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:35.122148 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning for port 63dd5c57-8935-4b18-94f8-737a7f6e3e1b completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:32:35.130542 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port 63dd5c57-8935-4b18-94f8-737a7f6e3e1b triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:32:35.132560 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:35.139144 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-913c16c9-426f-47a9-b2de-fbcb60140070 admin admin] Network 9fa75ad7-a669-4187-8c25-4bc1ee5a9f55 is scheduled to be hosted by DHCP agent 07372699-02ac-4239-816f-84b3a5b0eff9 with binding_index 1 {{(pid=92324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 03 08:32:35.245859 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e77d3a2d-a8e8-4f7c-a9ca-921bdab731f6 req-aa42940a-699f-4fe1-b79a-4ac97134dbcf tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:35.247529 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e77d3a2d-a8e8-4f7c-a9ca-921bdab731f6 req-aa42940a-699f-4fe1-b79a-4ac97134dbcf tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.0970149
Jun 03 08:32:35.287249 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:35.294171 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e77d3a2d-a8e8-4f7c-a9ca-921bdab731f6 req-d8578318-a628-45f1-93c0-0edd669dbba0 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0403199
Jun 03 08:32:35.324752 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 63dd5c57-8935-4b18-94f8-737a7f6e3e1b, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=63dd5c57-8935-4b18-94f8-737a7f6e3e1b,segment=NetworkSegment(1b8fb38d-ade8-4355-bd2b-f2b171f31184),segment_id=1b8fb38d-ade8-4355-bd2b-f2b171f31184)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:32:35.379330 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-913c16c9-426f-47a9-b2de-fbcb60140070 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-5-iscsi, 9fa75ad7-a669-4187-8c25-4bc1ee5a9f55) {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:32:35.379666 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-50d77576-8066-4cf6-bc64-cad21e3daac6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:35.396372 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb56599e-a75b-42f2-8b14-db25607e5085 None None] Network 9fa75ad7-a669-4187-8c25-4bc1ee5a9f55 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:32:35.404172 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-913c16c9-426f-47a9-b2de-fbcb60140070 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:35.407954 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-913c16c9-426f-47a9-b2de-fbcb60140070 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:35.497332 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:35.498387 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 4da2f73c-9644-4280-92c1-e0be72f1fdad up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:32:35.522831 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7323790e-880b-45b9-8827-1015de8d2d00 req-be860efa-82bd-40ff-91ef-4744d64e1633 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:35.527171 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7323790e-880b-45b9-8827-1015de8d2d00 req-be860efa-82bd-40ff-91ef-4744d64e1633 service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 1099 time: 0.0982406
Jun 03 08:32:35.543778 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:35.563168 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-913c16c9-426f-47a9-b2de-fbcb60140070 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 1.8805294
Jun 03 08:32:35.621711 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e76153db-44de-4ee3-bda9-cdacb2934b00 req-cf1cfcb6-2506-4c09-a584-8e7f9b245991 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:35.631667 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e76153db-44de-4ee3-bda9-cdacb2934b00 req-cf1cfcb6-2506-4c09-a584-8e7f9b245991 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.1453321
Jun 03 08:32:35.637050 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7323790e-880b-45b9-8827-1015de8d2d00 req-8e68a211-dc9c-45d7-8c7f-7a800109b402 service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1017618
Jun 03 08:32:35.703504 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e76153db-44de-4ee3-bda9-cdacb2934b00 req-676af30a-4523-4920-8aff-68fb11c53a05 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0685945
Jun 03 08:32:35.777998 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=63dd5c57-8935-4b18-94f8-737a7f6e3e1b,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:35.798311 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.254s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:35.811093 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78b68373-6be9-4a77-b324-3f9acef9ed8f None None] Network 9fa75ad7-a669-4187-8c25-4bc1ee5a9f55 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:32:35.954092 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fddb358b-2f2b-42e2-b744-698b594aef0b req-753a0151-f21f-4c0c-9792-597408eb67b5 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:35.955613 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-fddb358b-2f2b-42e2-b744-698b594aef0b req-753a0151-f21f-4c0c-9792-597408eb67b5 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 944 time: 0.0837524
Jun 03 08:32:36.001694 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning for port 4da2f73c-9644-4280-92c1-e0be72f1fdad completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:32:36.012911 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-fddb358b-2f2b-42e2-b744-698b594aef0b req-51a10b95-41be-4b0f-8e3b-432ad3255af7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0493250
Jun 03 08:32:36.017468 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port 4da2f73c-9644-4280-92c1-e0be72f1fdad triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:32:36.017468 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:36.154298 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:36.190757 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 4da2f73c-9644-4280-92c1-e0be72f1fdad, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=4da2f73c-9644-4280-92c1-e0be72f1fdad,segment=NetworkSegment(9923ac74-9556-45ec-9044-43728d2a8ec3),segment_id=9923ac74-9556-45ec-9044-43728d2a8ec3)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:32:36.218923 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:36.275858 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:36.277723 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:36.346801 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=4da2f73c-9644-4280-92c1-e0be72f1fdad,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:36.350363 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:36.488309 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2b025e3-868f-4c2a-8a12-7fa1688b2480 req-243084e5-0ea1-4d8e-9531-fbfd5d55e3b1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:36.489793 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e2b025e3-868f-4c2a-8a12-7fa1688b2480 req-243084e5-0ea1-4d8e-9531-fbfd5d55e3b1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.0794990
Jun 03 08:32:36.536479 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e2b025e3-868f-4c2a-8a12-7fa1688b2480 req-ea510ed3-3edd-4aae-89b3-b6176b81e659 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0404727
Jun 03 08:32:36.808126 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '63dd5c57-8935-4b18-94f8-737a7f6e3e1b'}, {'server_uuid': '5377bc09-faa4-4050-8213-109ccb227085', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4da2f73c-9644-4280-92c1-e0be72f1fdad'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:32:36.812597 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1b1406f8-15aa-4669-a4d6-0d3e9a842358" -d '{"events": [{"server_uuid": "a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7", "name": "network-vif-plugged", "status": "completed", "tag": "63dd5c57-8935-4b18-94f8-737a7f6e3e1b"}, {"server_uuid": "5377bc09-faa4-4050-8213-109ccb227085", "name": "network-vif-plugged", "status": "completed", "tag": "4da2f73c-9644-4280-92c1-e0be72f1fdad"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:32:36.891261 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Thu, 03 Jun 2021 08:32:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-86edb3ca-0ee6-456a-a3a0-fa3ff0aa7486 x-openstack-request-id: req-86edb3ca-0ee6-456a-a3a0-fa3ff0aa7486 {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:32:36.891261 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7", "name": "network-vif-plugged", "status": "completed", "tag": "63dd5c57-8935-4b18-94f8-737a7f6e3e1b", "code": 200}, {"server_uuid": "5377bc09-faa4-4050-8213-109ccb227085", "name": "network-vif-plugged", "status": "completed", "tag": "4da2f73c-9644-4280-92c1-e0be72f1fdad", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:32:36.891261 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-86edb3ca-0ee6-456a-a3a0-fa3ff0aa7486 {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:32:36.891261 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '63dd5c57-8935-4b18-94f8-737a7f6e3e1b', 'code': 200}
Jun 03 08:32:36.891261 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5377bc09-faa4-4050-8213-109ccb227085', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4da2f73c-9644-4280-92c1-e0be72f1fdad', 'code': 200}
Jun 03 08:32:36.927284 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39dcfe30-3cf6-4b3d-9eea-0564735fd815 req-c992e5fe-d553-44f7-8a3e-e15d7d91fa18 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:36.930133 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-39dcfe30-3cf6-4b3d-9eea-0564735fd815 req-c992e5fe-d553-44f7-8a3e-e15d7d91fa18 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.1012626
Jun 03 08:32:36.977784 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-39dcfe30-3cf6-4b3d-9eea-0564735fd815 req-7192449f-2044-4dd7-bf53-1c1b389f2fdc tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0405695
Jun 03 08:32:37.244446 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39c39020-7d4c-4b26-b59c-ad2783c330e8 req-3a9302a5-43e5-4fdb-a31a-9b44007b5f34 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:37.244446 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-39c39020-7d4c-4b26-b59c-ad2783c330e8 req-3a9302a5-43e5-4fdb-a31a-9b44007b5f34 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 945 time: 0.0944803
Jun 03 08:32:37.289088 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-39c39020-7d4c-4b26-b59c-ad2783c330e8 req-6b1dd413-bad0-4e09-a149-ac21e6173ab5 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0536046
Jun 03 08:32:37.540446 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ccfd7a0-e3e4-4204-95a4-8b2a930effa8 req-dc07ebbb-1fc2-4c60-94a5-92623b8cdff1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:37.542035 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-880753fd-6fac-4884-8940-d01cd03fe859 req-36f3a4c9-95c1-45ac-8a60-6928bd996bc8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:37.542347 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2ccfd7a0-e3e4-4204-95a4-8b2a930effa8 req-dc07ebbb-1fc2-4c60-94a5-92623b8cdff1 service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 1098 time: 0.1034701
Jun 03 08:32:37.543567 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-880753fd-6fac-4884-8940-d01cd03fe859 req-36f3a4c9-95c1-45ac-8a60-6928bd996bc8 service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 1099 time: 0.1038959
Jun 03 08:32:37.593405 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2ccfd7a0-e3e4-4204-95a4-8b2a930effa8 req-13b020d3-14dd-44b8-81f4-78e2a66e1b1c service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0381627
Jun 03 08:32:37.599363 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-880753fd-6fac-4884-8940-d01cd03fe859 req-7d7b6571-1fa4-4926-a019-3abc4dcb8e12 service neutron] Synchronizing usage tracker for tenant:c379711d07ee4799b0e38ad3e4bcd932 on resource:security_group {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:32:37.751249 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-170c98a6-087c-425b-8024-5c719b3a94bd req-e229f7d8-bee6-4ee5-a4bb-718fee320bda tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:37.752780 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-170c98a6-087c-425b-8024-5c719b3a94bd req-e229f7d8-bee6-4ee5-a4bb-718fee320bda tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.0985284
Jun 03 08:32:37.800972 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-170c98a6-087c-425b-8024-5c719b3a94bd req-3eb7a9db-0695-4c1b-b705-dcb0fc78fe18 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0416420
Jun 03 08:32:37.908618 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-880753fd-6fac-4884-8940-d01cd03fe859 req-7d7b6571-1fa4-4926-a019-3abc4dcb8e12 service neutron] Unset dirty status for tenant:c379711d07ee4799b0e38ad3e4bcd932 on resource:security_group {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:32:37.909795 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-880753fd-6fac-4884-8940-d01cd03fe859 req-7d7b6571-1fa4-4926-a019-3abc4dcb8e12 service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3547766
Jun 03 08:32:38.075865 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:38.165659 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1212d595-5eef-4978-8a43-f59deae48498 req-78360ac2-ab38-4dd4-83d4-0bcf581803f0 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:38.167201 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1212d595-5eef-4978-8a43-f59deae48498 req-78360ac2-ab38-4dd4-83d4-0bcf581803f0 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.0830081
Jun 03 08:32:38.213041 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1212d595-5eef-4978-8a43-f59deae48498 req-b3ffa6e4-b435-45e4-86fc-625c7321c6c7 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0401931
Jun 03 08:32:38.558305 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be553007-720b-411b-bfba-7ebe7edf0ba1 req-143ee26f-9a39-49cc-a9cc-95aa35b14e70 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:38.560320 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-be553007-720b-411b-bfba-7ebe7edf0ba1 req-143ee26f-9a39-49cc-a9cc-95aa35b14e70 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 945 time: 0.1620896
Jun 03 08:32:38.609145 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-be553007-720b-411b-bfba-7ebe7edf0ba1 req-ba7a1b5c-d78e-4ca2-b0d0-d2ae4c6740ab tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0428777
Jun 03 08:32:39.010689 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27c7ec3d-7e11-45fa-b00f-9d4857aaddce req-add191e5-3794-4ac4-9a3a-2cb3bf7fbbf7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:39.015446 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-27c7ec3d-7e11-45fa-b00f-9d4857aaddce req-add191e5-3794-4ac4-9a3a-2cb3bf7fbbf7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.0979316
Jun 03 08:32:39.080161 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-27c7ec3d-7e11-45fa-b00f-9d4857aaddce req-9f020430-af1e-4dda-9224-7abe82c3a2a8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0605481
Jun 03 08:32:39.303075 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-14efaeaf-8f5d-4fb8-85e2-a5904546311c tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:39.304644 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-14efaeaf-8f5d-4fb8-85e2-a5904546311c tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Synchronizing usage tracker for tenant:96ee04709f4540ee8818120a88291b46 on resource:network {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:32:39.321999 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:32:39.419804 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ab83abb-2045-4e6b-aed1-1e03257c3766 req-d24f8800-09ea-4b0e-98b5-686db3baf85a tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:39.421250 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1ab83abb-2045-4e6b-aed1-1e03257c3766 req-d24f8800-09ea-4b0e-98b5-686db3baf85a tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.0818179
Jun 03 08:32:39.447009 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-14efaeaf-8f5d-4fb8-85e2-a5904546311c tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Unset dirty status for tenant:96ee04709f4540ee8818120a88291b46 on resource:network {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:32:39.448335 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-14efaeaf-8f5d-4fb8-85e2-a5904546311c tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/networks?id=9fa75ad7-a669-4187-8c25-4bc1ee5a9f55 HTTP/1.1" status: 200  len: 808 time: 0.3094196
Jun 03 08:32:39.465132 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-bda91309-86b3-419f-a487-cd9cdd037539 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/quotas/96ee04709f4540ee8818120a88291b46 HTTP/1.1" status: 200  len: 375 time: 0.0109553
Jun 03 08:32:39.469681 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1ab83abb-2045-4e6b-aed1-1e03257c3766 req-a6c1434a-b7e3-455d-b799-c3325446aba9 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0420856
Jun 03 08:32:39.517489 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-1c5d8b8a-af34-4d43-8152-dfd3bddde1a6 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=96ee04709f4540ee8818120a88291b46&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0459728
Jun 03 08:32:39.659122 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-0b445df6-9e5b-4faa-9b0a-125c9b1fae1e service neutron] 10.222.0.11 "GET /v2.0/networks/9fa75ad7-a669-4187-8c25-4bc1ee5a9f55?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1339729
Jun 03 08:32:39.803042 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-3e9b0e41-752b-4835-ae57-117c562ebf29 service neutron] 10.222.0.11 "GET /v2.0/networks/9fa75ad7-a669-4187-8c25-4bc1ee5a9f55?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1390803
Jun 03 08:32:39.842569 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7be1cf6d-e784-43a0-b313-2a6a89691135 req-520ed32c-2fa4-44c2-a2b7-b51ae9b49085 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:39.844435 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7be1cf6d-e784-43a0-b313-2a6a89691135 req-520ed32c-2fa4-44c2-a2b7-b51ae9b49085 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 945 time: 0.1011827
Jun 03 08:32:39.899328 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7be1cf6d-e784-43a0-b313-2a6a89691135 req-86a8730d-6f80-4875-9c0b-2063b5d993db tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0469744
Jun 03 08:32:40.311512 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a621919f-ddbe-41f5-8ec1-8bf99bec1f50 req-4d5bb3db-43c1-40a6-9ed7-6e96aa52d3f2 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=5df35469-23b8-40f8-a651-bc60a1aadd9e HTTP/1.1" status: 200  len: 210 time: 0.1383364
Jun 03 08:32:40.437646 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dca07bb-a593-4378-a957-994e47b98472 req-7a73ca1a-17e8-41b3-9a0e-b9a4f680b558 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:40.439951 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8dca07bb-a593-4378-a957-994e47b98472 req-7a73ca1a-17e8-41b3-9a0e-b9a4f680b558 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.1239841
Jun 03 08:32:40.493332 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8dca07bb-a593-4378-a957-994e47b98472 req-e872565a-ef96-4696-9bfa-1161da48b648 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0451725
Jun 03 08:32:40.688804 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ffbf40c-f668-4940-a383-257c58fdd90b req-59f30fbc-87a6-4401-892f-3df3b4779259 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:40.690414 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-5ffbf40c-f668-4940-a383-257c58fdd90b req-59f30fbc-87a6-4401-892f-3df3b4779259 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.0828807
Jun 03 08:32:40.744285 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-5ffbf40c-f668-4940-a383-257c58fdd90b req-27e58ef8-d1cf-4b47-b166-439d54b1055e tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0458496
Jun 03 08:32:41.408714 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a3030382-bc4d-4840-b84f-efd14140066d req-e53a23fc-06c6-4b8f-b1af-67dd75ad5893 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=5df35469-23b8-40f8-a651-bc60a1aadd9e HTTP/1.1" status: 200  len: 210 time: 0.0439587
Jun 03 08:32:41.621309 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6dcefa5-e4fd-47b7-a7dd-b8a6de0ac853 req-0863107b-2a35-4b8b-9ef3-39b0e1b3167b tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:41.623123 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b6dcefa5-e4fd-47b7-a7dd-b8a6de0ac853 req-0863107b-2a35-4b8b-9ef3-39b0e1b3167b tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.1029744
Jun 03 08:32:41.699999 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b6dcefa5-e4fd-47b7-a7dd-b8a6de0ac853 req-97678031-0a39-40a3-9563-ea621710fa3d tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0625532
Jun 03 08:32:41.763179 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48d1f986-98ae-4dd2-aae8-10a73d86297c req-a59f6e55-56f0-47cf-a897-6256dcff68b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:41.765202 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-48d1f986-98ae-4dd2-aae8-10a73d86297c req-a59f6e55-56f0-47cf-a897-6256dcff68b6 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=b9cf7834ca79439981d1f8e77b89daed&device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 1099 time: 0.1940708
Jun 03 08:32:41.823738 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9db2d442-58be-43fc-bd1f-d51715987253 req-5972ce0b-4b8d-43f4-a262-f9cc6114845f tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:41.825199 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-9db2d442-58be-43fc-bd1f-d51715987253 req-5972ce0b-4b8d-43f4-a262-f9cc6114845f tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.1478679
Jun 03 08:32:41.941010 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-9db2d442-58be-43fc-bd1f-d51715987253 req-dcffc950-4ab6-4c97-8c94-f7358bf31590 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1101990
Jun 03 08:32:41.958391 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48d1f986-98ae-4dd2-aae8-10a73d86297c req-81d83805-c34a-4a9e-9b6a-f538207c3842 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:41.960631 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-48d1f986-98ae-4dd2-aae8-10a73d86297c req-81d83805-c34a-4a9e-9b6a-f538207c3842 service neutron] 10.222.0.55 "GET /v2.0/networks?id=6861b4db-6cd2-4a5b-bf02-87826345c933 HTTP/1.1" status: 200  len: 920 time: 0.1831682
Jun 03 08:32:42.032475 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-48d1f986-98ae-4dd2-aae8-10a73d86297c req-1512c6f4-0220-453a-94b0-6e2dd3ff6e7d service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=63dd5c57-8935-4b18-94f8-737a7f6e3e1b HTTP/1.1" status: 200  len: 217 time: 0.0658927
Jun 03 08:32:42.098510 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48d1f986-98ae-4dd2-aae8-10a73d86297c req-189e774a-8f0d-42b0-b21a-d51fcdea30ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:42.099839 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-48d1f986-98ae-4dd2-aae8-10a73d86297c req-189e774a-8f0d-42b0-b21a-d51fcdea30ae service neutron] 10.222.0.55 "GET /v2.0/subnets?id=0ea4966f-f9de-4d69-a774-7746b1ee12ee HTTP/1.1" status: 200  len: 859 time: 0.0608346
Jun 03 08:32:42.172348 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-48d1f986-98ae-4dd2-aae8-10a73d86297c req-2f550e96-86a7-4f8d-9c3b-42247ee43ed4 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=6861b4db-6cd2-4a5b-bf02-87826345c933&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0506539
Jun 03 08:32:42.313706 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-48d1f986-98ae-4dd2-aae8-10a73d86297c req-d9c03189-8b9f-41ea-88c7-6e40cb94be92 service neutron] 10.222.0.55 "GET /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1373353
Jun 03 08:32:42.603315 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 49388) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:42.647782 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-48d1f986-98ae-4dd2-aae8-10a73d86297c req-e3281592-2c67-40f5-9d90-feead0ebd902 service neutron] 10.222.0.55 "GET /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3268962
Jun 03 08:32:42.706404 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a847d4e8-4f44-47ab-ac20-2f9cacdb55aa req-9d50813c-3745-43dd-a16b-2fc0089f62b0 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=5df35469-23b8-40f8-a651-bc60a1aadd9e HTTP/1.1" status: 200  len: 210 time: 0.0615695
Jun 03 08:32:42.735954 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:42.755545 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:42.760693 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] Usage tracker for resource:security_group_rule and tenant:4e6e594c96074fc2a4cb94288e2c62fd is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:42.765656 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:42.772921 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:42.872620 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:42.925602 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-684d845f-9177-43db-8962-438d63fb510f req-33c807ca-dee6-4726-b452-8125126e3f71 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:42.927099 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-684d845f-9177-43db-8962-438d63fb510f req-33c807ca-dee6-4726-b452-8125126e3f71 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.0902994
Jun 03 08:32:42.978314 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-684d845f-9177-43db-8962-438d63fb510f req-dfa1b6ce-cb1a-48a8-9523-8fe530109138 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0438306
Jun 03 08:32:42.990396 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:43.002783 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-9adafe2e-ed4a-491d-aa96-1c500def63d1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:43.055550 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a7e8947c-018c-477c-8da7-ad7cbc82bebf,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:43.065162 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=4e6e594c96074fc2a4cb94288e2c62fd&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4896581
Jun 03 08:32:43.066801 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.067366 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.067973 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.068108 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 49402) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:43.068685 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.069340 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.070035 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.070579 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.071100 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.071451 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.071815 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.072159 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.072498 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.086913 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:43.135684 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9b38759a-d6e7-419b-be2b-bbf63ab76bde admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:43.155683 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 49404) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:43.231981 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9b38759a-d6e7-419b-be2b-bbf63ab76bde admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:43.307678 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c0dc056d-4ee5-4812-80c6-7c276b5c89f7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:43.313662 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daedef91-8813-41ca-978e-85c1914c6e11 req-442c9edd-379e-41fe-9cc0-5ca252c76691 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:43.315252 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-daedef91-8813-41ca-978e-85c1914c6e11 req-442c9edd-379e-41fe-9cc0-5ca252c76691 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.1659033
Jun 03 08:32:43.327567 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-c0dc056d-4ee5-4812-80c6-7c276b5c89f7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:43.331929 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-c0dc056d-4ee5-4812-80c6-7c276b5c89f7 admin admin] Usage tracker for resource:security_group_rule and tenant:7cb4f2bf5b8d46ee87fc026474619fe3 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:43.335055 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-c0dc056d-4ee5-4812-80c6-7c276b5c89f7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:43.340901 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-c0dc056d-4ee5-4812-80c6-7c276b5c89f7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:43.369068 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-daedef91-8813-41ca-978e-85c1914c6e11 req-288ee037-8d80-45b6-891e-e26cf8707249 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0441825
Jun 03 08:32:43.470168 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9b38759a-d6e7-419b-be2b-bbf63ab76bde admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:43.474705 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:43.488581 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b38759a-d6e7-419b-be2b-bbf63ab76bde admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a7e8947c-018c-477c-8da7-ad7cbc82bebf,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:43.498916 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b38759a-d6e7-419b-be2b-bbf63ab76bde admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.499278 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b38759a-d6e7-419b-be2b-bbf63ab76bde admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.499659 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b38759a-d6e7-419b-be2b-bbf63ab76bde admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.500005 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b38759a-d6e7-419b-be2b-bbf63ab76bde admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.500345 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b38759a-d6e7-419b-be2b-bbf63ab76bde admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.500774 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b38759a-d6e7-419b-be2b-bbf63ab76bde admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.501116 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b38759a-d6e7-419b-be2b-bbf63ab76bde admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.501457 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b38759a-d6e7-419b-be2b-bbf63ab76bde admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.501837 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b38759a-d6e7-419b-be2b-bbf63ab76bde admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.502132 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b38759a-d6e7-419b-be2b-bbf63ab76bde admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.502439 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b38759a-d6e7-419b-be2b-bbf63ab76bde admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.502790 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b38759a-d6e7-419b-be2b-bbf63ab76bde admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:32:43.505935 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9b38759a-d6e7-419b-be2b-bbf63ab76bde admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:43.507357 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-9b38759a-d6e7-419b-be2b-bbf63ab76bde admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/a7e8947c-018c-477c-8da7-ad7cbc82bebf HTTP/1.1" status: 204  len: 168 time: 0.4381070
Jun 03 08:32:43.508739 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9b38759a-d6e7-419b-be2b-bbf63ab76bde admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:43.559770 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c0dc056d-4ee5-4812-80c6-7c276b5c89f7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:43.738004 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c0dc056d-4ee5-4812-80c6-7c276b5c89f7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:43.756030 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-fb1c566e-08c8-4c3c-bade-9a7c6429a6fc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.002s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:43.839245 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-c0dc056d-4ee5-4812-80c6-7c276b5c89f7 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=7cb4f2bf5b8d46ee87fc026474619fe3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6798806
Jun 03 08:32:43.839245 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0dc056d-4ee5-4812-80c6-7c276b5c89f7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8edbca1c-b624-4a6e-8711-0445f505cb39,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:43.851036 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 49424) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:43.851840 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c0dc056d-4ee5-4812-80c6-7c276b5c89f7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:43.926945 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 49428) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:43.938414 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3ab7cbcc-9d6d-4f5e-9c01-eda38457c095 req-bdd0bf71-fc81-48b6-a366-fb30aaf135ea tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=5df35469-23b8-40f8-a651-bc60a1aadd9e HTTP/1.1" status: 200  len: 210 time: 0.0602274
Jun 03 08:32:43.996232 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e5cf0feb-cf52-4989-a948-379444a2eef1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:44.090205 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-66932741-575c-4319-b18c-d0d076f1feec admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:44.095088 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e5cf0feb-cf52-4989-a948-379444a2eef1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:44.117632 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-66932741-575c-4319-b18c-d0d076f1feec admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:44.129127 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-66932741-575c-4319-b18c-d0d076f1feec admin admin] Usage tracker for resource:security_group_rule and tenant:7bc9655fc6e041519b9d271f4d37248f is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:44.133679 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-66932741-575c-4319-b18c-d0d076f1feec admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:44.141944 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-66932741-575c-4319-b18c-d0d076f1feec admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:44.239523 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-66932741-575c-4319-b18c-d0d076f1feec admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:44.267851 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-02e665d6-555c-4c97-bd48-42c0a468440a tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:44.269255 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-02e665d6-555c-4c97-bd48-42c0a468440a tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.55 "GET /v2.0/networks?id=9fa75ad7-a669-4187-8c25-4bc1ee5a9f55 HTTP/1.1" status: 200  len: 808 time: 0.3074124
Jun 03 08:32:44.291987 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-22e2c99b-98c3-4a7b-a57e-43aa6ae37583 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Request body: {'port': {'device_id': '5df35469-23b8-40f8-a651-bc60a1aadd9e', 'network_id': '9fa75ad7-a669-4187-8c25-4bc1ee5a9f55', 'admin_state_up': True, 'tenant_id': '96ee04709f4540ee8818120a88291b46'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:32:44.319980 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84c7ff18-c0ff-4370-a825-4b46d4166ce0 req-d504d50d-7c03-48c8-b490-6990d5fcf15e tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:44.325372 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-84c7ff18-c0ff-4370-a825-4b46d4166ce0 req-d504d50d-7c03-48c8-b490-6990d5fcf15e tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.1464818
Jun 03 08:32:44.347811 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-66932741-575c-4319-b18c-d0d076f1feec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:44.363548 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e5cf0feb-cf52-4989-a948-379444a2eef1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:44.384472 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-3db5cb50-035a-47a3-8bb1-586fc36ee063 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:44.433306 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-4268e012-54da-4e8f-95f8-82c54fef205e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:44.456424 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-66932741-575c-4319-b18c-d0d076f1feec admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=7bc9655fc6e041519b9d271f4d37248f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5220451
Jun 03 08:32:44.456424 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66932741-575c-4319-b18c-d0d076f1feec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=74d5c03c-9377-491d-bb61-7634131bc0a4,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:44.461744 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5cf0feb-cf52-4989-a948-379444a2eef1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8edbca1c-b624-4a6e-8711-0445f505cb39,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:44.470379 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e5cf0feb-cf52-4989-a948-379444a2eef1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:44.471142 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 49438) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:44.475135 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-66932741-575c-4319-b18c-d0d076f1feec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:44.494063 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e5cf0feb-cf52-4989-a948-379444a2eef1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:44.497530 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-e5cf0feb-cf52-4989-a948-379444a2eef1 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/8edbca1c-b624-4a6e-8711-0445f505cb39 HTTP/1.1" status: 204  len: 168 time: 0.6544480
Jun 03 08:32:44.501953 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-84c7ff18-c0ff-4370-a825-4b46d4166ce0 req-fd52b167-f3ad-45f9-b621-ac1fc62caff6 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1592267
Jun 03 08:32:44.526202 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-22e2c99b-98c3-4a7b-a57e-43aa6ae37583 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:44.539209 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-22e2c99b-98c3-4a7b-a57e-43aa6ae37583 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Usage tracker for resource:port and tenant:96ee04709f4540ee8818120a88291b46 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:44.542824 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-22e2c99b-98c3-4a7b-a57e-43aa6ae37583 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:44.550631 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-22e2c99b-98c3-4a7b-a57e-43aa6ae37583 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:44.572871 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 49444) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:44.591583 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-6a186f43-5777-4377-90a7-7652fb7fa28b admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:44.607309 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-6a186f43-5777-4377-90a7-7652fb7fa28b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:44.611343 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-6a186f43-5777-4377-90a7-7652fb7fa28b admin admin] Usage tracker for resource:security_group_rule and tenant:e71d727687db41328c584fffbd35fc52 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:44.614252 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-6a186f43-5777-4377-90a7-7652fb7fa28b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:44.616668 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-288d6b99-8f79-481c-81a0-3c854d106a66 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:44.620409 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-6a186f43-5777-4377-90a7-7652fb7fa28b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:44.625590 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-22e2c99b-98c3-4a7b-a57e-43aa6ae37583 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Made reservation on behalf of 96ee04709f4540ee8818120a88291b46 for: {'port': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:32:44.629320 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-22e2c99b-98c3-4a7b-a57e-43aa6ae37583 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:44.653308 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-288d6b99-8f79-481c-81a0-3c854d106a66 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:44.682388 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ef2b9cf-19d6-445b-a858-2e23ff3db537 req-9eb545aa-8c7f-4a7f-b3a5-d6d3d0425e1b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:44.684171 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8ef2b9cf-19d6-445b-a858-2e23ff3db537 req-9eb545aa-8c7f-4a7f-b3a5-d6d3d0425e1b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.1589165
Jun 03 08:32:44.741300 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8ef2b9cf-19d6-445b-a858-2e23ff3db537 req-54a58947-17b5-4c94-99c1-3d66d8c95f02 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0471089
Jun 03 08:32:44.852493 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-6a186f43-5777-4377-90a7-7652fb7fa28b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:44.861897 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.db_base_plugin_common [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-22e2c99b-98c3-4a7b-a57e-43aa6ae37583 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Allocated IP 172.20.0.7 (9fa75ad7-a669-4187-8c25-4bc1ee5a9f55/4463a771-9390-43b9-805a-b4b8e5004e4c/6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f) {{(pid=92324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:32:44.896341 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-288d6b99-8f79-481c-81a0-3c854d106a66 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:44.896341 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-7e214a40-0b4a-4256-8ff4-5db1c9f1162a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:44.903987 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-288d6b99-8f79-481c-81a0-3c854d106a66 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=74d5c03c-9377-491d-bb61-7634131bc0a4,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:44.907997 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-288d6b99-8f79-481c-81a0-3c854d106a66 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:44.926281 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-288d6b99-8f79-481c-81a0-3c854d106a66 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:44.933946 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-288d6b99-8f79-481c-81a0-3c854d106a66 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/74d5c03c-9377-491d-bb61-7634131bc0a4 HTTP/1.1" status: 204  len: 168 time: 0.4564986
Jun 03 08:32:44.954572 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-6a186f43-5777-4377-90a7-7652fb7fa28b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:44.966916 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-8e37ccbd-c86e-46c2-9791-cb04ccfe98be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:45.090334 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a186f43-5777-4377-90a7-7652fb7fa28b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=40974007-2f5a-4c07-b234-1525b375b5b6,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:45.094822 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-6a186f43-5777-4377-90a7-7652fb7fa28b admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=e71d727687db41328c584fffbd35fc52&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5208330
Jun 03 08:32:45.096388 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-6a186f43-5777-4377-90a7-7652fb7fa28b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:45.097650 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 49456) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:45.144925 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b859b769-7e89-442b-8459-2d2bc9ee679b req-77a4ff18-f797-484f-ba71-778db719ffbd tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=5df35469-23b8-40f8-a651-bc60a1aadd9e HTTP/1.1" status: 200  len: 210 time: 0.0665133
Jun 03 08:32:45.205298 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d6394f82-4163-4f2d-aa30-92cb2f974095 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:45.227050 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-22e2c99b-98c3-4a7b-a57e-43aa6ae37583 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Notify callbacks [] for port, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:45.238710 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d6394f82-4163-4f2d-aa30-92cb2f974095 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:45.378024 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d6394f82-4163-4f2d-aa30-92cb2f974095 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:45.378274 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-22e2c99b-98c3-4a7b-a57e-43aa6ae37583 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:45.384581 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-655a5cfd-a17b-4bc2-a52d-eb24d913243f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:45.386287 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:45.402809 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6394f82-4163-4f2d-aa30-92cb2f974095 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=40974007-2f5a-4c07-b234-1525b375b5b6,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:45.406112 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-d6394f82-4163-4f2d-aa30-92cb2f974095 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:45.409759 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d6394f82-4163-4f2d-aa30-92cb2f974095 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:45.430980 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-d6394f82-4163-4f2d-aa30-92cb2f974095 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/40974007-2f5a-4c07-b234-1525b375b5b6 HTTP/1.1" status: 204  len: 168 time: 0.3316584
Jun 03 08:32:45.487358 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-22e2c99b-98c3-4a7b-a57e-43aa6ae37583 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Network 9fa75ad7-a669-4187-8c25-4bc1ee5a9f55 is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:32:45.487358 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-22e2c99b-98c3-4a7b-a57e-43aa6ae37583 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:32:45.489355 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-22e2c99b-98c3-4a7b-a57e-43aa6ae37583 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Received port after_create {{(pid=92324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:32:45.527517 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22e2c99b-98c3-4a7b-a57e-43aa6ae37583 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Pushing event updated for resources: {'Port': ['ID=6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:45.532171 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-22e2c99b-98c3-4a7b-a57e-43aa6ae37583 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:45.568031 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-22e2c99b-98c3-4a7b-a57e-43aa6ae37583 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:45.569281 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-22e2c99b-98c3-4a7b-a57e-43aa6ae37583 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for port, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:45.716576 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-22e2c99b-98c3-4a7b-a57e-43aa6ae37583 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.55 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.4292626
Jun 03 08:32:45.734514 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Request body: {'port': {'device_id': '5df35469-23b8-40f8-a651-bc60a1aadd9e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:32:45.744759 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44003979-8942-47a3-b225-52aa9c727579 req-e33231ce-ac7a-476a-b430-06bc62c4d5db tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:45.746272 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-44003979-8942-47a3-b225-52aa9c727579 req-e33231ce-ac7a-476a-b430-06bc62c4d5db tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.1003499
Jun 03 08:32:45.795786 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-44003979-8942-47a3-b225-52aa9c727579 req-f8070948-a4b3-42ce-a1b0-0aa28c123324 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0429540
Jun 03 08:32:46.008465 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:46.104056 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be744e6e-b0f3-4aab-a0dc-4fb5a4546c54 req-0a2db827-89fc-45a7-8da4-b462e9a8b7f0 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:46.105636 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-be744e6e-b0f3-4aab-a0dc-4fb5a4546c54 req-0a2db827-89fc-45a7-8da4-b462e9a8b7f0 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.1761181
Jun 03 08:32:46.235491 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 49488) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:46.236901 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-be744e6e-b0f3-4aab-a0dc-4fb5a4546c54 req-aa453b18-99d5-4568-a452-fe008ec29c68 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0874496
Jun 03 08:32:46.256002 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-6d33dcad-e82b-4193-b499-ab8443c780b2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:46.297337 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-6d33dcad-e82b-4193-b499-ab8443c780b2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:46.297337 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-6d33dcad-e82b-4193-b499-ab8443c780b2 admin admin] Usage tracker for resource:security_group_rule and tenant:4229b9d50a794c84a16f3acc56549a59 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:46.299892 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-6d33dcad-e82b-4193-b499-ab8443c780b2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:46.307644 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-6d33dcad-e82b-4193-b499-ab8443c780b2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:46.448138 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-6d33dcad-e82b-4193-b499-ab8443c780b2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:46.552012 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-6d33dcad-e82b-4193-b499-ab8443c780b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:46.555255 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22fdbe6a-4f95-4ada-b985-c87349f4057a req-b033b9c4-567a-49fd-908a-8e4409b8f24f tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:46.555419 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-22fdbe6a-4f95-4ada-b985-c87349f4057a req-b033b9c4-567a-49fd-908a-8e4409b8f24f tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Synchronizing usage tracker for tenant:96ee04709f4540ee8818120a88291b46 on resource:port {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:32:46.566463 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.notifiers.nova [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f {{(pid=92324) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:32:46.577922 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:46.593646 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-7ea1115f-db64-4ef1-a149-ff47a5c67d9e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:46.598431 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.provisioning_blocks [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Transition to ACTIVE for port object 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f will not be triggered until provisioned by entity L2. {{(pid=92324) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:32:46.738694 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-6d33dcad-e82b-4193-b499-ab8443c780b2 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=4229b9d50a794c84a16f3acc56549a59&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5020528
Jun 03 08:32:46.741273 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d33dcad-e82b-4193-b499-ab8443c780b2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f63e0a64-3bc1-40e0-9c76-c4d4455a253b,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:46.741822 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 49498) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:46.744937 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-6d33dcad-e82b-4193-b499-ab8443c780b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:46.787086 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-106af63f-7277-48de-af10-89be89e1472a req-cfa03409-32e4-4d76-99ee-bf8fcb17aefc tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:46.788765 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-106af63f-7277-48de-af10-89be89e1472a req-cfa03409-32e4-4d76-99ee-bf8fcb17aefc tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.1253192
Jun 03 08:32:46.809109 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2bb1fb4e-f11b-4a60-a956-f4aa8c1b4990 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:46.826635 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15641369'] for port, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:46.826635 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-22fdbe6a-4f95-4ada-b985-c87349f4057a req-b033b9c4-567a-49fd-908a-8e4409b8f24f tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Unset dirty status for tenant:96ee04709f4540ee8818120a88291b46 on resource:port {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:32:46.832477 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-22fdbe6a-4f95-4ada-b985-c87349f4057a req-b033b9c4-567a-49fd-908a-8e4409b8f24f tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=5df35469-23b8-40f8-a651-bc60a1aadd9e HTTP/1.1" status: 200  len: 931 time: 0.4596715
Jun 03 08:32:46.841892 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 49502) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:46.861112 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:46.863278 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-106af63f-7277-48de-af10-89be89e1472a req-53a88479-2fe9-4233-b499-2a1f41ddc845 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0687857
Jun 03 08:32:46.866714 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a17d73c8-c217-4d4b-8d9b-030817402eb4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:46.888008 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-a17d73c8-c217-4d4b-8d9b-030817402eb4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:46.892371 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-a17d73c8-c217-4d4b-8d9b-030817402eb4 admin admin] Usage tracker for resource:security_group_rule and tenant:358e247261494220b4900d0da0e48ab8 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:46.896233 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-a17d73c8-c217-4d4b-8d9b-030817402eb4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:46.903593 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-a17d73c8-c217-4d4b-8d9b-030817402eb4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:46.950772 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2bb1fb4e-f11b-4a60-a956-f4aa8c1b4990 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:46.958737 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Pushing event updated for resources: {'Port': ['ID=6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f,revision_number=2']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:46.985209 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:46.989055 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-22fdbe6a-4f95-4ada-b985-c87349f4057a req-4b787a7f-7d38-476a-a985-dfe8496dd94e tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Synchronizing usage tracker for tenant:96ee04709f4540ee8818120a88291b46 on resource:security_group {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:32:47.046617 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a17d73c8-c217-4d4b-8d9b-030817402eb4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:47.092192 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ec12d4b-cad6-405e-ae42-d0a08a1f0b3a req-6d171389-5848-415a-85d3-6cf0a902eea6 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:47.094754 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9ec12d4b-cad6-405e-ae42-d0a08a1f0b3a req-6d171389-5848-415a-85d3-6cf0a902eea6 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.0957510
Jun 03 08:32:47.151915 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9ec12d4b-cad6-405e-ae42-d0a08a1f0b3a req-f48bf5c2-4649-45d6-9f71-1383284545f0 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0500515
Jun 03 08:32:47.176041 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a17d73c8-c217-4d4b-8d9b-030817402eb4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:47.184999 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f1702bbc-2719-4292-8c0d-88e734a49997 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:47.204195 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.managers [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Attempting to bind port 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92324) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:32:47.204741 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.managers [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Attempting to bind port 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '9559424d-973e-4a97-92a4-8a446b0a62b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 513, 'network_id': '9fa75ad7-a669-4187-8c25-4bc1ee5a9f55'}] {{(pid=92324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:32:47.204845 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Attempting to bind port 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f on network 9fa75ad7-a669-4187-8c25-4bc1ee5a9f55 {{(pid=92324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:32:47.209806 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Port 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f on network 9fa75ad7-a669-4187-8c25-4bc1ee5a9f55 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 03 08:32:47.210360 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Attempting to bind port 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f on network 9fa75ad7-a669-4187-8c25-4bc1ee5a9f55 {{(pid=92324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:32:47.215747 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Checking agent: {'id': '181c5753-100b-4f03-bda8-e34279b057f4', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'started_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 32, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:32:47.216086 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Checking segment: {'id': '9559424d-973e-4a97-92a4-8a446b0a62b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 513, 'network_id': '9fa75ad7-a669-4187-8c25-4bc1ee5a9f55'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:32:47.216465 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Bound using segment: {'id': '9559424d-973e-4a97-92a4-8a446b0a62b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 513, 'network_id': '9fa75ad7-a669-4187-8c25-4bc1ee5a9f55'} {{(pid=92324) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:32:47.216899 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.managers [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Bound port: 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9559424d-973e-4a97-92a4-8a446b0a62b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 513, 'network_id': '9fa75ad7-a669-4187-8c25-4bc1ee5a9f55'}}] {{(pid=92324) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:32:47.217250 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:47.233200 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-a17d73c8-c217-4d4b-8d9b-030817402eb4 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=358e247261494220b4900d0da0e48ab8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3885605
Jun 03 08:32:47.233200 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a17d73c8-c217-4d4b-8d9b-030817402eb4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e90ded50-876c-41d6-9d61-32d5fb0d6c83,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:47.233482 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 49508) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:47.234879 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a17d73c8-c217-4d4b-8d9b-030817402eb4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:47.249141 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-22fdbe6a-4f95-4ada-b985-c87349f4057a req-4b787a7f-7d38-476a-a985-dfe8496dd94e tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Unset dirty status for tenant:96ee04709f4540ee8818120a88291b46 on resource:security_group {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:32:47.249729 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-22fdbe6a-4f95-4ada-b985-c87349f4057a req-4b787a7f-7d38-476a-a985-dfe8496dd94e tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4164908
Jun 03 08:32:47.345085 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2bb1fb4e-f11b-4a60-a956-f4aa8c1b4990 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:47.352727 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-873b276b-6b5e-4ac3-a6bb-ce4e0c3a71f0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:47.387036 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bb1fb4e-f11b-4a60-a956-f4aa8c1b4990 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f63e0a64-3bc1-40e0-9c76-c4d4455a253b,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:47.390909 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-914a3dbd-cb81-4253-88ec-959cff9e9f7c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:47.397596 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-2bb1fb4e-f11b-4a60-a956-f4aa8c1b4990 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:47.397596 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.db [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] For port 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f, host hv-cinder-78726, cleared binding levels {{(pid=92324) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:32:47.399891 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2bb1fb4e-f11b-4a60-a956-f4aa8c1b4990 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:47.403494 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-2bb1fb4e-f11b-4a60-a956-f4aa8c1b4990 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/f63e0a64-3bc1-40e0-9c76-c4d4455a253b HTTP/1.1" status: 204  len: 168 time: 0.6581459
Jun 03 08:32:47.403494 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.db [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] For port 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f,segment=NetworkSegment(9559424d-973e-4a97-92a4-8a446b0a62b5),segment_id=9559424d-973e-4a97-92a4-8a446b0a62b5)] {{(pid=92324) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:32:47.430805 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-914a3dbd-cb81-4253-88ec-959cff9e9f7c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:47.468882 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe3a7cdb-ca5c-4372-b2bd-bd97dfe7a63c req-76fbcdda-66ad-46a5-82c4-e658a2091a5c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:47.470793 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fe3a7cdb-ca5c-4372-b2bd-bd97dfe7a63c req-76fbcdda-66ad-46a5-82c4-e658a2091a5c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.1010747
Jun 03 08:32:47.505153 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15641369'] for port, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:47.511710 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:47.518917 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fe3a7cdb-ca5c-4372-b2bd-bd97dfe7a63c req-8a37222a-d066-4e0a-a75c-fa35a4d1247c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0406184
Jun 03 08:32:47.580455 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:47.581294 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for port, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:47.582921 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] 10.222.0.55 "PUT /v2.0/ports/6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f HTTP/1.1" status: 200  len: 1093 time: 1.8528404
Jun 03 08:32:47.583481 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5df35469-23b8-40f8-a651-bc60a1aadd9e', 'tag': '6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f'}] {{(pid=92324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:32:47.589833 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}25ad023063ed160b339e2d2d51ef3e5c51250aece1f4db0a35843dff1b64291a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-81709a5c-5470-45ab-a943-ba35ce5572fa" -d '{"events": [{"name": "network-changed", "server_uuid": "5df35469-23b8-40f8-a651-bc60a1aadd9e", "tag": "6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f"}]}' {{(pid=92324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:32:47.616437 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Pushing event updated for resources: {'Port': ['ID=6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f,revision_number=3']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:47.623377 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:47.630210 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-914a3dbd-cb81-4253-88ec-959cff9e9f7c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:47.634652 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e3ed2481-e2db-4e3e-bd64-c378ea4bbecb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:47.646054 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:32:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ad7e5a4f-8843-4ac1-9bf4-edb65c4bd74f x-openstack-request-id: req-ad7e5a4f-8843-4ac1-9bf4-edb65c4bd74f {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:32:47.646373 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5df35469-23b8-40f8-a651-bc60a1aadd9e", "tag": "6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f", "status": "completed", "code": 200}]} {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:32:47.646676 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-ad7e5a4f-8843-4ac1-9bf4-edb65c4bd74f {{(pid=92324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:32:47.647705 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5df35469-23b8-40f8-a651-bc60a1aadd9e', 'tag': '6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f', 'status': 'completed', 'code': 200}
Jun 03 08:32:47.652875 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-914a3dbd-cb81-4253-88ec-959cff9e9f7c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e90ded50-876c-41d6-9d61-32d5fb0d6c83,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:47.655872 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-914a3dbd-cb81-4253-88ec-959cff9e9f7c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:47.657857 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-914a3dbd-cb81-4253-88ec-959cff9e9f7c admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:47.659016 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-914a3dbd-cb81-4253-88ec-959cff9e9f7c admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/e90ded50-876c-41d6-9d61-32d5fb0d6c83 HTTP/1.1" status: 204  len: 168 time: 0.4247167
Jun 03 08:32:47.750471 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81709a5c-5470-45ab-a943-ba35ce5572fa req-2fed76cf-ac84-4feb-9e02-579d802ebaab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:47.751982 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-81709a5c-5470-45ab-a943-ba35ce5572fa req-2fed76cf-ac84-4feb-9e02-579d802ebaab service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=96ee04709f4540ee8818120a88291b46&device_id=5df35469-23b8-40f8-a651-bc60a1aadd9e HTTP/1.1" status: 200  len: 1096 time: 0.0746338
Jun 03 08:32:47.900743 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81709a5c-5470-45ab-a943-ba35ce5572fa req-41ca224e-e1b3-4715-b573-aae1eee341ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:47.902343 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-81709a5c-5470-45ab-a943-ba35ce5572fa req-41ca224e-e1b3-4715-b573-aae1eee341ad service neutron] 10.222.0.55 "GET /v2.0/networks?tenant_id=96ee04709f4540ee8818120a88291b46&shared=False HTTP/1.1" status: 200  len: 909 time: 0.1429720
Jun 03 08:32:48.059633 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81709a5c-5470-45ab-a943-ba35ce5572fa req-f0208931-6c73-4dd4-a26b-a1abff8312ac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:48.061094 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-81709a5c-5470-45ab-a943-ba35ce5572fa req-f0208931-6c73-4dd4-a26b-a1abff8312ac service neutron] 10.222.0.55 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1522796
Jun 03 08:32:48.067197 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61b1142e-52df-450f-a189-640c1d5cdfed req-c59bdc6a-ae4c-43dd-bda8-0781089af553 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:48.068830 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-61b1142e-52df-450f-a189-640c1d5cdfed req-c59bdc6a-ae4c-43dd-bda8-0781089af553 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.0859244
Jun 03 08:32:48.116409 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-61b1142e-52df-450f-a189-640c1d5cdfed req-734eb57d-047f-4977-915a-e36032a68742 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0394087
Jun 03 08:32:48.169434 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-84eecf74-f36b-40ab-9684-48b1cc2cfead service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:48.170950 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-84eecf74-f36b-40ab-9684-48b1cc2cfead service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=96ee04709f4540ee8818120a88291b46&device_id=5df35469-23b8-40f8-a651-bc60a1aadd9e HTTP/1.1" status: 200  len: 1096 time: 0.0714407
Jun 03 08:32:48.499054 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-9dc1bfe7-c222-428c-aa28-5e33a54dcfff service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f HTTP/1.1" status: 200  len: 217 time: 0.3159983
Jun 03 08:32:48.507470 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccbe0406-58da-4996-b7b9-d04e8c330cd8 req-366d43d0-8819-4b17-91e5-9c444f3c5aab tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:48.515545 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ccbe0406-58da-4996-b7b9-d04e8c330cd8 req-366d43d0-8819-4b17-91e5-9c444f3c5aab tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=5df35469-23b8-40f8-a651-bc60a1aadd9e HTTP/1.1" status: 200  len: 943 time: 0.1219110
Jun 03 08:32:48.588982 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ccbe0406-58da-4996-b7b9-d04e8c330cd8 req-83994784-8274-42b2-bd52-6602af69118c tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0725071
Jun 03 08:32:48.597864 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-c3b1ab3f-21c7-45f5-aa13-5ef40c63c2a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:48.599339 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-c3b1ab3f-21c7-45f5-aa13-5ef40c63c2a5 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=4463a771-9390-43b9-805a-b4b8e5004e4c HTTP/1.1" status: 200  len: 848 time: 0.0925806
Jun 03 08:32:48.620893 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49fbd575-5de5-4ec2-b9e2-4a8adf9f533b req-11c446b2-6eed-4c28-acbb-be965872c1b1 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:48.626665 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-49fbd575-5de5-4ec2-b9e2-4a8adf9f533b req-11c446b2-6eed-4c28-acbb-be965872c1b1 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.2384913
Jun 03 08:32:48.692746 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-1419c17d-c7e5-433c-84bd-041c812b3025 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=9fa75ad7-a669-4187-8c25-4bc1ee5a9f55&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0622678
Jun 03 08:32:48.726466 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-49fbd575-5de5-4ec2-b9e2-4a8adf9f533b req-1e95a923-df2e-4252-8491-cfee710aecfb tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0915065
Jun 03 08:32:48.823093 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60372311-5dcd-44b5-8bd5-c07f7fb2c46e req-10bb086a-dd62-4254-a0c7-7cfe4baf1a33 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:48.824601 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-60372311-5dcd-44b5-8bd5-c07f7fb2c46e req-10bb086a-dd62-4254-a0c7-7cfe4baf1a33 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.0934258
Jun 03 08:32:48.852119 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-6d207ad2-37f8-40c8-8cdd-cf5efe08b8dc service neutron] 10.222.0.55 "GET /v2.0/networks/9fa75ad7-a669-4187-8c25-4bc1ee5a9f55?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1319132
Jun 03 08:32:48.877670 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-60372311-5dcd-44b5-8bd5-c07f7fb2c46e req-9502eb1d-9021-45a9-b74f-a8863c2adc2b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0468740
Jun 03 08:32:48.993561 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ed98bff1-40ac-4777-9cb9-18004a07a05a req-b95a25b4-9890-46d7-949d-ba0dec4cf31e service neutron] 10.222.0.55 "GET /v2.0/networks/9fa75ad7-a669-4187-8c25-4bc1ee5a9f55?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1331749
Jun 03 08:32:49.318395 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-214bcb6a-6953-4a64-8603-0d77f8d32afa req-f7b97c6c-a747-4212-a81d-3408f1bbd8dd tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:49.320530 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-214bcb6a-6953-4a64-8603-0d77f8d32afa req-f7b97c6c-a747-4212-a81d-3408f1bbd8dd tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.0907173
Jun 03 08:32:49.366857 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-214bcb6a-6953-4a64-8603-0d77f8d32afa req-768370f8-142d-4e79-9ce7-d659560b7346 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0407026
Jun 03 08:32:49.725968 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 49582) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:49.810928 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b625d22a-f21d-4a8c-80fa-3584026126e8 req-84870e39-f367-44b3-a9ed-ba9fee3e5473 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:49.813232 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b625d22a-f21d-4a8c-80fa-3584026126e8 req-84870e39-f367-44b3-a9ed-ba9fee3e5473 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=5df35469-23b8-40f8-a651-bc60a1aadd9e HTTP/1.1" status: 200  len: 943 time: 0.1005850
Jun 03 08:32:49.879180 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b625d22a-f21d-4a8c-80fa-3584026126e8 req-add8f638-614a-4288-901d-f940340675cf tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0584276
Jun 03 08:32:49.887662 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-825399230-network', 'tenant_id': '96a989a900784d61a1475d86dd209c5f'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:32:49.900726 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:49.912196 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Usage tracker for resource:network and tenant:96a989a900784d61a1475d86dd209c5f is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:49.916712 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:49.925428 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:49.956600 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4e7e0ea-69b1-4d78-b9c8-e76725e5f9b8 req-463a1153-9599-4260-a6f3-74df616e2c86 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:49.958265 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c4e7e0ea-69b1-4d78-b9c8-e76725e5f9b8 req-463a1153-9599-4260-a6f3-74df616e2c86 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.1247127
Jun 03 08:32:50.018731 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c4e7e0ea-69b1-4d78-b9c8-e76725e5f9b8 req-6fbdfed3-582e-425e-b3e4-ca05e2a48c14 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0525467
Jun 03 08:32:50.096004 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1f4d367-6b48-4ee8-84fd-367e2e3d4370 req-283170f8-5796-42ee-a864-abe3e1926c23 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:50.097491 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a1f4d367-6b48-4ee8-84fd-367e2e3d4370 req-283170f8-5796-42ee-a864-abe3e1926c23 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.0903776
Jun 03 08:32:50.126891 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Made reservation on behalf of 96a989a900784d61a1475d86dd209c5f for: {'network': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:32:50.129418 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-676039'] for network, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:50.142020 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:50.146191 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a1f4d367-6b48-4ee8-84fd-367e2e3d4370 req-0de940fb-a637-43a0-858c-0a5a88c83c79 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0420952
Jun 03 08:32:50.157852 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:50.166913 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Usage tracker for resource:security_group_rule and tenant:96a989a900784d61a1475d86dd209c5f is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:50.166913 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:50.172907 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:50.259913 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:50.360335 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:50.363598 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-cab5cae3-9311-419e-b180-ea7d72b8af6a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:50.389294 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] vlan segment allocate from pool success with {'vlan_id': 525, 'physical_network': 'physnet1'}  {{(pid=92324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 03 08:32:50.408516 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f03c63c9-82ad-4a26-aba6-7f507d2ecc01,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:50.411762 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:50.417753 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:50.418101 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.segments_db [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Added segment 3151dd7e-a009-433b-ae5e-c81299e42bfb of type vlan for network 113ded30-096c-4860-8773-fb717f3ea4c6
Jun 03 08:32:50.449093 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8774223827658'] for network, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:50.561612 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77138f48-232c-428f-b7b2-6814ef4095b8 req-3bf79896-0de2-4ee9-9332-6b96d18eb6ab tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:50.563116 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-77138f48-232c-428f-b7b2-6814ef4095b8 req-3bf79896-0de2-4ee9-9332-6b96d18eb6ab tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.0812409
Jun 03 08:32:50.608430 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-77138f48-232c-428f-b7b2-6814ef4095b8 req-024c028c-4826-4764-a0c0-69ac98ba994e tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0396509
Jun 03 08:32:50.652553 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820'] for network, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:50.659310 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:50.659310 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:50.659310 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-239f8031-61ee-442b-b31a-f2dcccadf3e7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:50.778863 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Pushing event updated for resources: {'Network': ['ID=113ded30-096c-4860-8773-fb717f3ea4c6,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:50.781687 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:50.790219 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Network 113ded30-096c-4860-8773-fb717f3ea4c6 details requested by agent ovs-agent-dv-cinder-787262-5-iscsi with host dv-cinder-787262-5-iscsi {{(pid=92325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 03 08:32:50.932394 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 49608) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:50.932947 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 1.2054636
Jun 03 08:32:50.938778 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-aa0a8100-3574-4dcb-b15b-59de5e491fd0 admin admin] Request body: {'subnet': {'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-825399230-subnet', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'ip_version': 4}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:32:50.945052 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-aa0a8100-3574-4dcb-b15b-59de5e491fd0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:50.949199 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-aa0a8100-3574-4dcb-b15b-59de5e491fd0 admin admin] Usage tracker for resource:subnet and tenant:96a989a900784d61a1475d86dd209c5f is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:50.952355 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-aa0a8100-3574-4dcb-b15b-59de5e491fd0 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:50.958761 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-aa0a8100-3574-4dcb-b15b-59de5e491fd0 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:51.065165 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aa0a8100-3574-4dcb-b15b-59de5e491fd0 admin admin] Made reservation on behalf of 96a989a900784d61a1475d86dd209c5f for: {'subnet': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:32:51.070393 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-aa0a8100-3574-4dcb-b15b-59de5e491fd0 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:51.296199 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e789716-bba2-4d9b-84bc-9c9bb414e5fa req-14a9471b-47d0-4d88-a891-bd103dac2ba0 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:51.301399 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3e789716-bba2-4d9b-84bc-9c9bb414e5fa req-14a9471b-47d0-4d88-a891-bd103dac2ba0 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.0906208
Jun 03 08:32:51.315005 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a1157ae-51b2-4537-9254-e92eed4d83c1 req-410291a5-d099-4ffc-97b6-2ca4a3871c63 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:51.320193 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0a1157ae-51b2-4537-9254-e92eed4d83c1 req-410291a5-d099-4ffc-97b6-2ca4a3871c63 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=5df35469-23b8-40f8-a651-bc60a1aadd9e HTTP/1.1" status: 200  len: 943 time: 0.1245813
Jun 03 08:32:51.343999 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3e789716-bba2-4d9b-84bc-9c9bb414e5fa req-e961465f-4bdd-43e4-8e18-564893dc7377 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0399549
Jun 03 08:32:51.404291 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0a1157ae-51b2-4537-9254-e92eed4d83c1 req-481a42c0-cca0-418f-8098-2677ba459994 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0602467
Jun 03 08:32:51.565274 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae0b5fd1-ee53-4571-bfa1-8642040724f4 req-ab39b0f0-f85d-406a-82c8-bf36da34f0da tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:51.565274 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ae0b5fd1-ee53-4571-bfa1-8642040724f4 req-ab39b0f0-f85d-406a-82c8-bf36da34f0da tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.0906639
Jun 03 08:32:51.614655 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ae0b5fd1-ee53-4571-bfa1-8642040724f4 req-20606f44-a0c4-4c6a-9ffd-c88b27ec6169 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0450311
Jun 03 08:32:51.867170 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-354976cd-20fb-4b73-af83-8cea1b84009b req-7e84f3fb-7bf4-4c7c-8a60-f0197e56340b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:51.868650 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-354976cd-20fb-4b73-af83-8cea1b84009b req-7e84f3fb-7bf4-4c7c-8a60-f0197e56340b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.1121814
Jun 03 08:32:51.969995 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-354976cd-20fb-4b73-af83-8cea1b84009b req-61a27597-ff66-4747-a11d-be9b29202a24 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0938222
Jun 03 08:32:51.979658 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-aa0a8100-3574-4dcb-b15b-59de5e491fd0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829'] for subnet, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:51.984365 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:52.059603 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa0a8100-3574-4dcb-b15b-59de5e491fd0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=159409d9-9245-4f6d-adbe-4aa8aad78d07,revision_number=0']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:52.063749 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-aa0a8100-3574-4dcb-b15b-59de5e491fd0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:52.067893 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa0a8100-3574-4dcb-b15b-59de5e491fd0 admin admin] Checking segment: {'id': '3151dd7e-a009-433b-ae5e-c81299e42bfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:32:52.068255 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa0a8100-3574-4dcb-b15b-59de5e491fd0 admin admin] Network hostable DHCP agents. Network: 113ded30-096c-4860-8773-fb717f3ea4c6, hostable agents: ['07372699-02ac-4239-816f-84b3a5b0eff9'], hosted agents: [] {{(pid=92323) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 03 08:32:52.172545 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa0a8100-3574-4dcb-b15b-59de5e491fd0 admin admin] Network 113ded30-096c-4860-8773-fb717f3ea4c6 is scheduled to be hosted by DHCP agent 07372699-02ac-4239-816f-84b3a5b0eff9 with binding_index 1 {{(pid=92323) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 03 08:32:52.198050 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:32:52.264465 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-aa0a8100-3574-4dcb-b15b-59de5e491fd0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-5-iscsi, 113ded30-096c-4860-8773-fb717f3ea4c6) {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:32:52.275865 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa0a8100-3574-4dcb-b15b-59de5e491fd0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:52.278955 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-aa0a8100-3574-4dcb-b15b-59de5e491fd0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:52.300635 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bdea4576-5bd6-4f6f-bb5f-0da659c3148a None None] Network 113ded30-096c-4860-8773-fb717f3ea4c6 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:32:52.449812 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f,segment=NetworkSegment(9559424d-973e-4a97-92a4-8a446b0a62b5),segment_id=9559424d-973e-4a97-92a4-8a446b0a62b5)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:32:52.453534 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-aa0a8100-3574-4dcb-b15b-59de5e491fd0 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 850 time: 1.5189607
Jun 03 08:32:52.456244 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 49656) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:52.462891 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-825399230-router', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:32:52.473546 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:52.479083 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Usage tracker for resource:router and tenant:96a989a900784d61a1475d86dd209c5f is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:52.480459 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': '6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f', 'network_id': '9fa75ad7-a669-4187-8c25-4bc1ee5a9f55', 'port_id': '6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f', 'mac_address': 'fa:16:3e:3f:11:42', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 513, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4463a771-9390-43b9-805a-b4b8e5004e4c', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:32:52.490882 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:52.501552 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:52.632407 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-16388154', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2397'] for router, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:52.633802 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-16389011', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-16327785', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-16383573', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2340'] for router, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:52.635635 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:52.663192 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b52d083d-f6b3-4ec8-aa47-cba4fc050fd4 req-417b0c43-3a8b-435b-8979-dc887397b067 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:52.672860 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b52d083d-f6b3-4ec8-aa47-cba4fc050fd4 req-417b0c43-3a8b-435b-8979-dc887397b067 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.1326911
Jun 03 08:32:52.673165 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:32:52.675665 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:52.709773 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-654eef58-1e94-4793-bb46-462893090a61 req-e2f2da89-5daa-4d68-99cc-85214f1a5568 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:52.717469 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-654eef58-1e94-4793-bb46-462893090a61 req-e2f2da89-5daa-4d68-99cc-85214f1a5568 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=5df35469-23b8-40f8-a651-bc60a1aadd9e HTTP/1.1" status: 200  len: 943 time: 0.1326575
Jun 03 08:32:52.725336 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f,segment=NetworkSegment(9559424d-973e-4a97-92a4-8a446b0a62b5),segment_id=9559424d-973e-4a97-92a4-8a446b0a62b5)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:32:52.737900 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b52d083d-f6b3-4ec8-aa47-cba4fc050fd4 req-c244aa25-175f-4d9a-ac81-268a07cb3fff tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0640924
Jun 03 08:32:52.769323 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp3789a88e-0f76-536c-9507-4ab4ace56879-113ded30-096c-4860-8773-fb717f3ea4c6', 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'fixed_ips': [{'subnet_id': '159409d9-9245-4f6d-adbe-4aa8aad78d07'}]}} from dv-cinder-787262-5-iscsi. {{(pid=92325) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 03 08:32:52.770792 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:52.841828 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-654eef58-1e94-4793-bb46-462893090a61 req-d41224cc-830e-4d1f-a5cb-941f0ec3392f tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1235163
Jun 03 08:32:52.917723 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:52.918468 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:32:52.929617 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-ab9d6f51-044c-42a6-8fa7-1e88fe51cee0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:52.939322 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8f92828-f7ad-4227-94bc-1b6118152e95 req-2bf767fe-9125-476a-bd74-952d69a0ccd1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:52.940811 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a8f92828-f7ad-4227-94bc-1b6118152e95 req-2bf767fe-9125-476a-bd74-952d69a0ccd1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.0912673
Jun 03 08:32:52.992652 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a8f92828-f7ad-4227-94bc-1b6118152e95 req-840d8a4c-426e-4570-949a-73c6fe1d9c70 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0444708
Jun 03 08:32:53.002300 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.db_base_plugin_common [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Allocated IP 172.20.0.2 (113ded30-096c-4860-8773-fb717f3ea4c6/159409d9-9245-4f6d-adbe-4aa8aad78d07/3561fa8f-70de-4286-94db-502955bd7ed0) {{(pid=92325) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:32:53.106582 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.db.resource_extend [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] It took 0.18 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 03 08:32:53.298936 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:53.302096 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-16327803', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-16388116', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2358'] for router, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:53.321483 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.392s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:53.367928 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1915c08d-65f4-46f8-96c5-2e1003ad9687 req-d61edf0b-cf8a-4f01-a5b1-fd3310335141 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:53.371048 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1915c08d-65f4-46f8-96c5-2e1003ad9687 req-d61edf0b-cf8a-4f01-a5b1-fd3310335141 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.2044759
Jun 03 08:32:53.409498 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:32:53.419207 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1915c08d-65f4-46f8-96c5-2e1003ad9687 req-39c6d2c5-e241-4271-bb63-27d6d7f20f48 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0430615
Jun 03 08:32:53.436374 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Notify callbacks [] for port, precommit_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:53.438840 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'port_id': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97', 'mac_address': 'fa:16:3e:93:b9:aa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 526, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:32:53.476772 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Transition to ACTIVE for port object 3561fa8f-70de-4286-94db-502955bd7ed0 will not be triggered until provisioned by entity L2. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:32:53.550330 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Transition to ACTIVE for port object 3561fa8f-70de-4286-94db-502955bd7ed0 will not be triggered until provisioned by entity DHCP. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:32:53.558173 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:53.581619 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:32:53.616807 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:32:53.711229 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:53.722730 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:53.870588 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:53.889175 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Network 113ded30-096c-4860-8773-fb717f3ea4c6 is already hosted by enough agents. {{(pid=92325) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:32:53.894471 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.scheduler.base_scheduler [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Resources bound (agent type, host, resource id):  {{(pid=92325) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:32:53.902953 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Received port after_create {{(pid=92325) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:32:54.023489 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Pushing event updated for resources: {'Port': ['ID=3561fa8f-70de-4286-94db-502955bd7ed0,revision_number=1']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:54.038930 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.318s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:54.039788 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.149s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:54.092128 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-888fb8e5-6c1c-4b04-a53c-ea72b2c8a6cd req-f53bd832-72ca-4cbc-9468-6d4fd63cc07c tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:54.096374 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-888fb8e5-6c1c-4b04-a53c-ea72b2c8a6cd req-f53bd832-72ca-4cbc-9468-6d4fd63cc07c tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.1492341
Jun 03 08:32:54.126943 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:32:54.193596 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Attempting to bind port 3561fa8f-70de-4286-94db-502955bd7ed0 on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:32:54.194377 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Attempting to bind port 3561fa8f-70de-4286-94db-502955bd7ed0 by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '3151dd7e-a009-433b-ae5e-c81299e42bfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6'}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:32:54.195048 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Attempting to bind port 3561fa8f-70de-4286-94db-502955bd7ed0 on network 113ded30-096c-4860-8773-fb717f3ea4c6 {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:32:54.195206 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-888fb8e5-6c1c-4b04-a53c-ea72b2c8a6cd req-4b60da62-5b0a-44b7-89f4-972a1b337390 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0888500
Jun 03 08:32:54.215931 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 32, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:32:54.217180 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Checking segment: {'id': '3151dd7e-a009-433b-ae5e-c81299e42bfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:32:54.217817 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:54.218448 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Bound using segment: {'id': '3151dd7e-a009-433b-ae5e-c81299e42bfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6'} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:32:54.219191 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Bound port: 3561fa8f-70de-4286-94db-502955bd7ed0, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3151dd7e-a009-433b-ae5e-c81299e42bfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6'}}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:32:54.219989 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:54.242645 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,revision_number=6']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:54.262452 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.223s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:54.263821 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:32:54.294110 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:54.337177 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:54.444487 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa82e3a6-3276-4d81-977b-7b973af68329 req-918392dc-e50d-475a-bb84-86df7b7d2aa1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:54.446526 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-aa82e3a6-3276-4d81-977b-7b973af68329 req-918392dc-e50d-475a-bb84-86df7b7d2aa1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 944 time: 0.1158783
Jun 03 08:32:54.500065 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08a1dd74-9f6d-4a5b-8cbf-d43db8234010 req-2d81d24b-25d2-4784-897f-c633efc76bdb tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:54.501638 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-08a1dd74-9f6d-4a5b-8cbf-d43db8234010 req-2d81d24b-25d2-4784-897f-c633efc76bdb tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=5df35469-23b8-40f8-a651-bc60a1aadd9e HTTP/1.1" status: 200  len: 944 time: 0.3422778
Jun 03 08:32:54.555789 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Allocated IP 172.27.0.99 (684ef871-89aa-450d-ae0d-e232bfaf51fb/e7b58fba-1ed5-483b-b341-7736b2ffb853/7bd8082c-c1ea-4edf-bafc-03cff8ed0641) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:32:54.574303 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] For port 3561fa8f-70de-4286-94db-502955bd7ed0, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:32:54.619866 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-aa82e3a6-3276-4d81-977b-7b973af68329 req-e0400cd2-8d0a-4fb5-9507-e4f3d66a486a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1580858
Jun 03 08:32:54.636016 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] For port 3561fa8f-70de-4286-94db-502955bd7ed0, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=3561fa8f-70de-4286-94db-502955bd7ed0,segment=NetworkSegment(3151dd7e-a009-433b-ae5e-c81299e42bfb),segment_id=3151dd7e-a009-433b-ae5e-c81299e42bfb)] {{(pid=92325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:32:54.641877 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-08a1dd74-9f6d-4a5b-8cbf-d43db8234010 req-e8d611a8-40f7-431b-9f30-d2e55b1cf5e0 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1337016
Jun 03 08:32:54.882982 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:54.898394 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:54.999146 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Pushing event updated for resources: {'Port': ['ID=3561fa8f-70de-4286-94db-502955bd7ed0,revision_number=2']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:55.005847 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:55.035085 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:55.066345 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 49710) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:55.128513 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f22ab3b-347f-4105-8df7-3a27e20f7f25 req-f8c08b1a-a930-4ab2-8019-1eba84fdfc07 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:55.130064 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2f22ab3b-347f-4105-8df7-3a27e20f7f25 req-f8c08b1a-a930-4ab2-8019-1eba84fdfc07 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.2356024
Jun 03 08:32:55.163566 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:55.169378 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-195c6f27-5e77-426c-bb1f-30faa7b3f3f2 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:55.250648 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2f22ab3b-347f-4105-8df7-3a27e20f7f25 req-98a05f7b-2fc8-404c-aa3f-a402e4990082 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1083455
Jun 03 08:32:55.254217 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 49718) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:55.300014 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:32:55.327217 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:32:55.367940 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:32:55.570661 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1e934078-068b-46e9-a4d0-b3a6b9962ee9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:55.609008 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-1e934078-068b-46e9-a4d0-b3a6b9962ee9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:55.618919 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-1e934078-068b-46e9-a4d0-b3a6b9962ee9 admin admin] Usage tracker for resource:security_group_rule and tenant:48fade23de8c4e03a1f96fd0069bf7a2 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:55.627428 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-1e934078-068b-46e9-a4d0-b3a6b9962ee9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:55.645014 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-1e934078-068b-46e9-a4d0-b3a6b9962ee9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:55.813635 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1e934078-068b-46e9-a4d0-b3a6b9962ee9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:55.828695 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d4f6f634-faf4-4fd5-8dd2-6391e80072a6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:55.848495 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1b4f076-45b8-4415-8335-d5ee4b0d9024 req-8fe02d2d-9798-4781-888f-59741b5483b4 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:55.855034 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e1b4f076-45b8-4415-8335-d5ee4b0d9024 req-8fe02d2d-9798-4781-888f-59741b5483b4 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.3495362
Jun 03 08:32:55.869107 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-d4f6f634-faf4-4fd5-8dd2-6391e80072a6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:32:55.933329 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1e934078-068b-46e9-a4d0-b3a6b9962ee9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:55.961573 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-cc3daab8-424e-49ee-92fd-f094aada55b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:56.032733 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-d4f6f634-faf4-4fd5-8dd2-6391e80072a6 admin admin] Usage tracker for resource:security_group_rule and tenant:705bac34c9ba4ebeabac77088de2ee31 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:32:56.037907 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Pushing event updated for resources: {'Port': ['ID=7bd8082c-c1ea-4edf-bafc-03cff8ed0641,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:56.042191 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-d4f6f634-faf4-4fd5-8dd2-6391e80072a6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:32:56.059939 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.890s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:56.095972 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-d4f6f634-faf4-4fd5-8dd2-6391e80072a6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:32:56.115389 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 3561fa8f-70de-4286-94db-502955bd7ed0 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:32:56.247329 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e1b4f076-45b8-4415-8335-d5ee4b0d9024 req-b286e206-b473-43ba-abc7-7e1f759c9067 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3129785
Jun 03 08:32:56.273932 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-1e934078-068b-46e9-a4d0-b3a6b9962ee9 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=48fade23de8c4e03a1f96fd0069bf7a2&name=default HTTP/1.1" status: 200  len: 2979 time: 1.0185421
Jun 03 08:32:56.276530 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 49736) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:56.289157 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e934078-068b-46e9-a4d0-b3a6b9962ee9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=733349e9-2eab-4724-8770-d32b224428f8,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:56.302381 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:32:56.306384 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-1e934078-068b-46e9-a4d0-b3a6b9962ee9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.345s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:56.344096 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:56.393406 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ff1a9d3-bae9-4c01-9a9e-c1e531befd8f req-2ff3328d-d622-481c-b9ff-bf757bd563b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:56.397912 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8ff1a9d3-bae9-4c01-9a9e-c1e531befd8f req-2ff3328d-d622-481c-b9ff-bf757bd563b1 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=36c42f532cd14f19811ffbee3a39a208&device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 1097 time: 0.4375179
Jun 03 08:32:56.561640 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port 3561fa8f-70de-4286-94db-502955bd7ed0 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:32:56.585562 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bfe061f7-89e8-4480-8314-4818c423e447 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:56.636482 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning for port 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:32:56.645995 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:32:56.646389 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:56.718310 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bfe061f7-89e8-4480-8314-4818c423e447 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:56.734243 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ff1a9d3-bae9-4c01-9a9e-c1e531befd8f req-cea1420d-2964-4f2f-90dd-6ceebccc8c5d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:56.735959 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8ff1a9d3-bae9-4c01-9a9e-c1e531befd8f req-cea1420d-2964-4f2f-90dd-6ceebccc8c5d service neutron] 10.222.0.55 "GET /v2.0/networks?id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba HTTP/1.1" status: 200  len: 918 time: 0.3100553
Jun 03 08:32:56.782101 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bca3f79-5f4f-4dbb-9156-36d1281c9f2c req-4c7cb7e8-bde1-44f6-8335-dee440f34f0a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:56.791127 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0bca3f79-5f4f-4dbb-9156-36d1281c9f2c req-4c7cb7e8-bde1-44f6-8335-dee440f34f0a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 944 time: 0.3203254
Jun 03 08:32:56.874885 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:56.904606 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1501850c-b893-4704-8149-75503a4f6f47 None None] Network 113ded30-096c-4860-8773-fb717f3ea4c6 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:32:57.031692 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:57.104351 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0bca3f79-5f4f-4dbb-9156-36d1281c9f2c req-5cdea492-057a-42f8-965e-ca6ffdd90b42 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.3116288
Jun 03 08:32:57.117739 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f,segment=NetworkSegment(9559424d-973e-4a97-92a4-8a446b0a62b5),segment_id=9559424d-973e-4a97-92a4-8a446b0a62b5)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:32:57.142156 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8ff1a9d3-bae9-4c01-9a9e-c1e531befd8f req-2b60219a-7c12-4136-a2ea-9ad463de3cb3 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 HTTP/1.1" status: 200  len: 1000 time: 0.3343408
Jun 03 08:32:57.202158 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5df35469-23b8-40f8-a651-bc60a1aadd9e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:32:57.205642 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ee0f00fc-ae5d-4bbc-9863-f73ade9328ef" -d '{"events": [{"server_uuid": "5df35469-23b8-40f8-a651-bc60a1aadd9e", "name": "network-vif-plugged", "status": "completed", "tag": "6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:32:57.218252 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d4f6f634-faf4-4fd5-8dd2-6391e80072a6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:57.218769 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:57.219856 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:32:57.256124 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ff1a9d3-bae9-4c01-9a9e-c1e531befd8f req-9bce239a-eb33-4ffb-966e-99949747af6e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:57.261403 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8ff1a9d3-bae9-4c01-9a9e-c1e531befd8f req-9bce239a-eb33-4ffb-966e-99949747af6e service neutron] 10.222.0.55 "GET /v2.0/subnets?id=cff67a13-bc33-4d3e-a796-5829103ca25c HTTP/1.1" status: 200  len: 856 time: 0.1089089
Jun 03 08:32:57.308332 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:57.485479 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-bdc83bbb-6220-4ab7-b3ec-07b21b8db047 None None] Provisioning for port 3561fa8f-70de-4286-94db-502955bd7ed0 completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:32:57.496890 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:57.512502 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ff1a9d3-bae9-4c01-9a9e-c1e531befd8f req-ee5b206b-92c2-4390-b024-283794023c45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:57.512502 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8ff1a9d3-bae9-4c01-9a9e-c1e531befd8f req-ee5b206b-92c2-4390-b024-283794023c45 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2311893
Jun 03 08:32:57.523603 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d4f6f634-faf4-4fd5-8dd2-6391e80072a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:57.530097 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54ddba62-ef8c-4c23-b36e-15ab633835ea req-03d7dfee-819e-4b82-b781-1268a247364d tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:57.530989 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:57.538118 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-54ddba62-ef8c-4c23-b36e-15ab633835ea req-03d7dfee-819e-4b82-b781-1268a247364d tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.1827776
Jun 03 08:32:57.542900 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-bdc83bbb-6220-4ab7-b3ec-07b21b8db047 None None] Provisioning complete for port 3561fa8f-70de-4286-94db-502955bd7ed0 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:32:57.543777 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-bdc83bbb-6220-4ab7-b3ec-07b21b8db047 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:57.575157 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-de7a72f0-815d-468b-a158-df8e5f4d3923 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:57.620369 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-d4f6f634-faf4-4fd5-8dd2-6391e80072a6 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=705bac34c9ba4ebeabac77088de2ee31&name=default HTTP/1.1" status: 200  len: 2979 time: 2.5526903
Jun 03 08:32:57.626554 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4f6f634-faf4-4fd5-8dd2-6391e80072a6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=416cb890-62cb-409d-92dc-db10ab14d4cc,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:57.636535 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 49744) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:57.647081 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-d4f6f634-faf4-4fd5-8dd2-6391e80072a6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:57.688638 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c8e4a5b-c7a3-46b9-9b27-62bd9da787ab req-a4092b8a-2002-4289-824d-39093937e054 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:57.696825 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7c8e4a5b-c7a3-46b9-9b27-62bd9da787ab req-a4092b8a-2002-4289-824d-39093937e054 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=5df35469-23b8-40f8-a651-bc60a1aadd9e HTTP/1.1" status: 200  len: 944 time: 0.6911030
Jun 03 08:32:57.701998 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bfe061f7-89e8-4480-8314-4818c423e447 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:57.735098 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-4d189df6-03b2-4e9e-b7f9-ca2f0d4a8b7d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:57.748319 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:32:57.748319 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:57.766528 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-54ddba62-ef8c-4c23-b36e-15ab633835ea req-d95146f2-9faa-47b6-894e-e7eca458540f tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2274044
Jun 03 08:32:57.847631 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfe061f7-89e8-4480-8314-4818c423e447 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=733349e9-2eab-4724-8770-d32b224428f8,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:57.858598 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-bfe061f7-89e8-4480-8314-4818c423e447 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:57.899236 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7c8e4a5b-c7a3-46b9-9b27-62bd9da787ab req-f1c944dc-3ae5-444e-89b1-8b5f533ad2be tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2011738
Jun 03 08:32:57.924495 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:32:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e2d02640-0291-4697-b090-83240593fff3 x-openstack-request-id: req-e2d02640-0291-4697-b090-83240593fff3 {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:32:57.924495 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5df35469-23b8-40f8-a651-bc60a1aadd9e", "name": "network-vif-plugged", "status": "completed", "tag": "6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:32:57.924797 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-e2d02640-0291-4697-b090-83240593fff3 {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:32:57.925078 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5df35469-23b8-40f8-a651-bc60a1aadd9e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f', 'code': 200}
Jun 03 08:32:57.925393 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bfe061f7-89e8-4480-8314-4818c423e447 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:57.926526 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-bfe061f7-89e8-4480-8314-4818c423e447 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/733349e9-2eab-4724-8770-d32b224428f8 HTTP/1.1" status: 204  len: 168 time: 1.6462135
Jun 03 08:32:57.940683 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-16388099', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-16327774'] for router, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:58.019403 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8ff1a9d3-bae9-4c01-9a9e-c1e531befd8f req-bdadaf43-59aa-41e6-948e-73bf37c5a590 service neutron] 10.222.0.55 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4559343
Jun 03 08:32:58.020424 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-bdc83bbb-6220-4ab7-b3ec-07b21b8db047 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:58.236940 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-bdc83bbb-6220-4ab7-b3ec-07b21b8db047 None None] For port 3561fa8f-70de-4286-94db-502955bd7ed0, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=3561fa8f-70de-4286-94db-502955bd7ed0,segment=NetworkSegment(3151dd7e-a009-433b-ae5e-c81299e42bfb),segment_id=3151dd7e-a009-433b-ae5e-c81299e42bfb)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:32:58.239570 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:58.350618 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:32:58.357837 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-91dac9d0-38da-4931-9689-366201c27eed admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:58.367080 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-bdc83bbb-6220-4ab7-b3ec-07b21b8db047 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:58.378701 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:58.480827 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-91dac9d0-38da-4931-9689-366201c27eed admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:58.535537 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-fc5a93e0-5d10-4bc8-b758-8ef4e0d05ef4 None None] Provisioning complete for port 3561fa8f-70de-4286-94db-502955bd7ed0 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:32:58.536243 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-fc5a93e0-5d10-4bc8-b758-8ef4e0d05ef4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:58.606119 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdc83bbb-6220-4ab7-b3ec-07b21b8db047 None None] Pushing event updated for resources: {'Port': ['ID=3561fa8f-70de-4286-94db-502955bd7ed0,revision_number=3']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:58.620671 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-bdc83bbb-6220-4ab7-b3ec-07b21b8db047 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.251s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:58.621744 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:58.624648 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:58.634095 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8ff1a9d3-bae9-4c01-9a9e-c1e531befd8f req-91fb42d3-eb6d-482a-87a1-cb7edf52710a service neutron] 10.222.0.55 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6076360
Jun 03 08:32:58.678429 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da8d9fb7-2c3d-4077-8d08-4398e7d22a0c req-a805cd00-60ef-4680-88ed-602993ac6aa3 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:58.681374 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-da8d9fb7-2c3d-4077-8d08-4398e7d22a0c req-a805cd00-60ef-4680-88ed-602993ac6aa3 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.5294874
Jun 03 08:32:58.703198 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fa856f9-2d9a-4ec1-af0e-6dafeda54a45 req-9a8c8695-0ed3-4233-8b65-5870639f8f14 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:58.705354 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9fa856f9-2d9a-4ec1-af0e-6dafeda54a45 req-9a8c8695-0ed3-4233-8b65-5870639f8f14 service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=5df35469-23b8-40f8-a651-bc60a1aadd9e HTTP/1.1" status: 200  len: 1098 time: 0.3163021
Jun 03 08:32:58.771363 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b61c3458-730d-4306-bbcd-f239cf07543e req-ce30a63a-2370-4207-a64b-8258109e5f77 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:58.780027 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b61c3458-730d-4306-bbcd-f239cf07543e req-ce30a63a-2370-4207-a64b-8258109e5f77 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.3049512
Jun 03 08:32:58.784955 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-91dac9d0-38da-4931-9689-366201c27eed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:58.791433 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-62f146d9-5c95-4deb-af73-714ebd2dd435 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:32:58.813061 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,revision_number=7']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:58.824001 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.199s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:58.827191 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Router b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 is scheduled to L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 with binding_index 1 {{(pid=92323) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 03 08:32:58.832099 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9fa856f9-2d9a-4ec1-af0e-6dafeda54a45 req-879cea35-6bf3-4015-8b2d-ee27a6a7c776 service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1171060
Jun 03 08:32:58.846673 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-da8d9fb7-2c3d-4077-8d08-4398e7d22a0c req-c5ace88d-f817-4a3f-a935-61f80873ded7 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1490479
Jun 03 08:32:58.851214 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91dac9d0-38da-4931-9689-366201c27eed admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=416cb890-62cb-409d-92dc-db10ab14d4cc,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:32:58.867453 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-91dac9d0-38da-4931-9689-366201c27eed admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:32:58.882784 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-91dac9d0-38da-4931-9689-366201c27eed admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:58.885433 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-91dac9d0-38da-4931-9689-366201c27eed admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/416cb890-62cb-409d-92dc-db10ab14d4cc HTTP/1.1" status: 204  len: 168 time: 1.2464814
Jun 03 08:32:58.966771 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b61c3458-730d-4306-bbcd-f239cf07543e req-8eb6c686-bc83-401f-8fda-0b5c5af18b3c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1818476
Jun 03 08:32:59.162640 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d129275d-113b-4804-97e3-922a37c91d47 req-7e0e0aeb-8308-4b6e-a744-f724f34f5c58 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:59.164515 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d129275d-113b-4804-97e3-922a37c91d47 req-7e0e0aeb-8308-4b6e-a744-f724f34f5c58 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.1627626
Jun 03 08:32:59.242907 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d129275d-113b-4804-97e3-922a37c91d47 req-bd8a6e54-28aa-4a2a-82a4-4ae7bdb481e0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0695317
Jun 03 08:32:59.379113 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:32:59.398991 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] Sync routers for ids ['b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'] in dv-cinder-787262-5-iscsi {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:32:59.419276 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] Routers {'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:32:59.423548 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86ca84f0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:32:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:32:59.423735 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6a4b4b7-86f5-4431-a14c-c306bcb899fc req-d6f7ec56-0c2a-4ac8-a365-ffcb296ce199 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:32:59.423735 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f6a4b4b7-86f5-4431-a14c-c306bcb899fc req-d6f7ec56-0c2a-4ac8-a365-ffcb296ce199 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=5df35469-23b8-40f8-a651-bc60a1aadd9e HTTP/1.1" status: 200  len: 945 time: 0.1579666
Jun 03 08:32:59.556611 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f6a4b4b7-86f5-4431-a14c-c306bcb899fc req-d856f310-38ba-4e09-a9ad-8242491471a6 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1274955
Jun 03 08:32:59.561158 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Notify callbacks [] for router, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:32:59.565543 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201  len: 925 time: 7.1053727
Jun 03 08:32:59.566122 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 49778) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:32:59.926451 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0c731ecb-c3fc-401e-af74-34336582cf7d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:32:59.929902 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e9134500-e106-49fc-8a2a-dd558556eafa" -d '{"events": [{"server_uuid": "0c731ecb-c3fc-401e-af74-34336582cf7d", "name": "network-vif-plugged", "status": "completed", "tag": "7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:32:59.953035 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 3561fa8f-70de-4286-94db-502955bd7ed0 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:32:59.960971 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] Set router b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:33:00.133639 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 3561fa8f-70de-4286-94db-502955bd7ed0 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:00.134252 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:00.355712 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 49810) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:00.466539 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a95ba3e-572c-4b48-b992-9018ddce59aa req-3fa2eb4b-21dd-491b-a7ab-3646ebeaa0e4 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:00.469420 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4a95ba3e-572c-4b48-b992-9018ddce59aa req-3fa2eb4b-21dd-491b-a7ab-3646ebeaa0e4 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.2497880
Jun 03 08:33:00.553389 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4a95ba3e-572c-4b48-b992-9018ddce59aa req-fc275bb7-b557-4eca-bdf6-a723e9368d23 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0563052
Jun 03 08:33:00.553389 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1711690997-network', 'tenant_id': '9a96090cd93b48608ead040676d45129'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:00.553389 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:00.556960 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Usage tracker for resource:network and tenant:9a96090cd93b48608ead040676d45129 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:00.561666 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:00.569953 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:00.577845 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-2e408bfd-d302-424a-9c29-216980d49a39 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:00.579363 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-2e408bfd-d302-424a-9c29-216980d49a39 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/networks?id=f9db9a2a-942b-4a98-97ed-1896cb9158b4 HTTP/1.1" status: 200  len: 815 time: 0.6344821
Jun 03 08:33:00.580338 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86ca84f0>, [{'id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'name': 'tempest-TestMinimumBasicScenario-825399230-router', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:52Z', 'updated_at': '2021-06-03T08:32:56Z', 'revision_number': 3, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'gw_port': {'id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:59:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 358, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:54Z', 'updated_at': '2021-06-03T08:32:54Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:00.585896 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] Checking router: b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 for host: dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:33:00.586258 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] Updating router b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 port 7bd8082c-c1ea-4edf-bafc-03cff8ed0641 binding host dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 03 08:33:00.608409 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:32:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-44253137-f165-49c7-9a60-a23ed73e34e3 x-openstack-request-id: req-44253137-f165-49c7-9a60-a23ed73e34e3 {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:33:00.609232 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0c731ecb-c3fc-401e-af74-34336582cf7d", "name": "network-vif-plugged", "status": "completed", "tag": "7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:33:00.609599 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-44253137-f165-49c7-9a60-a23ed73e34e3 {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:33:00.610096 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0c731ecb-c3fc-401e-af74-34336582cf7d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97', 'code': 200}
Jun 03 08:33:00.647569 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:00.669634 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-b1c8f3f7-0d8f-42d7-b038-761eebd3c60d tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/quotas/7bac6d994f4d49b292bc39fac07c0311 HTTP/1.1" status: 200  len: 375 time: 0.0291569
Jun 03 08:33:00.785286 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae1c288d-e615-4cee-a168-65e81fa5df5d req-0db7d6a1-2283-496a-ba84-408a24e45470 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:00.786794 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ae1c288d-e615-4cee-a168-65e81fa5df5d req-0db7d6a1-2283-496a-ba84-408a24e45470 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.0857427
Jun 03 08:33:00.836187 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ae1c288d-e615-4cee-a168-65e81fa5df5d req-205c1120-acbd-4a8c-ba1a-dd03b9612a12 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0421290
Jun 03 08:33:00.937375 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-c9925e40-d4b5-407f-87f3-50cfc400a0ec tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=7bac6d994f4d49b292bc39fac07c0311&fields=id HTTP/1.1" status: 200  len: 348 time: 0.2567017
Jun 03 08:33:01.030127 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Made reservation on behalf of 9a96090cd93b48608ead040676d45129 for: {'network': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:33:01.033071 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-676039'] for network, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:01.049581 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:01.069231 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:01.073562 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Usage tracker for resource:security_group_rule and tenant:9a96090cd93b48608ead040676d45129 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:01.074271 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] Notify callbacks [] for port, precommit_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:01.076646 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:01.085259 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:01.094058 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.provisioning_blocks [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] Transition to ACTIVE for port object 7bd8082c-c1ea-4edf-bafc-03cff8ed0641 will not be triggered until provisioned by entity L2. {{(pid=92326) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:33:01.144000 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a40bbe8f-90ef-4f21-bf5d-a5ac3d5b9936 req-3e6d6a55-3c8f-4d88-abc1-85a957d38b40 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:01.147103 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a40bbe8f-90ef-4f21-bf5d-a5ac3d5b9936 req-3e6d6a55-3c8f-4d88-abc1-85a957d38b40 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.1899681
Jun 03 08:33:01.251614 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-6534261e-7b84-4a60-8005-3d89263e646f service neutron] 10.222.0.11 "GET /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3055243
Jun 03 08:33:01.258021 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:01.264275 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:01.291115 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a40bbe8f-90ef-4f21-bf5d-a5ac3d5b9936 req-e5fed5dd-00f5-4e5b-b426-79519186e11b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1320658
Jun 03 08:33:01.337305 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:01.393285 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75025a32-eee3-4f40-ba9c-e34ed7ac2bd0 None None] Pushing event updated for resources: {'Port': ['ID=7bd8082c-c1ea-4edf-bafc-03cff8ed0641,revision_number=2']} {{(pid=92326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:01.411372 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-75025a32-eee3-4f40-ba9c-e34ed7ac2bd0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:01.453301 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:01.456329 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-288d6b99-8f79-481c-81a0-3c854d106a66 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:01.487731 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] Attempting to bind port 7bd8082c-c1ea-4edf-bafc-03cff8ed0641 on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:33:01.488167 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] Attempting to bind port 7bd8082c-c1ea-4edf-bafc-03cff8ed0641 by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}] {{(pid=92326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:33:01.488595 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] Attempting to bind port 7bd8082c-c1ea-4edf-bafc-03cff8ed0641 on network 684ef871-89aa-450d-ae0d-e232bfaf51fb {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:33:01.497837 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:01.504434 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 32, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:33:01.504811 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] Checking segment: {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92326) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:33:01.505210 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:01.505601 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] Bound using segment: {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'} {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:33:01.513639 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] Bound port: 7bd8082c-c1ea-4edf-bafc-03cff8ed0641, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}}] {{(pid=92326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:33:01.514355 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:01.561018 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] vlan segment allocate from pool success with {'vlan_id': 523, 'physical_network': 'physnet1'}  {{(pid=92323) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 03 08:33:01.588617 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:01.588927 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.db.segments_db [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Added segment 6978222c-6678-416a-a506-1fa962d91d64 of type vlan for network d6b7a34f-3fa8-4a38-ab72-8c6458a51990
Jun 03 08:33:01.590015 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1455c957-f90c-4cab-a146-6db18bd88bec,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:01.598678 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:01.625728 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8774223827658'] for network, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:01.653136 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 49834) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:01.670183 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44f86e85-0a57-4e3d-87ac-35338407f46c req-982aec16-f0f1-4906-9f83-7480fff26d34 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:01.671723 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-44f86e85-0a57-4e3d-87ac-35338407f46c req-982aec16-f0f1-4906-9f83-7480fff26d34 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=5df35469-23b8-40f8-a651-bc60a1aadd9e HTTP/1.1" status: 200  len: 945 time: 0.2033455
Jun 03 08:33:01.680409 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.db [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] For port 7bd8082c-c1ea-4edf-bafc-03cff8ed0641, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92326) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:33:01.682123 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.db [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] For port 7bd8082c-c1ea-4edf-bafc-03cff8ed0641, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=7bd8082c-c1ea-4edf-bafc-03cff8ed0641,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92326) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:33:01.687582 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-da6253e6-b5da-4ee9-b402-b7e5091705ed service neutron] 10.222.0.11 "GET /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4284716
Jun 03 08:33:01.751252 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-44f86e85-0a57-4e3d-87ac-35338407f46c req-5eeb04d5-d736-4fe3-8051-31506f235b22 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0649912
Jun 03 08:33:01.795638 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820'] for network, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:01.797310 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:01.798115 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:01.803721 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:01.836967 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:01.842271 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-bce8eae0-16f6-4ddd-9809-76c8dc5e970d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:01.895430 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1807805368-network', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:01.905470 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:01.922821 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Usage tracker for resource:network and tenant:0e5e096a327f421e9b0a02235740cc36 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:01.933228 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:02.028800 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:02.037688 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] Routers {'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:33:02.038345 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86ca84f0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:32:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:02.045530 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.db_base_plugin_common [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] Allocated IP 172.20.0.1 (113ded30-096c-4860-8773-fb717f3ea4c6/159409d9-9245-4f6d-adbe-4aa8aad78d07/67b7325f-861c-41e6-b770-4814b84aebba) {{(pid=92324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:33:02.061694 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 1.7045679
Jun 03 08:33:02.079428 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 49848) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:02.103178 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-bbbd0cdc-1a2a-4e11-b13c-6874f694d258 admin admin] Request body: {'subnet': {'network_id': 'd6b7a34f-3fa8-4a38-ab72-8c6458a51990', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1711690997-subnet', 'tenant_id': '9a96090cd93b48608ead040676d45129', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:02.169389 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Pushing event updated for resources: {'Network': ['ID=d6b7a34f-3fa8-4a38-ab72-8c6458a51990,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:02.186958 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.383s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:02.194304 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75025a32-eee3-4f40-ba9c-e34ed7ac2bd0 None None] Pushing event updated for resources: {'Port': ['ID=7bd8082c-c1ea-4edf-bafc-03cff8ed0641,revision_number=3']} {{(pid=92326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:02.195760 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Network d6b7a34f-3fa8-4a38-ab72-8c6458a51990 details requested by agent ovs-agent-dv-cinder-787262-5-iscsi with host dv-cinder-787262-5-iscsi {{(pid=92325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 03 08:33:02.213417 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-75025a32-eee3-4f40-ba9c-e34ed7ac2bd0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.371s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:02.277994 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ba8daf3-651b-4d29-917b-c347b2156ceb req-ccecaaba-bc6c-46d4-8f4a-537b542d7cc7 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:02.284356 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9ba8daf3-651b-4d29-917b-c347b2156ceb req-ccecaaba-bc6c-46d4-8f4a-537b542d7cc7 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.2424774
Jun 03 08:33:02.293575 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Made reservation on behalf of 0e5e096a327f421e9b0a02235740cc36 for: {'network': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:33:02.300398 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-676039'] for network, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:02.435023 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] Set router b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:33:02.481389 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:02.520815 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] Notify callbacks [] for port, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:02.524685 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-bbbd0cdc-1a2a-4e11-b13c-6874f694d258 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:02.535604 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9ba8daf3-651b-4d29-917b-c347b2156ceb req-648ca368-544a-4db6-83f7-f4f6e1bb1724 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1700413
Jun 03 08:33:02.543910 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:02.546476 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-bbbd0cdc-1a2a-4e11-b13c-6874f694d258 admin admin] Usage tracker for resource:subnet and tenant:9a96090cd93b48608ead040676d45129 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:02.549794 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5710f019-e4f8-46a3-b8b3-9a005a28d788 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:02.550582 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-bbbd0cdc-1a2a-4e11-b13c-6874f694d258 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:02.567542 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Usage tracker for resource:security_group_rule and tenant:0e5e096a327f421e9b0a02235740cc36 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:02.568626 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-bbbd0cdc-1a2a-4e11-b13c-6874f694d258 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:02.571253 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.provisioning_blocks [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] Transition to ACTIVE for port object 67b7325f-861c-41e6-b770-4814b84aebba will not be triggered until provisioned by entity DHCP. {{(pid=92324) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:33:02.576526 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:02.593797 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:02.630044 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d32ce0d3-48f9-4031-a875-c488bdd6249c req-6f87ab49-c657-4f04-8033-77bdefeaa21c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:02.631429 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d32ce0d3-48f9-4031-a875-c488bdd6249c req-6f87ab49-c657-4f04-8033-77bdefeaa21c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.1522658
Jun 03 08:33:02.702560 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d32ce0d3-48f9-4031-a875-c488bdd6249c req-5493f40c-f774-4589-a628-e9f72dc7042f tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0611346
Jun 03 08:33:02.738437 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bbbd0cdc-1a2a-4e11-b13c-6874f694d258 admin admin] Made reservation on behalf of 9a96090cd93b48608ead040676d45129 for: {'subnet': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:33:02.741526 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-bbbd0cdc-1a2a-4e11-b13c-6874f694d258 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14870279'] for subnet, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:02.750836 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-075d5fad-ba5d-421b-b1d7-2b081587076a req-b469cccf-5a1a-45a7-b1b2-bebb06c62688 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 210 time: 0.1121073
Jun 03 08:33:02.868860 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:02.925271 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:02.985642 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:03.054882 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:03.059376 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c0dc056d-4ee5-4812-80c6-7c276b5c89f7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:03.072940 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] Network 113ded30-096c-4860-8773-fb717f3ea4c6 is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:33:03.080276 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:33:03.087041 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] Received port after_create {{(pid=92324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:33:03.101757 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86ca84f0>, [{'id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'name': 'tempest-TestMinimumBasicScenario-825399230-router', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:52Z', 'updated_at': '2021-06-03T08:32:56Z', 'revision_number': 3, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'gw_port': {'id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:59:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 358, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:54Z', 'updated_at': '2021-06-03T08:33:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:03.116570 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2eef6095-51df-4600-8c86-8cb085651b27 None None] The sync data for ids ['b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'] in dv-cinder-787262-5-iscsi is: [{'id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'name': 'tempest-TestMinimumBasicScenario-825399230-router', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:52Z', 'updated_at': '2021-06-03T08:32:56Z', 'revision_number': 3, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'gw_port': {'id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:59:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 358, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:54Z', 'updated_at': '2021-06-03T08:33:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}] {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:33:03.153960 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] Pushing event updated for resources: {'Port': ['ID=67b7325f-861c-41e6-b770-4814b84aebba,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:03.161596 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:03.163969 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ca2183e8-72e0-4b3e-84c5-b603aad91a90,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:03.168249 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:03.189773 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] vlan segment allocate from pool success with {'vlan_id': 503, 'physical_network': 'physnet1'}  {{(pid=92323) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 03 08:33:03.210573 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:03.210917 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.db.segments_db [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Added segment aaa5b128-9aff-431e-b567-4ca42a016de6 of type vlan for network 4a053960-3cf4-4216-b7a5-291ef61e89b7
Jun 03 08:33:03.211040 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-16328800'] for router_interface, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:03.269759 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08d26efa-d544-42b4-87dd-1204c533b9b1 req-fef89604-718d-40e4-b027-9d6f91b80637 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:03.271545 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8774223827658'] for network, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:03.277368 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-08d26efa-d544-42b4-87dd-1204c533b9b1 req-fef89604-718d-40e4-b027-9d6f91b80637 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.3595040
Jun 03 08:33:03.380172 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-08d26efa-d544-42b4-87dd-1204c533b9b1 req-ba7d1470-7f48-44dd-9431-037a176d5c48 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1018102
Jun 03 08:33:03.483499 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820'] for network, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:03.500223 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:03.500223 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:03.535468 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-2798041b-9e7d-4038-9197-511c90e55e7a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:03.658824 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-4d3f5a39-fdd5-40d3-b59a-36626e5ade7e None None] Provisioning for port 67b7325f-861c-41e6-b770-4814b84aebba completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:33:03.671123 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-4d3f5a39-fdd5-40d3-b59a-36626e5ade7e None None] Provisioning complete for port 67b7325f-861c-41e6-b770-4814b84aebba triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:03.671513 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4d3f5a39-fdd5-40d3-b59a-36626e5ade7e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:03.762862 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-4d3f5a39-fdd5-40d3-b59a-36626e5ade7e None None] Port 67b7325f-861c-41e6-b770-4814b84aebba cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:33:03.880584 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:03.882378 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Pushing event updated for resources: {'Network': ['ID=4a053960-3cf4-4216-b7a5-291ef61e89b7,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:03.886850 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.353s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:03.916780 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Network 4a053960-3cf4-4216-b7a5-291ef61e89b7 details requested by agent ovs-agent-dv-cinder-787262-5-iscsi with host dv-cinder-787262-5-iscsi {{(pid=92325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 03 08:33:04.028093 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 2.3732595
Jun 03 08:33:04.031126 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 49872) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:04.039195 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-72136203-9a0a-4b2b-a7ee-f5c68d616d8f admin admin] Request body: {'subnet': {'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1807805368-subnet', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'ip_version': 4}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:04.072451 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-72136203-9a0a-4b2b-a7ee-f5c68d616d8f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:04.106055 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 7bd8082c-c1ea-4edf-bafc-03cff8ed0641 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:04.113321 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-72136203-9a0a-4b2b-a7ee-f5c68d616d8f admin admin] Usage tracker for resource:subnet and tenant:0e5e096a327f421e9b0a02235740cc36 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:04.122382 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-72136203-9a0a-4b2b-a7ee-f5c68d616d8f admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:04.168680 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-72136203-9a0a-4b2b-a7ee-f5c68d616d8f admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:04.248856 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a2428bb-ce12-4fc4-b1be-7d46d58ac11c req-aa110f4c-9224-4cb5-bb41-ef7b6109a4ef tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:04.262202 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9a2428bb-ce12-4fc4-b1be-7d46d58ac11c req-aa110f4c-9224-4cb5-bb41-ef7b6109a4ef tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.3628440
Jun 03 08:33:04.320665 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-72136203-9a0a-4b2b-a7ee-f5c68d616d8f admin admin] Made reservation on behalf of 0e5e096a327f421e9b0a02235740cc36 for: {'subnet': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:33:04.322225 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-72136203-9a0a-4b2b-a7ee-f5c68d616d8f admin admin] Notify callbacks [] for subnet, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:04.398449 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port 7bd8082c-c1ea-4edf-bafc-03cff8ed0641 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:33:04.403526 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 7bd8082c-c1ea-4edf-bafc-03cff8ed0641 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:04.410228 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:04.534774 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9a2428bb-ce12-4fc4-b1be-7d46d58ac11c req-6645d12a-5b25-4be9-a064-24dc8c5c6a2b tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2713723
Jun 03 08:33:04.774804 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-361835a9-1a1a-4db9-9a69-9bdf614f2a28 req-d26e57ef-6980-4bd1-ac50-5fa74c101b8f tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 210 time: 0.0818286
Jun 03 08:33:04.789063 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:04.798130 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] Notify callbacks [] for port, precommit_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:04.816307 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c262bd92-0f8f-406b-b590-7440442c784a req-2b2f7c19-d591-40d3-95ae-790437871534 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:04.817955 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c262bd92-0f8f-406b-b590-7440442c784a req-2b2f7c19-d591-40d3-95ae-790437871534 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.8703415
Jun 03 08:33:04.829978 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port 7bd8082c-c1ea-4edf-bafc-03cff8ed0641, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=7bd8082c-c1ea-4edf-bafc-03cff8ed0641,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:33:04.889221 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-bbbd0cdc-1a2a-4e11-b13c-6874f694d258 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15641492', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14870385'] for subnet, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:04.913991 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-fca6b0e1-a55b-4688-9af8-524d8ccd892a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:04.957238 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:04.959264 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:04.961799 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:04.970158 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15641369'] for port, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:05.067535 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-16344774', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-16328707'] for router_interface, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:05.071332 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=7bd8082c-c1ea-4edf-bafc-03cff8ed0641,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:05.074549 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c262bd92-0f8f-406b-b590-7440442c784a req-20305fb1-80a6-4492-beb2-0d7a6a96ad3d tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1855819
Jun 03 08:33:05.074966 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:05.114906 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bbbd0cdc-1a2a-4e11-b13c-6874f694d258 admin admin] Checking segment: {'id': '6978222c-6678-416a-a506-1fa962d91d64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 523, 'network_id': 'd6b7a34f-3fa8-4a38-ab72-8c6458a51990'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:33:05.115495 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bbbd0cdc-1a2a-4e11-b13c-6874f694d258 admin admin] Network hostable DHCP agents. Network: d6b7a34f-3fa8-4a38-ab72-8c6458a51990, hostable agents: ['07372699-02ac-4239-816f-84b3a5b0eff9'], hosted agents: [] {{(pid=92324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 03 08:33:05.321242 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-ecb892b2-ff60-4253-a291-ae81d026731d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:05.337375 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbbd0cdc-1a2a-4e11-b13c-6874f694d258 admin admin] Pushing event updated for resources: {'Subnet': ['ID=511f126c-ca8b-42fb-80d6-5f4b9a80cf7e,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:05.340743 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-bbbd0cdc-1a2a-4e11-b13c-6874f694d258 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.427s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:05.344959 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.277s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:05.407605 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-72136203-9a0a-4b2b-a7ee-f5c68d616d8f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829'] for subnet, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:05.417497 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:05.456147 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] Pushing event updated for resources: {'Port': ['ID=67b7325f-861c-41e6-b770-4814b84aebba,revision_number=2']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:05.460129 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:05.472153 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] Network 113ded30-096c-4860-8773-fb717f3ea4c6 is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:33:05.479821 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:33:05.545095 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72136203-9a0a-4b2b-a7ee-f5c68d616d8f admin admin] Pushing event updated for resources: {'Subnet': ['ID=fc181126-7c66-44d3-b731-a59036bd562f,revision_number=0']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:05.548581 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72136203-9a0a-4b2b-a7ee-f5c68d616d8f admin admin] Checking segment: {'id': 'aaa5b128-9aff-431e-b567-4ca42a016de6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:33:05.549282 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-72136203-9a0a-4b2b-a7ee-f5c68d616d8f admin admin] Network hostable DHCP agents. Network: 4a053960-3cf4-4216-b7a5-291ef61e89b7, hostable agents: ['07372699-02ac-4239-816f-84b3a5b0eff9'], hosted agents: [] {{(pid=92323) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 03 08:33:05.557548 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-72136203-9a0a-4b2b-a7ee-f5c68d616d8f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:05.758009 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-72136203-9a0a-4b2b-a7ee-f5c68d616d8f admin admin] Network 4a053960-3cf4-4216-b7a5-291ef61e89b7 is scheduled to be hosted by DHCP agent 07372699-02ac-4239-816f-84b3a5b0eff9 with binding_index 1 {{(pid=92323) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 03 08:33:05.892001 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bbbd0cdc-1a2a-4e11-b13c-6874f694d258 admin admin] Network d6b7a34f-3fa8-4a38-ab72-8c6458a51990 is scheduled to be hosted by DHCP agent 07372699-02ac-4239-816f-84b3a5b0eff9 with binding_index 1 {{(pid=92324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 03 08:33:05.919709 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-195b5374-160b-4b2d-bd13-b7b7f1f20caf req-d6fcf1c9-2855-4784-936d-97eb2802fc6a tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:05.921699 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-e969dec9-9058-405c-88a4-223fb6a6b591 None None] Provisioning complete for port 67b7325f-861c-41e6-b770-4814b84aebba triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:05.926365 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-e969dec9-9058-405c-88a4-223fb6a6b591 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:05.929316 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-195b5374-160b-4b2d-bd13-b7b7f1f20caf req-d6fcf1c9-2855-4784-936d-97eb2802fc6a tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.5939078
Jun 03 08:33:06.001052 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-1106c8a5-9b3b-4d06-a4b1-e06ff3e91e7e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:06.003071 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-1106c8a5-9b3b-4d06-a4b1-e06ff3e91e7e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.55 "GET /v2.0/networks?id=f9db9a2a-942b-4a98-97ed-1896cb9158b4 HTTP/1.1" status: 200  len: 815 time: 0.3076215
Jun 03 08:33:06.012424 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2dcdfdb-49b1-4329-9409-5c86b21a1c64 req-db0f352b-627e-4f09-b25c-bbb352e6b184 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:06.013433 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-195b5374-160b-4b2d-bd13-b7b7f1f20caf req-0409c97e-a8a9-43c8-9480-6a3de06eb586 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0798843
Jun 03 08:33:06.015189 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e2dcdfdb-49b1-4329-9409-5c86b21a1c64 req-db0f352b-627e-4f09-b25c-bbb352e6b184 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=5df35469-23b8-40f8-a651-bc60a1aadd9e HTTP/1.1" status: 200  len: 945 time: 0.3690734
Jun 03 08:33:06.029614 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-a157741f-ca5d-4f7f-822f-40edf4d8e26e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Request body: {'port': {'device_id': '8ddd6245-fce5-47f9-a7a6-680ac133188d', 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4', 'admin_state_up': True, 'tenant_id': '7bac6d994f4d49b292bc39fac07c0311'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:06.029854 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-e969dec9-9058-405c-88a4-223fb6a6b591 None None] Port 67b7325f-861c-41e6-b770-4814b84aebba cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:33:06.031591 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 7bd8082c-c1ea-4edf-bafc-03cff8ed0641 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:06.032154 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] Router b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:33:06.102622 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-72136203-9a0a-4b2b-a7ee-f5c68d616d8f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-5-iscsi, 4a053960-3cf4-4216-b7a5-291ef61e89b7) {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:33:06.114225 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aec16a2a-d863-47ce-9e6e-eafe8aa4eb5f None None] Network 4a053960-3cf4-4216-b7a5-291ef61e89b7 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:33:06.185888 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-72136203-9a0a-4b2b-a7ee-f5c68d616d8f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:06.186882 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-72136203-9a0a-4b2b-a7ee-f5c68d616d8f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:06.230043 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e2dcdfdb-49b1-4329-9409-5c86b21a1c64 req-207f8e48-925f-41b3-955d-ddbf56e3ae10 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1807156
Jun 03 08:33:06.268484 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 7bd8082c-c1ea-4edf-bafc-03cff8ed0641 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:06.269024 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:06.317073 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-bbbd0cdc-1a2a-4e11-b13c-6874f694d258 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-5-iscsi, d6b7a34f-3fa8-4a38-ab72-8c6458a51990) {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:33:06.340464 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-a157741f-ca5d-4f7f-822f-40edf4d8e26e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:06.351668 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-72136203-9a0a-4b2b-a7ee-f5c68d616d8f admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 2.3190987
Jun 03 08:33:06.361613 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 49884) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:06.374377 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1807805368-router', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:06.381496 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c63d6fc1-6f3e-4397-bab6-79f49c56408c None None] Network d6b7a34f-3fa8-4a38-ab72-8c6458a51990 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:33:06.383695 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-a157741f-ca5d-4f7f-822f-40edf4d8e26e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:06.403666 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:06.411809 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Usage tracker for resource:router and tenant:0e5e096a327f421e9b0a02235740cc36 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:06.418700 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:06.426069 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bbbd0cdc-1a2a-4e11-b13c-6874f694d258 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:06.426722 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-bbbd0cdc-1a2a-4e11-b13c-6874f694d258 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:06.433946 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:06.437156 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:06.517030 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-a157741f-ca5d-4f7f-822f-40edf4d8e26e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Made reservation on behalf of 7bac6d994f4d49b292bc39fac07c0311 for: {'port': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:33:06.520871 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-a157741f-ca5d-4f7f-822f-40edf4d8e26e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:06.567201 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d2caca54-abad-4b13-a9a3-3d8ca3503591 req-14f1a895-e703-4dea-a81c-678d873619fb tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 210 time: 0.1294246
Jun 03 08:33:06.600593 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c3f3982-f042-4369-b6eb-a3a8f5d56c4b req-9b8060c4-47e3-457a-903d-d4eb80ba1dab tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:06.620135 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6c3f3982-f042-4369-b6eb-a3a8f5d56c4b req-9b8060c4-47e3-457a-903d-d4eb80ba1dab tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.2524281
Jun 03 08:33:06.681802 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-bbbd0cdc-1a2a-4e11-b13c-6874f694d258 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 4.5883141
Jun 03 08:33:06.699422 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:33:06.727329 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] 10.222.0.11 "PUT /v2.0/routers/b0a93675-90ab-4436-ae4b-fc8b1f1a6c97/add_router_interface HTTP/1.1" status: 200  len: 503 time: 7.1494851
Jun 03 08:33:06.793755 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6c3f3982-f042-4369-b6eb-a3a8f5d56c4b req-3db8e503-7250-408a-bc75-fce801a9832a tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1702642
Jun 03 08:33:06.871360 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-a157741f-ca5d-4f7f-822f-40edf4d8e26e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Allocated IP 172.20.0.10 (f9db9a2a-942b-4a98-97ed-1896cb9158b4/5f3b55e2-964f-4ce8-9d71-3ac11dc6ebf1/6a3181af-0127-4cce-b71a-90b9c83c8f88) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:33:06.880849 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-16388154', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2397'] for router, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:06.883860 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-16389011', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-16327785', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-16383573', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2340'] for router, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:06.930272 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] Sync routers for ids ['b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:33:06.985584 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:07.101492 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] Routers {'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:33:07.102144 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86afe550>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:33:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:07.258857 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a4b91c8-8456-4a3d-8c27-19b20a27c860 req-fd465c26-d8bb-4291-b0fa-0d4338d49ff3 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:07.260650 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7a4b91c8-8456-4a3d-8c27-19b20a27c860 req-fd465c26-d8bb-4291-b0fa-0d4338d49ff3 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.3738441
Jun 03 08:33:07.286199 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-756329e1-3984-4d3a-8da4-00348e5b1f07 None None] Network d6b7a34f-3fa8-4a38-ab72-8c6458a51990 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:33:07.648175 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c50e70b9-d010-4dd1-b505-9d609d25a544 req-d536a590-6a91-4f9e-b8d0-f273a5dc7d1c tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:07.658010 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7a4b91c8-8456-4a3d-8c27-19b20a27c860 req-6a175e58-f38c-420b-8c95-c6696eb09572 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2410429
Jun 03 08:33:07.659165 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c50e70b9-d010-4dd1-b505-9d609d25a544 req-d536a590-6a91-4f9e-b8d0-f273a5dc7d1c tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.3499525
Jun 03 08:33:07.760946 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp3789a88e-0f76-536c-9507-4ab4ace56879-4a053960-3cf4-4216-b7a5-291ef61e89b7', 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'fixed_ips': [{'subnet_id': 'fc181126-7c66-44d3-b731-a59036bd562f'}]}} from dv-cinder-787262-5-iscsi. {{(pid=92325) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 03 08:33:07.765822 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:07.831459 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c50e70b9-d010-4dd1-b505-9d609d25a544 req-5cd11d50-9e5a-4a8b-ad7f-7e42c2bd948e tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1710238
Jun 03 08:33:07.885364 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a5ef28d-d03d-4e71-a8b6-16fb28f87dfb req-43b486fd-9036-4b57-ba8e-2fe691d0934b tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:07.887223 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] Set router b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:33:07.889427 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8a5ef28d-d03d-4e71-a8b6-16fb28f87dfb req-43b486fd-9036-4b57-ba8e-2fe691d0934b tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.55 "GET /v2.0/ports?device_id=5df35469-23b8-40f8-a651-bc60a1aadd9e HTTP/1.1" status: 200  len: 945 time: 0.3915334
Jun 03 08:33:08.106593 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 49918) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:08.119263 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-16327803', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-16388116', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2358'] for router, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:08.123496 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-86704573-network', 'tenant_id': '7de719cd894b4eff8d1ebe284e30569b'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:08.131602 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-a157741f-ca5d-4f7f-822f-40edf4d8e26e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:08.142340 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:08.150698 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Usage tracker for resource:network and tenant:7de719cd894b4eff8d1ebe284e30569b is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:08.155930 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:08.181792 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a105578-5e53-4685-a46b-5d07df207ce0 req-49208948-b82e-4656-81f7-614dcf2d8769 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:08.183340 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0a105578-5e53-4685-a46b-5d07df207ce0 req-49208948-b82e-4656-81f7-614dcf2d8769 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=5df35469-23b8-40f8-a651-bc60a1aadd9e HTTP/1.1" status: 200  len: 945 time: 0.2364151
Jun 03 08:33:08.198819 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:08.269680 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-07efdbfc-be12-465a-adfa-63998a62bd64 req-d7bd7f39-1184-473a-b1a7-b72c0f0673a7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 210 time: 0.0679190
Jun 03 08:33:08.324913 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [req-8a5ef28d-d03d-4e71-a8b6-16fb28f87dfb req-abec9ab5-6e84-4431-b8e0-50ddbe3d4848 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Deleting port 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f {{(pid=92324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:33:08.325340 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-8a5ef28d-d03d-4e71-a8b6-16fb28f87dfb req-abec9ab5-6e84-4431-b8e0-50ddbe3d4848 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:08.334540 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0a105578-5e53-4685-a46b-5d07df207ce0 req-8ecc7988-b9f7-4b6e-8ca4-536f8fa27703 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1438489
Jun 03 08:33:08.536229 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.db [req-8a5ef28d-d03d-4e71-a8b6-16fb28f87dfb req-abec9ab5-6e84-4431-b8e0-50ddbe3d4848 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] For port 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f,segment=NetworkSegment(9559424d-973e-4a97-92a4-8a446b0a62b5),segment_id=9559424d-973e-4a97-92a4-8a446b0a62b5)] {{(pid=92324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:33:08.536623 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-8a5ef28d-d03d-4e71-a8b6-16fb28f87dfb req-abec9ab5-6e84-4431-b8e0-50ddbe3d4848 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:08.602980 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.db_base_plugin_common [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Allocated IP 172.20.0.2 (4a053960-3cf4-4216-b7a5-291ef61e89b7/fc181126-7c66-44d3-b731-a59036bd562f/4c8a9990-58ca-4dbf-ad59-9ae166e2fd63) {{(pid=92325) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:33:08.656300 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:08.659658 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-a157741f-ca5d-4f7f-822f-40edf4d8e26e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:08.671605 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:08.710324 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [req-8a5ef28d-d03d-4e71-a8b6-16fb28f87dfb req-abec9ab5-6e84-4431-b8e0-50ddbe3d4848 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Calling delete_port for 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f owned by compute:nova {{(pid=92324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:33:08.714195 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Made reservation on behalf of 7de719cd894b4eff8d1ebe284e30569b for: {'network': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:33:08.717163 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-676039'] for network, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:08.742245 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:08.798384 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-a157741f-ca5d-4f7f-822f-40edf4d8e26e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Network f9db9a2a-942b-4a98-97ed-1896cb9158b4 is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:33:08.803182 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-a157741f-ca5d-4f7f-822f-40edf4d8e26e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:33:08.809176 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-a157741f-ca5d-4f7f-822f-40edf4d8e26e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:33:08.815326 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-a157741f-ca5d-4f7f-822f-40edf4d8e26e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:08.816319 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-a157741f-ca5d-4f7f-822f-40edf4d8e26e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:08.822300 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a157741f-ca5d-4f7f-822f-40edf4d8e26e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Pushing event updated for resources: {'Port': ['ID=6a3181af-0127-4cce-b71a-90b9c83c8f88,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:08.833857 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a157741f-ca5d-4f7f-822f-40edf4d8e26e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:08.854197 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['24826ba2-ee17-4774-b5ca-2cd1675f325a', 'a309b335-7644-4c59-8d6b-90e763827a25', '4da2f73c-9644-4280-92c1-e0be72f1fdad'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:33:08.898162 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e1bc9a5-e372-4bf9-a31a-f69358bc850c req-dfff05c2-b2cc-43e7-93d6-674d8cb8180d tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:08.899583 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-5e1bc9a5-e372-4bf9-a31a-f69358bc850c req-dfff05c2-b2cc-43e7-93d6-674d8cb8180d tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.4629893
Jun 03 08:33:08.915970 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:08.937354 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Usage tracker for resource:security_group_rule and tenant:7de719cd894b4eff8d1ebe284e30569b is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:08.949814 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:08.960239 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:09.003134 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-5e1bc9a5-e372-4bf9-a31a-f69358bc850c req-a1dca231-dc33-418d-a691-188583bcf09e tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0891056
Jun 03 08:33:09.035105 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-a157741f-ca5d-4f7f-822f-40edf4d8e26e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.55 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 3.0179548
Jun 03 08:33:09.050517 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Request body: {'port': {'device_id': '8ddd6245-fce5-47f9-a7a6-680ac133188d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:09.220499 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86afe550>, [{'id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'name': 'tempest-TestMinimumBasicScenario-825399230-router', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:52Z', 'updated_at': '2021-06-03T08:33:03Z', 'revision_number': 4, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'gw_port': {'id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:59:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 358, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:54Z', 'updated_at': '2021-06-03T08:33:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '67b7325f-861c-41e6-b770-4814b84aebba', 'name': '', 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'mac_address': 'fa:16:3e:22:e2:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 376, 'fixed_ips': [{'subnet_id': '159409d9-9245-4f6d-adbe-4aa8aad78d07', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:01Z', 'updated_at': '2021-06-03T08:33:04Z', 'revision_number': 2, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'subnets': [{'id': '159409d9-9245-4f6d-adbe-4aa8aad78d07', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:09.231391 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:09.244651 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] Checking router: b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:33:09.245110 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] Updating router b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 port 67b7325f-861c-41e6-b770-4814b84aebba binding host dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 03 08:33:09.453763 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Notify callbacks [] for port, precommit_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:09.465772 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-8a5ef28d-d03d-4e71-a8b6-16fb28f87dfb req-abec9ab5-6e84-4431-b8e0-50ddbe3d4848 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:09.485162 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Transition to ACTIVE for port object 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63 will not be triggered until provisioned by entity L2. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:33:09.495430 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:09.502106 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:09.507379 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:09.538184 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c993337a-98e2-457a-bc7c-aeed8f8f9de8 req-9f26bc12-dade-41d5-ab33-cb1329e6c00b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:09.541493 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c993337a-98e2-457a-bc7c-aeed8f8f9de8 req-9f26bc12-dade-41d5-ab33-cb1329e6c00b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.6256404
Jun 03 08:33:09.596138 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Transition to ACTIVE for port object 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63 will not be triggered until provisioned by entity DHCP. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:33:09.604621 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:09.608628 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abec9ab5-6e84-4431-b8e0-50ddbe3d4848 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Pushing event deleted for resources: {'Port': ['ID=6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:09.614861 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-abec9ab5-6e84-4431-b8e0-50ddbe3d4848 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:09.616423 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-2bb1fb4e-f11b-4a60-a956-f4aa8c1b4990 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.004s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:09.689379 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] vlan segment allocate from pool success with {'vlan_id': 504, 'physical_network': 'physnet1'}  {{(pid=92324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 03 08:33:09.748232 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [req-8a5ef28d-d03d-4e71-a8b6-16fb28f87dfb req-abec9ab5-6e84-4431-b8e0-50ddbe3d4848 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] No DVR routers for this DVR port 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f on host hv-cinder-78726 {{(pid=92324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:33:09.752041 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:09.752390 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.segments_db [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Added segment 8acb7a59-d9f0-4604-be49-ed0601f465ae of type vlan for network 15e18fdf-cd32-4b01-8841-c321ea578305
Jun 03 08:33:09.753779 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f7ada93-849a-407a-8d47-5a1db5fd6bdc,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:09.762208 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:09.773594 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:09.775319 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-312d7783-b544-4d4a-98fc-c90db8ce9b93 req-51361423-f5dc-430a-8bf5-171fd41df19f tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:09.782471 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-312d7783-b544-4d4a-98fc-c90db8ce9b93 req-51361423-f5dc-430a-8bf5-171fd41df19f tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.5736961
Jun 03 08:33:09.800024 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c993337a-98e2-457a-bc7c-aeed8f8f9de8 req-88f27150-26a3-462f-a0ff-3be904e59564 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2287393
Jun 03 08:33:09.812993 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-8a5ef28d-d03d-4e71-a8b6-16fb28f87dfb req-abec9ab5-6e84-4431-b8e0-50ddbe3d4848 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:09.836599 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5df35469-23b8-40f8-a651-bc60a1aadd9e', 'name': 'network-vif-deleted', 'tag': '6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f'}] {{(pid=92324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:33:09.836599 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}25ad023063ed160b339e2d2d51ef3e5c51250aece1f4db0a35843dff1b64291a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-12dad165-3b10-42b2-afd2-fcd21d7208e2" -d '{"events": [{"server_uuid": "5df35469-23b8-40f8-a651-bc60a1aadd9e", "name": "network-vif-deleted", "tag": "6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f"}]}' {{(pid=92324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:33:09.912553 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Pushing event updated for resources: {'Port': ['ID=4c8a9990-58ca-4dbf-ad59-9ae166e2fd63,revision_number=1']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:09.925279 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.308s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:09.943039 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Network 4a053960-3cf4-4216-b7a5-291ef61e89b7 is already hosted by enough agents. {{(pid=92325) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:33:09.951995 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.scheduler.base_scheduler [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Resources bound (agent type, host, resource id):  {{(pid=92325) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:33:09.956446 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Received port after_create {{(pid=92325) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:33:10.002851 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8774223827658'] for network, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:10.007857 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:10.008387 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:10.009039 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:10.009570 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:10.010068 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:10.010504 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:10.013538 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:10.013538 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:10.013538 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:10.013538 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:10.013538 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:10.013538 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:10.018849 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.245s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:10.021229 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-312d7783-b544-4d4a-98fc-c90db8ce9b93 req-c2b6f95b-07b2-46c0-a31e-3c5e4507ad9f tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2377329
Jun 03 08:33:10.054359 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8a5ef28d-d03d-4e71-a8b6-16fb28f87dfb req-abec9ab5-6e84-4431-b8e0-50ddbe3d4848 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.55 "DELETE /v2.0/ports/6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f HTTP/1.1" status: 204  len: 173 time: 2.1583295
Jun 03 08:33:10.084200 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6a3181af-0127-4cce-b71a-90b9c83c8f88 {{(pid=92323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:33:10.093158 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:10.110086 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Transition to ACTIVE for port object 6a3181af-0127-4cce-b71a-90b9c83c8f88 will not be triggered until provisioned by entity L2. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:33:10.169430 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:10.219833 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:10.247570 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820'] for network, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:10.257091 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:10.258140 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:10.263953 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-2a5070d8-d9f6-4340-bbc7-53814f61c87d req-01a489c8-fef3-4161-b8f0-8359c49e76a3 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Synchronizing usage tracker for tenant:96ee04709f4540ee8818120a88291b46 on resource:port {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:33:10.267919 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:10.270669 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:10.285713 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-862a0233-3886-42a3-9a81-54253f967a75 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:10.296526 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Attempting to bind port 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63 on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:33:10.296907 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Attempting to bind port 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63 by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': 'aaa5b128-9aff-431e-b567-4ca42a016de6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7'}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:33:10.297279 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Attempting to bind port 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63 on network 4a053960-3cf4-4216-b7a5-291ef61e89b7 {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:33:10.405225 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 33, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:33:10.405785 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Checking segment: {'id': 'aaa5b128-9aff-431e-b567-4ca42a016de6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:33:10.406289 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:10.406831 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Bound using segment: {'id': 'aaa5b128-9aff-431e-b567-4ca42a016de6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7'} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:33:10.407477 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Bound port: 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aaa5b128-9aff-431e-b567-4ca42a016de6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7'}}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:33:10.407957 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:10.416808 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Pushing event updated for resources: {'Network': ['ID=15e18fdf-cd32-4b01-8841-c321ea578305,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:10.422326 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:10.435941 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Network 15e18fdf-cd32-4b01-8841-c321ea578305 details requested by agent ovs-agent-dv-cinder-787262-5-iscsi with host dv-cinder-787262-5-iscsi {{(pid=92325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 03 08:33:10.454756 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201  len: 886 time: 2.3469265
Jun 03 08:33:10.456116 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 49942) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:10.456575 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-2a5070d8-d9f6-4340-bbc7-53814f61c87d req-01a489c8-fef3-4161-b8f0-8359c49e76a3 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Unset dirty status for tenant:96ee04709f4540ee8818120a88291b46 on resource:port {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:33:10.471564 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2a5070d8-d9f6-4340-bbc7-53814f61c87d req-01a489c8-fef3-4161-b8f0-8359c49e76a3 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=5df35469-23b8-40f8-a651-bc60a1aadd9e HTTP/1.1" status: 200  len: 210 time: 0.2710383
Jun 03 08:33:10.479554 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-7b6566f0-56a8-4411-87a8-c856d1efe702 admin admin] Request body: {'subnet': {'network_id': '15e18fdf-cd32-4b01-8841-c321ea578305', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-86704573-subnet', 'tenant_id': '7de719cd894b4eff8d1ebe284e30569b', 'ip_version': 4}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:10.496462 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-7b6566f0-56a8-4411-87a8-c856d1efe702 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:10.500523 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-7b6566f0-56a8-4411-87a8-c856d1efe702 admin admin] Usage tracker for resource:subnet and tenant:7de719cd894b4eff8d1ebe284e30569b is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:10.503612 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-7b6566f0-56a8-4411-87a8-c856d1efe702 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:10.510249 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-7b6566f0-56a8-4411-87a8-c856d1efe702 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:10.530365 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:33:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-76bf54fd-fc47-4f80-9b87-c26bf6db30d9 x-openstack-request-id: req-76bf54fd-fc47-4f80-9b87-c26bf6db30d9 {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:33:10.530934 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5df35469-23b8-40f8-a651-bc60a1aadd9e", "name": "network-vif-deleted", "tag": "6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f", "status": "completed", "code": 200}]} {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:33:10.531447 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-76bf54fd-fc47-4f80-9b87-c26bf6db30d9 {{(pid=92324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:33:10.532014 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5df35469-23b8-40f8-a651-bc60a1aadd9e', 'name': 'network-vif-deleted', 'tag': '6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f', 'status': 'completed', 'code': 200}
Jun 03 08:33:10.620786 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17e4b1ae-9bc2-4d0d-a4c2-1e3e7bd96151 req-d4277d3a-9b67-49bb-aef6-65349cbed9a7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:10.621549 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-17e4b1ae-9bc2-4d0d-a4c2-1e3e7bd96151 req-d4277d3a-9b67-49bb-aef6-65349cbed9a7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Synchronizing usage tracker for tenant:7bac6d994f4d49b292bc39fac07c0311 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:33:10.662301 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7b6566f0-56a8-4411-87a8-c856d1efe702 admin admin] Made reservation on behalf of 7de719cd894b4eff8d1ebe284e30569b for: {'subnet': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:33:10.669507 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7b6566f0-56a8-4411-87a8-c856d1efe702 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:10.754546 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] For port 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:33:10.758299 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] For port 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=4c8a9990-58ca-4dbf-ad59-9ae166e2fd63,segment=NetworkSegment(aaa5b128-9aff-431e-b567-4ca42a016de6),segment_id=aaa5b128-9aff-431e-b567-4ca42a016de6)] {{(pid=92325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:33:10.801050 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3d524b5-0dd8-414f-9a0a-d0d461a08235 req-2bd329e4-1bd3-4730-8a9b-945e4aa1a7d5 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:10.810993 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f3d524b5-0dd8-414f-9a0a-d0d461a08235 req-2bd329e4-1bd3-4730-8a9b-945e4aa1a7d5 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.1562865
Jun 03 08:33:10.868029 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] Notify callbacks [] for port, precommit_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:10.883262 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f3d524b5-0dd8-414f-9a0a-d0d461a08235 req-dad930f0-4590-4868-96c1-0cca923a6adb tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0711610
Jun 03 08:33:10.889892 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] Transition to ACTIVE for port object 67b7325f-861c-41e6-b770-4814b84aebba will not be triggered until provisioned by entity L2. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:33:10.909355 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:10.936018 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:11.021659 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:11.182655 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Pushing event updated for resources: {'Port': ['ID=6a3181af-0127-4cce-b71a-90b9c83c8f88,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:11.194062 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.908s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:11.292154 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Allocated IP 172.27.0.155 (684ef871-89aa-450d-ae0d-e232bfaf51fb/e7b58fba-1ed5-483b-b341-7736b2ffb853/bea952c0-6612-45c9-abe7-1c904d1c4f14) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:33:11.354217 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Pushing event updated for resources: {'Port': ['ID=4c8a9990-58ca-4dbf-ad59-9ae166e2fd63,revision_number=2']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:11.361116 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.425s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:11.361678 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.332s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:11.373108 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec54c7e7-fd49-4b83-982d-48931f46da0a req-961c7679-c8f8-4f64-91cf-e8e7b6fceaa0 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:11.377401 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ec54c7e7-fd49-4b83-982d-48931f46da0a req-961c7679-c8f8-4f64-91cf-e8e7b6fceaa0 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.2767334
Jun 03 08:33:11.502072 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ec54c7e7-fd49-4b83-982d-48931f46da0a req-3bfe2dde-f6a3-402b-9359-3cd4ade21e46 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1155052
Jun 03 08:33:11.519239 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Attempting to bind port 6a3181af-0127-4cce-b71a-90b9c83c8f88 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:33:11.519579 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Attempting to bind port 6a3181af-0127-4cce-b71a-90b9c83c8f88 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '9923ac74-9556-45ec-9044-43728d2a8ec3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4'}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:33:11.519908 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Attempting to bind port 6a3181af-0127-4cce-b71a-90b9c83c8f88 on network f9db9a2a-942b-4a98-97ed-1896cb9158b4 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:33:11.539151 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Port 6a3181af-0127-4cce-b71a-90b9c83c8f88 on network f9db9a2a-942b-4a98-97ed-1896cb9158b4 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 03 08:33:11.539474 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Attempting to bind port 6a3181af-0127-4cce-b71a-90b9c83c8f88 on network f9db9a2a-942b-4a98-97ed-1896cb9158b4 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:33:11.539988 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] Attempting to bind port 67b7325f-861c-41e6-b770-4814b84aebba on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:33:11.540358 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] Attempting to bind port 67b7325f-861c-41e6-b770-4814b84aebba by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '3151dd7e-a009-433b-ae5e-c81299e42bfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6'}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:33:11.540732 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] Attempting to bind port 67b7325f-861c-41e6-b770-4814b84aebba on network 113ded30-096c-4860-8773-fb717f3ea4c6 {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:33:11.568211 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 33, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:33:11.568833 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] Checking segment: {'id': '3151dd7e-a009-433b-ae5e-c81299e42bfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:33:11.569455 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:11.569867 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] Bound using segment: {'id': '3151dd7e-a009-433b-ae5e-c81299e42bfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6'} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:33:11.570361 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] Bound port: 67b7325f-861c-41e6-b770-4814b84aebba, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3151dd7e-a009-433b-ae5e-c81299e42bfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6'}}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:33:11.570789 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:11.594538 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Checking agent: {'id': '181c5753-100b-4f03-bda8-e34279b057f4', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'started_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 32, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:33:11.611777 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Checking segment: {'id': '9923ac74-9556-45ec-9044-43728d2a8ec3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:33:11.612038 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Bound using segment: {'id': '9923ac74-9556-45ec-9044-43728d2a8ec3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4'} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:33:11.612490 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Bound port: 6a3181af-0127-4cce-b71a-90b9c83c8f88, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9923ac74-9556-45ec-9044-43728d2a8ec3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 511, 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4'}}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:33:11.612878 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:11.664067 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e05eaaa8-64d4-42de-b214-8cb4ecc91820 None None] Pushing event updated for resources: {'Port': ['ID=67b7325f-861c-41e6-b770-4814b84aebba,revision_number=3']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:11.671840 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-e05eaaa8-64d4-42de-b214-8cb4ecc91820 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.310s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:11.697397 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-17e4b1ae-9bc2-4d0d-a4c2-1e3e7bd96151 req-d4277d3a-9b67-49bb-aef6-65349cbed9a7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Unset dirty status for tenant:7bac6d994f4d49b292bc39fac07c0311 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:33:11.698890 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-17e4b1ae-9bc2-4d0d-a4c2-1e3e7bd96151 req-d4277d3a-9b67-49bb-aef6-65349cbed9a7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 932 time: 1.5863104
Jun 03 08:33:11.735936 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] For port 67b7325f-861c-41e6-b770-4814b84aebba, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:33:11.756304 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] For port 67b7325f-861c-41e6-b770-4814b84aebba, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=67b7325f-861c-41e6-b770-4814b84aebba,segment=NetworkSegment(3151dd7e-a009-433b-ae5e-c81299e42bfb),segment_id=3151dd7e-a009-433b-ae5e-c81299e42bfb)] {{(pid=92325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:33:11.868012 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:11.882603 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:11.882603 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:11.922146 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-17e4b1ae-9bc2-4d0d-a4c2-1e3e7bd96151 req-87361ce9-f68b-4975-bfc3-f8a4918a2c32 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2049799
Jun 03 08:33:11.929184 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] For port 6a3181af-0127-4cce-b71a-90b9c83c8f88, host hv-cinder-78726, cleared binding levels {{(pid=92323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:33:11.937779 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] For port 6a3181af-0127-4cce-b71a-90b9c83c8f88, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=6a3181af-0127-4cce-b71a-90b9c83c8f88,segment=NetworkSegment(9923ac74-9556-45ec-9044-43728d2a8ec3),segment_id=9923ac74-9556-45ec-9044-43728d2a8ec3)] {{(pid=92323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:33:11.991536 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:12.010003 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-b5a505b9-0ccc-42f5-a5ee-6c063f092824 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:12.022607 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-b5a505b9-0ccc-42f5-a5ee-6c063f092824 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/networks?id=d6b7a34f-3fa8-4a38-ab72-8c6458a51990 HTTP/1.1" status: 200  len: 814 time: 0.2606456
Jun 03 08:33:12.040346 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:12.046620 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-92964000-8723-4f04-a6fb-566f2bb4ba44 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/quotas/9a96090cd93b48608ead040676d45129 HTTP/1.1" status: 200  len: 375 time: 0.0203321
Jun 03 08:33:12.062220 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.011s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:12.065395 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] Routers {'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:33:12.066056 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86afe550>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:33:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:12.158007 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:12.171483 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-b8f902db-1e24-423c-87e1-09c42f07bf9d tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=9a96090cd93b48608ead040676d45129&fields=id HTTP/1.1" status: 200  len: 210 time: 0.1236541
Jun 03 08:33:12.188957 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e05eaaa8-64d4-42de-b214-8cb4ecc91820 None None] Pushing event updated for resources: {'Port': ['ID=67b7325f-861c-41e6-b770-4814b84aebba,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:12.202383 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-e05eaaa8-64d4-42de-b214-8cb4ecc91820 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.323s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:12.295923 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:12.297245 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:12.298947 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] 10.222.0.55 "PUT /v2.0/ports/6a3181af-0127-4cce-b71a-90b9c83c8f88 HTTP/1.1" status: 200  len: 1094 time: 3.2531924
Jun 03 08:33:12.302148 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8ddd6245-fce5-47f9-a7a6-680ac133188d', 'tag': '6a3181af-0127-4cce-b71a-90b9c83c8f88'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:33:12.308701 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-66ef4dee-3290-401e-a0e4-3bb53f80684e" -d '{"events": [{"name": "network-changed", "server_uuid": "8ddd6245-fce5-47f9-a7a6-680ac133188d", "tag": "6a3181af-0127-4cce-b71a-90b9c83c8f88"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:33:12.436207 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7b6566f0-56a8-4411-87a8-c856d1efe702 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829'] for subnet, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:12.449346 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:33:12.458173 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-7d778527-6e85-4665-9b38-92ddd7d6532d service neutron] 10.222.0.11 "GET /v2.0/networks/d6b7a34f-3fa8-4a38-ab72-8c6458a51990?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2784171
Jun 03 08:33:12.506922 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] No Port match for: 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:33:12.507705 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 6cf1d48c-f13e-4b44-9ee1-55d6ad3ec69f not bound to the agent host hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:33:12.518706 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:33:12.544949 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:33:12.550938 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:33:12.584742 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] Set router b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:33:12.683823 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:33:12.689861 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-34713134-2a9a-462b-9fab-deea5fdb6cae service neutron] 10.222.0.11 "GET /v2.0/networks/d6b7a34f-3fa8-4a38-ab72-8c6458a51990?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2237933
Jun 03 08:33:12.717619 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28d74466-dc7b-4fee-8085-b6831550a9ee None None] Network 4a053960-3cf4-4216-b7a5-291ef61e89b7 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:33:12.794260 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Pushing event updated for resources: {'Port': ['ID=6a3181af-0127-4cce-b71a-90b9c83c8f88,revision_number=3']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:12.798894 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.737s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:12.806899 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-50355273-556a-4cd0-941d-7e20bd2fa10c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.615s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:12.915152 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-6ac5cbae-0034-4682-ba8b-aea818db239d None None] Provisioning for port 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63 completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:33:12.965754 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fddf44f-1b89-4f32-850f-6e322c9f7eb3 req-97478f0e-b0bd-41a5-85e3-d6e7ab809aae tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:12.967363 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3fddf44f-1b89-4f32-850f-6e322c9f7eb3 req-97478f0e-b0bd-41a5-85e3-d6e7ab809aae tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.7755070
Jun 03 08:33:13.006503 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b6566f0-56a8-4411-87a8-c856d1efe702 admin admin] Checking segment: {'id': '8acb7a59-d9f0-4604-be49-ed0601f465ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '15e18fdf-cd32-4b01-8841-c321ea578305'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:33:13.006751 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b6566f0-56a8-4411-87a8-c856d1efe702 admin admin] Network hostable DHCP agents. Network: 15e18fdf-cd32-4b01-8841-c321ea578305, hostable agents: ['07372699-02ac-4239-816f-84b3a5b0eff9'], hosted agents: [] {{(pid=92323) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 03 08:33:13.011422 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-19feba83-d53f-4af7-bf99-f3865b9a9bae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:13.013063 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-19feba83-d53f-4af7-bf99-f3865b9a9bae service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=7bac6d994f4d49b292bc39fac07c0311&device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 1097 time: 0.5619628
Jun 03 08:33:13.019427 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Pushing event updated for resources: {'Port': ['ID=bea952c0-6612-45c9-abe7-1c904d1c4f14,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:13.079385 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.273s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:13.086212 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.554s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:13.149686 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-6ac5cbae-0034-4682-ba8b-aea818db239d None None] Provisioning complete for port 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:13.150243 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-6ac5cbae-0034-4682-ba8b-aea818db239d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:13.278569 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-24a95f5f-3398-4342-bdf3-2984969550ab service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=6a3181af-0127-4cce-b71a-90b9c83c8f88 HTTP/1.1" status: 200  len: 217 time: 0.2535360
Jun 03 08:33:13.371787 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3fddf44f-1b89-4f32-850f-6e322c9f7eb3 req-0ae6f258-d45c-4ba7-a719-8fdbf72121a3 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.3923836
Jun 03 08:33:13.413366 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b6566f0-56a8-4411-87a8-c856d1efe702 admin admin] Pushing event updated for resources: {'Subnet': ['ID=12ddd2af-f3e3-46c1-98f9-a99828fc2abc,revision_number=0']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:13.417084 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-7b6566f0-56a8-4411-87a8-c856d1efe702 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.330s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:13.616174 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86afe550>, [{'id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'name': 'tempest-TestMinimumBasicScenario-825399230-router', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:52Z', 'updated_at': '2021-06-03T08:33:03Z', 'revision_number': 4, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'gw_port': {'id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:59:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 358, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:54Z', 'updated_at': '2021-06-03T08:33:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '67b7325f-861c-41e6-b770-4814b84aebba', 'name': '', 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'mac_address': 'fa:16:3e:22:e2:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 376, 'fixed_ips': [{'subnet_id': '159409d9-9245-4f6d-adbe-4aa8aad78d07', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:01Z', 'updated_at': '2021-06-03T08:33:11Z', 'revision_number': 4, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'subnets': [{'id': '159409d9-9245-4f6d-adbe-4aa8aad78d07', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:13.628688 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5144d319-a0df-461d-8ac3-027acb07303d None None] The sync data for ids ['b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'] in dv-cinder-787262-5-iscsi is: [{'id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'name': 'tempest-TestMinimumBasicScenario-825399230-router', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:52Z', 'updated_at': '2021-06-03T08:33:03Z', 'revision_number': 4, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'gw_port': {'id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:59:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 358, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:54Z', 'updated_at': '2021-06-03T08:33:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '67b7325f-861c-41e6-b770-4814b84aebba', 'name': '', 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'mac_address': 'fa:16:3e:22:e2:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 376, 'fixed_ips': [{'subnet_id': '159409d9-9245-4f6d-adbe-4aa8aad78d07', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:01Z', 'updated_at': '2021-06-03T08:33:11Z', 'revision_number': 4, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'subnets': [{'id': '159409d9-9245-4f6d-adbe-4aa8aad78d07', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:33:13.635081 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-6ac5cbae-0034-4682-ba8b-aea818db239d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:13.763092 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-6ac5cbae-0034-4682-ba8b-aea818db239d None None] For port 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=4c8a9990-58ca-4dbf-ad59-9ae166e2fd63,segment=NetworkSegment(aaa5b128-9aff-431e-b567-4ca42a016de6),segment_id=aaa5b128-9aff-431e-b567-4ca42a016de6)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:33:13.801914 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b6566f0-56a8-4411-87a8-c856d1efe702 admin admin] Network 15e18fdf-cd32-4b01-8841-c321ea578305 is scheduled to be hosted by DHCP agent 07372699-02ac-4239-816f-84b3a5b0eff9 with binding_index 1 {{(pid=92323) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 03 08:33:13.884445 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:33:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0ce747bc-9c22-4dc7-be17-6555ecf39dba x-openstack-request-id: req-0ce747bc-9c22-4dc7-be17-6555ecf39dba {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:33:13.884759 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8ddd6245-fce5-47f9-a7a6-680ac133188d", "tag": "6a3181af-0127-4cce-b71a-90b9c83c8f88", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:33:13.885035 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-0ce747bc-9c22-4dc7-be17-6555ecf39dba {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:33:13.885453 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8ddd6245-fce5-47f9-a7a6-680ac133188d', 'tag': '6a3181af-0127-4cce-b71a-90b9c83c8f88', 'status': 'completed', 'code': 200}
Jun 03 08:33:13.965739 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-771d8eef-4a6d-4e81-8249-2e40e9758076 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:13.966858 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-771d8eef-4a6d-4e81-8249-2e40e9758076 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=5f3b55e2-964f-4ce8-9d71-3ac11dc6ebf1 HTTP/1.1" status: 200  len: 855 time: 0.6627812
Jun 03 08:33:13.984607 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 67b7325f-861c-41e6-b770-4814b84aebba up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:13.994866 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23de78a0-dd61-497f-9f58-fbfca0287eee req-baf540a4-1745-4c3f-a041-17dbed2e17f9 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:14.004207 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-23de78a0-dd61-497f-9f58-fbfca0287eee req-baf540a4-1745-4c3f-a041-17dbed2e17f9 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.1620355
Jun 03 08:33:14.081814 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-23de78a0-dd61-497f-9f58-fbfca0287eee req-da0ffebf-8eb6-44de-a566-ca0023819c7a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0756555
Jun 03 08:33:14.093755 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-5644fde0-41d3-4667-8daa-e3541a67c9e6 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=f9db9a2a-942b-4a98-97ed-1896cb9158b4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1048436
Jun 03 08:33:14.103873 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-7b6566f0-56a8-4411-87a8-c856d1efe702 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-5-iscsi, 15e18fdf-cd32-4b01-8841-c321ea578305) {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:33:14.114274 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-6ac5cbae-0034-4682-ba8b-aea818db239d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:14.130901 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-bdc83bbb-6220-4ab7-b3ec-07b21b8db047 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:14.312665 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9225bdab-d5a1-4e0d-bbb9-e06311e972d7 None None] Network 15e18fdf-cd32-4b01-8841-c321ea578305 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:33:14.324845 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-a014d3fd-7b96-4681-9854-e01c54c2847e service neutron] 10.222.0.55 "GET /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2022862
Jun 03 08:33:14.326137 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b6566f0-56a8-4411-87a8-c856d1efe702 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:14.335081 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7b6566f0-56a8-4411-87a8-c856d1efe702 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:14.353038 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dfe7f49-fdaa-4baf-be34-41b8098dd649 req-266745db-d338-4414-a5d1-14486d556e19 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:14.361275 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6dfe7f49-fdaa-4baf-be34-41b8098dd649 req-266745db-d338-4414-a5d1-14486d556e19 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 944 time: 0.1263239
Jun 03 08:33:14.381907 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-8c43a456-c279-4a31-9b16-a0a730a61bca None None] Provisioning complete for port 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:14.382955 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-8c43a456-c279-4a31-9b16-a0a730a61bca None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:14.565915 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6dfe7f49-fdaa-4baf-be34-41b8098dd649 req-2bd31083-7dfc-4c23-8f07-6af6992cdcec tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1931958
Jun 03 08:33:14.589466 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ad8de743-99ed-4ea4-89a2-cb77ee5d3fdb req-76c8587e-edf6-42a6-bf80-9dd69f999a07 service neutron] 10.222.0.55 "GET /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2035990
Jun 03 08:33:14.594916 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-7b6566f0-56a8-4411-87a8-c856d1efe702 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 849 time: 4.1210079
Jun 03 08:33:14.603947 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 49990) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:14.613865 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-86704573-router', 'tenant_id': '7de719cd894b4eff8d1ebe284e30569b', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:14.632860 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:14.643698 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port 67b7325f-861c-41e6-b770-4814b84aebba completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:33:14.671902 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 67b7325f-861c-41e6-b770-4814b84aebba triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:14.672294 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:14.677060 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:14.705592 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Usage tracker for resource:router and tenant:7de719cd894b4eff8d1ebe284e30569b is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:14.728529 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ac5cbae-0034-4682-ba8b-aea818db239d None None] Pushing event updated for resources: {'Port': ['ID=4c8a9990-58ca-4dbf-ad59-9ae166e2fd63,revision_number=3']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:14.743975 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-6ac5cbae-0034-4682-ba8b-aea818db239d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.627s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:14.750919 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:14.801384 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:14.892801 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4182def8-0131-4cab-b2ea-85c44abe02fd req-55406ecc-c36c-4a30-b914-6398b7302a0d tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:14.903922 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-81a60c63-0f52-40da-92e4-6e6f60ab8bfb req-d0b29f26-3b10-4751-8b9b-4656e1e9d943 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 210 time: 0.0762212
Jun 03 08:33:14.906713 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4182def8-0131-4cab-b2ea-85c44abe02fd req-55406ecc-c36c-4a30-b914-6398b7302a0d tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 1.0203233
Jun 03 08:33:14.949783 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-16388154', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2397'] for router, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:14.951036 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-16389011', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-16327785', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-16383573', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2340'] for router, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:14.983109 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:15.098201 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:15.281795 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp3789a88e-0f76-536c-9507-4ab4ace56879-15e18fdf-cd32-4b01-8841-c321ea578305', 'network_id': '15e18fdf-cd32-4b01-8841-c321ea578305', 'tenant_id': '7de719cd894b4eff8d1ebe284e30569b', 'fixed_ips': [{'subnet_id': '12ddd2af-f3e3-46c1-98f9-a99828fc2abc'}]}} from dv-cinder-787262-5-iscsi. {{(pid=92325) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 03 08:33:15.289664 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:15.306381 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4182def8-0131-4cab-b2ea-85c44abe02fd req-d64f8767-a99a-40a1-a849-7b09e5070902 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3987501
Jun 03 08:33:15.335559 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port 67b7325f-861c-41e6-b770-4814b84aebba, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=67b7325f-861c-41e6-b770-4814b84aebba,segment=NetworkSegment(3151dd7e-a009-433b-ae5e-c81299e42bfb),segment_id=3151dd7e-a009-433b-ae5e-c81299e42bfb)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:33:15.560362 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:15.563477 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:15.703136 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=67b7325f-861c-41e6-b770-4814b84aebba,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:15.706195 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66ef4dee-3290-401e-a0e4-3bb53f80684e req-6c6cf439-22b5-443d-9762-ec07b5fcbcdb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:15.707750 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-66ef4dee-3290-401e-a0e4-3bb53f80684e req-6c6cf439-22b5-443d-9762-ec07b5fcbcdb service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=7bac6d994f4d49b292bc39fac07c0311&device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 1097 time: 0.5180790
Jun 03 08:33:15.707927 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:15.746440 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.db_base_plugin_common [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Allocated IP 172.20.0.2 (15e18fdf-cd32-4b01-8841-c321ea578305/12ddd2af-f3e3-46c1-98f9-a99828fc2abc/d9c1690f-ea93-4b43-a1b8-643701ef85de) {{(pid=92325) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:33:15.787358 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-16388099', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-16327774'] for router, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:15.983900 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c4af99a-1b9b-459a-b478-61189b692340 req-dfda781a-db3a-4daf-b83a-9439ab4465c1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:15.985474 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4c4af99a-1b9b-459a-b478-61189b692340 req-dfda781a-db3a-4daf-b83a-9439ab4465c1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.3722951
Jun 03 08:33:16.008800 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 67b7325f-861c-41e6-b770-4814b84aebba up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:16.033818 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Notify callbacks [] for port, precommit_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:16.041867 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-16327803', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-16388116', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2358'] for router, precommit_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:16.065207 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-d113bf6e-09cf-48db-a11a-6ae0ede7c7ea tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:16.066756 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-d113bf6e-09cf-48db-a11a-6ae0ede7c7ea tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/networks?id=9fa75ad7-a669-4187-8c25-4bc1ee5a9f55 HTTP/1.1" status: 200  len: 808 time: 0.9120448
Jun 03 08:33:16.075612 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Transition to ACTIVE for port object d9c1690f-ea93-4b43-a1b8-643701ef85de will not be triggered until provisioned by entity L2. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:33:16.085592 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26bb3446-9929-4f32-9c34-5d69e5462bd1 req-fdba0670-24ca-41a4-b57c-79b668bdeb4d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:16.087115 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-26bb3446-9929-4f32-9c34-5d69e5462bd1 req-fdba0670-24ca-41a4-b57c-79b668bdeb4d service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 1099 time: 1.0320997
Jun 03 08:33:16.089959 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-93538e46-b2cf-4194-959a-e7206eb40aa8 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/quotas/96ee04709f4540ee8818120a88291b46 HTTP/1.1" status: 200  len: 375 time: 0.0149982
Jun 03 08:33:16.112429 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Transition to ACTIVE for port object d9c1690f-ea93-4b43-a1b8-643701ef85de will not be triggered until provisioned by entity DHCP. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:33:16.143130 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 67b7325f-861c-41e6-b770-4814b84aebba triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:16.143677 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:16.159519 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4c4af99a-1b9b-459a-b478-61189b692340 req-d3e84e54-2fb3-466f-9d2f-f175027b670b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1598594
Jun 03 08:33:16.160574 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66ef4dee-3290-401e-a0e4-3bb53f80684e req-c151c98a-2335-4f30-8e81-4ad9443bc86f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:16.162848 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-66ef4dee-3290-401e-a0e4-3bb53f80684e req-c151c98a-2335-4f30-8e81-4ad9443bc86f service neutron] 10.222.0.55 "GET /v2.0/networks?id=f9db9a2a-942b-4a98-97ed-1896cb9158b4 HTTP/1.1" status: 200  len: 916 time: 0.4465969
Jun 03 08:33:16.229506 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:16.242299 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-1940ec80-acfa-4178-9315-03cdaded4066 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=96ee04709f4540ee8818120a88291b46&fields=id HTTP/1.1" status: 200  len: 210 time: 0.1016505
Jun 03 08:33:16.263715 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-2fff76ba-cc6f-456e-8db3-57cd0a065be7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:16.286229 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-26bb3446-9929-4f32-9c34-5d69e5462bd1 req-d39d7b71-faa4-4fb6-95c6-e5fcd9d2229f service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1905999
Jun 03 08:33:16.322531 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:33:16.506928 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Network 15e18fdf-cd32-4b01-8841-c321ea578305 is already hosted by enough agents. {{(pid=92325) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:33:16.514839 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.scheduler.base_scheduler [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Resources bound (agent type, host, resource id):  {{(pid=92325) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:33:16.541375 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Pushing event updated for resources: {'Port': ['ID=d9c1690f-ea93-4b43-a1b8-643701ef85de,revision_number=1']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:16.552066 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-43721499-1b83-43c3-a2c6-2c5278e25ee5 service neutron] 10.222.0.11 "GET /v2.0/networks/9fa75ad7-a669-4187-8c25-4bc1ee5a9f55?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2996960
Jun 03 08:33:16.552714 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Received port after_create {{(pid=92325) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:33:16.554380 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.291s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:16.628659 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-66ef4dee-3290-401e-a0e4-3bb53f80684e req-e6bc3196-fe68-4186-b83e-5217d8959ed9 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=6a3181af-0127-4cce-b71a-90b9c83c8f88 HTTP/1.1" status: 200  len: 217 time: 0.4486332
Jun 03 08:33:16.710016 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66ef4dee-3290-401e-a0e4-3bb53f80684e req-e06568c8-93b5-48be-9f69-0f1d9d9cc794 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:16.711644 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-66ef4dee-3290-401e-a0e4-3bb53f80684e req-e06568c8-93b5-48be-9f69-0f1d9d9cc794 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=5f3b55e2-964f-4ce8-9d71-3ac11dc6ebf1 HTTP/1.1" status: 200  len: 855 time: 0.0785751
Jun 03 08:33:16.723424 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2230fb99-4cde-4f7a-8626-5848d6efe379 req-2a897752-d38f-4261-952f-87aa3139e500 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:16.725232 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2230fb99-4cde-4f7a-8626-5848d6efe379 req-2a897752-d38f-4261-952f-87aa3139e500 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.2218659
Jun 03 08:33:16.751609 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Attempting to bind port d9c1690f-ea93-4b43-a1b8-643701ef85de on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:33:16.752203 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Attempting to bind port d9c1690f-ea93-4b43-a1b8-643701ef85de by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '8acb7a59-d9f0-4604-be49-ed0601f465ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '15e18fdf-cd32-4b01-8841-c321ea578305'}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:33:16.752736 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Attempting to bind port d9c1690f-ea93-4b43-a1b8-643701ef85de on network 15e18fdf-cd32-4b01-8841-c321ea578305 {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:33:16.762086 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:16.788541 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-66ef4dee-3290-401e-a0e4-3bb53f80684e req-ec9583c7-8197-4a8a-98da-8a222e7ebe16 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=f9db9a2a-942b-4a98-97ed-1896cb9158b4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0588145
Jun 03 08:33:16.793602 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 33, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:33:16.794137 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Checking segment: {'id': '8acb7a59-d9f0-4604-be49-ed0601f465ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '15e18fdf-cd32-4b01-8841-c321ea578305'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:33:16.794637 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:16.795127 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Bound using segment: {'id': '8acb7a59-d9f0-4604-be49-ed0601f465ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '15e18fdf-cd32-4b01-8841-c321ea578305'} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:33:16.795705 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Bound port: d9c1690f-ea93-4b43-a1b8-643701ef85de, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8acb7a59-d9f0-4604-be49-ed0601f465ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '15e18fdf-cd32-4b01-8841-c321ea578305'}}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:33:16.796214 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:16.863159 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2230fb99-4cde-4f7a-8626-5848d6efe379 req-7c282784-1539-4258-9de4-289f51ab2c97 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1012981
Jun 03 08:33:16.899887 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-f3ab6794-4e8f-40fe-9880-1a16e8374b68 service neutron] 10.222.0.11 "GET /v2.0/networks/9fa75ad7-a669-4187-8c25-4bc1ee5a9f55?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2340548
Jun 03 08:33:16.979803 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-66ef4dee-3290-401e-a0e4-3bb53f80684e req-67ed2ec0-5760-4db7-8fe3-4249adf171d8 service neutron] 10.222.0.55 "GET /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1844313
Jun 03 08:33:16.987679 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] For port d9c1690f-ea93-4b43-a1b8-643701ef85de, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:33:16.999425 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] For port d9c1690f-ea93-4b43-a1b8-643701ef85de, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=d9c1690f-ea93-4b43-a1b8-643701ef85de,segment=NetworkSegment(8acb7a59-d9f0-4604-be49-ed0601f465ae),segment_id=8acb7a59-d9f0-4604-be49-ed0601f465ae)] {{(pid=92325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:33:17.006730 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:17.009572 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:17.048598 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:17.082181 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:17.193936 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9af9de4-e210-4dec-a726-895e2d94d6a4 req-2a4799fe-8f95-4d26-ae66-29724ada24d2 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:17.195497 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b9af9de4-e210-4dec-a726-895e2d94d6a4 req-2a4799fe-8f95-4d26-ae66-29724ada24d2 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 944 time: 0.1480300
Jun 03 08:33:17.491537 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b9af9de4-e210-4dec-a726-895e2d94d6a4 req-fff30b03-28cf-4763-8d29-6b082117b097 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2899182
Jun 03 08:33:17.511953 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-66ef4dee-3290-401e-a0e4-3bb53f80684e req-64dd2b23-c15a-4d39-9b43-6f189271ac58 service neutron] 10.222.0.55 "GET /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5218925
Jun 03 08:33:17.562214 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.db_base_plugin_common [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Allocated IP 172.27.0.29 (684ef871-89aa-450d-ae0d-e232bfaf51fb/e7b58fba-1ed5-483b-b341-7736b2ffb853/ddaa7077-d668-4d3b-a8ec-849e13f8a9cf) {{(pid=92324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:33:17.572232 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Router 02c1b0e4-a9b8-4fc7-af87-8069fb4caced is scheduled to L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 with binding_index 1 {{(pid=92323) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 03 08:33:17.602063 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:17.609403 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-20577996-cc94-44e8-8114-647485d5ac28 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:17.781610 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:17.791702 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1fe08a6f-9a0e-480a-afb4-7b2647690610 req-38896563-c025-42d3-a4c3-0f37248f064e tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 210 time: 0.1210628
Jun 03 08:33:17.883924 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Pushing event updated for resources: {'Port': ['ID=d9c1690f-ea93-4b43-a1b8-643701ef85de,revision_number=2']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:17.889397 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.280s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:17.902913 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:17.920739 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-97cdd9a4-9e8b-4b17-8092-704efadc5e91 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:18.063208 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:33:18.066409 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:33:18.079482 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Received port after_create {{(pid=92324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:33:18.141194 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Pushing event updated for resources: {'Port': ['ID=ddaa7077-d668-4d3b-a8ec-849e13f8a9cf,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:18.157505 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.237s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:18.348405 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 6a3181af-0127-4cce-b71a-90b9c83c8f88 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:33:18.351786 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:33:18.365949 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] Sync routers for ids ['02c1b0e4-a9b8-4fc7-af87-8069fb4caced'] in dv-cinder-787262-5-iscsi {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:33:18.386126 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] Routers {'02c1b0e4-a9b8-4fc7-af87-8069fb4caced'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:33:18.389887 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86f16040>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:33:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['02c1b0e4-a9b8-4fc7-af87-8069fb4caced'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:18.401606 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d9fe94a-9a97-4bdb-b0f1-d76b42bf9e50 req-658b6ccb-50ab-418c-a3bf-a170fa57c837 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:18.409354 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6d9fe94a-9a97-4bdb-b0f1-d76b42bf9e50 req-658b6ccb-50ab-418c-a3bf-a170fa57c837 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.2558224
Jun 03 08:33:18.540326 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Notify callbacks [] for router, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:18.545978 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201  len: 921 time: 12.1807673
Jun 03 08:33:18.559695 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6d9fe94a-9a97-4bdb-b0f1-d76b42bf9e50 req-84303506-fe45-42e4-b757-c38e14d8b031 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1490889
Jun 03 08:33:18.566595 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 50030) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:18.741060 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 6a3181af-0127-4cce-b71a-90b9c83c8f88, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=6a3181af-0127-4cce-b71a-90b9c83c8f88,segment=NetworkSegment(9923ac74-9556-45ec-9044-43728d2a8ec3),segment_id=9923ac74-9556-45ec-9044-43728d2a8ec3)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:33:18.772702 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': '6a3181af-0127-4cce-b71a-90b9c83c8f88', 'network_id': 'f9db9a2a-942b-4a98-97ed-1896cb9158b4', 'port_id': '6a3181af-0127-4cce-b71a-90b9c83c8f88', 'mac_address': 'fa:16:3e:f6:e1:2c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 511, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5f3b55e2-964f-4ce8-9d71-3ac11dc6ebf1', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:33:18.825862 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] Set router 02c1b0e4-a9b8-4fc7-af87-8069fb4caced gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:33:18.887111 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:18.936507 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6a3181af-0127-4cce-b71a-90b9c83c8f88 {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:33:18.965828 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 6a3181af-0127-4cce-b71a-90b9c83c8f88, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=6a3181af-0127-4cce-b71a-90b9c83c8f88,segment=NetworkSegment(9923ac74-9556-45ec-9044-43728d2a8ec3),segment_id=9923ac74-9556-45ec-9044-43728d2a8ec3)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:33:18.967123 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-eb9d3e80-a3c3-4374-b9d1-1fe8190706a0 req-aa5e4e63-0f32-494a-8f7c-157c4405e569 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 210 time: 0.2516420
Jun 03 08:33:19.053308 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:19.055178 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-b4d60c39-d175-4fbc-b051-229654c472f5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:19.202039 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6183a0f-44be-4969-bc04-32eb7296e6bb req-b24db25d-35c0-42ed-b4ce-0fe442937a61 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:19.204287 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a6183a0f-44be-4969-bc04-32eb7296e6bb req-b24db25d-35c0-42ed-b4ce-0fe442937a61 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.4588428
Jun 03 08:33:19.281541 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a6183a0f-44be-4969-bc04-32eb7296e6bb req-898e2844-b9e7-4aa4-aa27-a11cbf4c7ff5 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0639091
Jun 03 08:33:19.341981 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:19.392951 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=6a3181af-0127-4cce-b71a-90b9c83c8f88,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:19.397941 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['6a3181af-0127-4cce-b71a-90b9c83c8f88'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:33:19.558198 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.503s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:19.702293 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86f16040>, [{'id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'name': 'tempest-TestShelveInstance-1807805368-router', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155'}], 'enable_snat': True}, 'gw_port_id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:06Z', 'updated_at': '2021-06-03T08:33:12Z', 'revision_number': 3, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'gw_port': {'id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:4e:b2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:10Z', 'updated_at': '2021-06-03T08:33:11Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:19.720679 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] Checking router: 02c1b0e4-a9b8-4fc7-af87-8069fb4caced for host: dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:33:19.721269 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] Updating router 02c1b0e4-a9b8-4fc7-af87-8069fb4caced port bea952c0-6612-45c9-abe7-1c904d1c4f14 binding host dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 03 08:33:19.898280 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce048337-56b9-40a8-a873-e9ebc9bc295e None None] Network 15e18fdf-cd32-4b01-8841-c321ea578305 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:33:19.952846 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f0b3340-e77f-45a5-948a-dcac1f4c2b80 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:19.953553 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f0b3340-e77f-45a5-948a-dcac1f4c2b80 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Synchronizing usage tracker for tenant:9a96090cd93b48608ead040676d45129 on resource:network {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:33:19.974480 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:19.988950 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device d9c1690f-ea93-4b43-a1b8-643701ef85de up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:20.148398 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41514ccb-4359-446a-825f-1cd255e4b7b7 req-36fdef17-95f5-40c6-b48e-be2579883115 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:20.148398 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-41514ccb-4359-446a-825f-1cd255e4b7b7 req-36fdef17-95f5-40c6-b48e-be2579883115 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 945 time: 0.3649547
Jun 03 08:33:20.172623 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-16388099', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-16327774'] for router, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:20.295111 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-41514ccb-4359-446a-825f-1cd255e4b7b7 req-9d32bdf7-9855-42e7-81d7-bc509e9ac8a3 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1421957
Jun 03 08:33:20.440890 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-17da9b98-9a62-4669-b114-c556c91fc834 None None] Provisioning for port d9c1690f-ea93-4b43-a1b8-643701ef85de completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:33:20.493777 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port d9c1690f-ea93-4b43-a1b8-643701ef85de completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:33:20.510178 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port d9c1690f-ea93-4b43-a1b8-643701ef85de triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:20.510600 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:20.524839 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae45a5dd-f56b-4a03-a979-4bc97947debb req-e8391e5f-4fd4-4758-b805-0ee202990927 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:20.533964 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] Notify callbacks [] for port, precommit_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:20.540726 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ae45a5dd-f56b-4a03-a979-4bc97947debb req-e8391e5f-4fd4-4758-b805-0ee202990927 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 1.2761114
Jun 03 08:33:20.556336 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.provisioning_blocks [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] Transition to ACTIVE for port object bea952c0-6612-45c9-abe7-1c904d1c4f14 will not be triggered until provisioned by entity L2. {{(pid=92326) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:33:20.618950 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ae45a5dd-f56b-4a03-a979-4bc97947debb req-eca04659-68d9-41f4-913b-a79b55d4bbc7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0765288
Jun 03 08:33:20.619567 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f0b3340-e77f-45a5-948a-dcac1f4c2b80 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Unset dirty status for tenant:9a96090cd93b48608ead040676d45129 on resource:network {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:33:20.620556 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f0b3340-e77f-45a5-948a-dcac1f4c2b80 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.55 "GET /v2.0/networks?id=d6b7a34f-3fa8-4a38-ab72-8c6458a51990 HTTP/1.1" status: 200  len: 814 time: 1.8954031
Jun 03 08:33:20.629902 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-bf17805b-73d6-4086-b5aa-72927809a9c9 req-1bbeb328-d28d-4b21-b0c1-c339bcae9622 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 210 time: 0.0678611
Jun 03 08:33:20.715830 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Router ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3 is scheduled to L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 with binding_index 1 {{(pid=92324) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 03 08:33:20.735944 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-5c2e098e-b008-4001-8d79-e25198adb79b tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Request body: {'port': {'device_id': '7525b38b-62a4-4060-b8e8-f15c49408a7b', 'network_id': 'd6b7a34f-3fa8-4a38-ab72-8c6458a51990', 'admin_state_up': True, 'tenant_id': '9a96090cd93b48608ead040676d45129'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:20.806529 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:20.836531 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:20.862343 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:20.899162 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port d9c1690f-ea93-4b43-a1b8-643701ef85de, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=d9c1690f-ea93-4b43-a1b8-643701ef85de,segment=NetworkSegment(8acb7a59-d9f0-4604-be49-ed0601f465ae),segment_id=8acb7a59-d9f0-4604-be49-ed0601f465ae)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:33:20.908046 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-36e3468b-6090-4de4-b1c6-bfec27c06388 None None] Provisioning complete for port d9c1690f-ea93-4b43-a1b8-643701ef85de triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:20.908573 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-36e3468b-6090-4de4-b1c6-bfec27c06388 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:20.919915 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] Attempting to bind port bea952c0-6612-45c9-abe7-1c904d1c4f14 on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:33:20.921259 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] Attempting to bind port bea952c0-6612-45c9-abe7-1c904d1c4f14 by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}] {{(pid=92326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:33:20.921259 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] Attempting to bind port bea952c0-6612-45c9-abe7-1c904d1c4f14 on network 684ef871-89aa-450d-ae0d-e232bfaf51fb {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:33:20.929036 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 33, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:33:20.929470 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] Checking segment: {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92326) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:33:20.929808 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:20.930195 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] Bound using segment: {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'} {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:33:20.930840 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] Bound port: bea952c0-6612-45c9-abe7-1c904d1c4f14, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}}] {{(pid=92326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:33:20.931240 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:21.063807 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-36e3468b-6090-4de4-b1c6-bfec27c06388 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:21.069117 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cf33545-edfe-408b-bf50-0479c3bce3dc None None] Pushing event updated for resources: {'Port': ['ID=bea952c0-6612-45c9-abe7-1c904d1c4f14,revision_number=2']} {{(pid=92326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:21.081207 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.db [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] For port bea952c0-6612-45c9-abe7-1c904d1c4f14, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92326) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:33:21.085427 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf33545-edfe-408b-bf50-0479c3bce3dc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:21.085765 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf33545-edfe-408b-bf50-0479c3bce3dc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:21.086788 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf33545-edfe-408b-bf50-0479c3bce3dc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:21.087123 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf33545-edfe-408b-bf50-0479c3bce3dc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:21.087451 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf33545-edfe-408b-bf50-0479c3bce3dc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:21.087777 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf33545-edfe-408b-bf50-0479c3bce3dc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:21.088107 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf33545-edfe-408b-bf50-0479c3bce3dc None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:21.088411 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf33545-edfe-408b-bf50-0479c3bce3dc None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:21.088750 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf33545-edfe-408b-bf50-0479c3bce3dc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:21.089067 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf33545-edfe-408b-bf50-0479c3bce3dc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:21.089376 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf33545-edfe-408b-bf50-0479c3bce3dc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:21.089685 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cf33545-edfe-408b-bf50-0479c3bce3dc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:21.100748 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.db [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] For port bea952c0-6612-45c9-abe7-1c904d1c4f14, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=bea952c0-6612-45c9-abe7-1c904d1c4f14,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92326) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:33:21.107945 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-7cf33545-edfe-408b-bf50-0479c3bce3dc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.245s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:21.120581 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:21.123512 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:21.164641 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-5c2e098e-b008-4001-8d79-e25198adb79b tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:21.170968 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-5c2e098e-b008-4001-8d79-e25198adb79b tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Usage tracker for resource:port and tenant:9a96090cd93b48608ead040676d45129 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:21.176667 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-5c2e098e-b008-4001-8d79-e25198adb79b tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:21.195151 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03296092-d899-456f-9774-a9bd1702f05d req-4b46ed6c-e2dd-4730-9d74-d63488a5ae6c tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:21.196810 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-03296092-d899-456f-9774-a9bd1702f05d req-4b46ed6c-e2dd-4730-9d74-d63488a5ae6c tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.2755632
Jun 03 08:33:21.199482 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-5c2e098e-b008-4001-8d79-e25198adb79b tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:21.206050 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:33:21.206344 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:21.222412 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:21.223998 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] Sync routers for ids ['ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:33:21.224539 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47e106b3-ed84-4047-94fc-a4c23740e7eb req-57664f19-92da-424c-88c9-37b6f485759d tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:21.226442 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-47e106b3-ed84-4047-94fc-a4c23740e7eb req-57664f19-92da-424c-88c9-37b6f485759d tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.3533585
Jun 03 08:33:21.238237 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:21.251657 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] Routers {'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:33:21.252604 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86ee01c0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:33:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:21.289080 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-47e106b3-ed84-4047-94fc-a4c23740e7eb req-ba3fce20-5280-4945-85f7-f256b2b68e9e tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0565166
Jun 03 08:33:21.308235 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.db.api [None req-36e3468b-6090-4de4-b1c6-bfec27c06388 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=92325) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}}
Jun 03 08:33:21.308999 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_db.api [None req-36e3468b-6090-4de4-b1c6-bfec27c06388 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}}
Jun 03 08:33:21.343197 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=d9c1690f-ea93-4b43-a1b8-643701ef85de,revision_number=3']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:21.348214 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.225s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:21.360962 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-5c2e098e-b008-4001-8d79-e25198adb79b tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Made reservation on behalf of 9a96090cd93b48608ead040676d45129 for: {'port': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:33:21.375010 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-5c2e098e-b008-4001-8d79-e25198adb79b tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:21.395176 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] Notify callbacks [] for router, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:21.397478 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cf33545-edfe-408b-bf50-0479c3bce3dc None None] Pushing event updated for resources: {'Port': ['ID=bea952c0-6612-45c9-abe7-1c904d1c4f14,revision_number=3']} {{(pid=92326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:21.402044 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-1f7995c5-c62a-4f24-b176-cc5258d7f251 admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201  len: 924 time: 6.7945580
Jun 03 08:33:21.403081 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 50062) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:21.409550 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-7cf33545-edfe-408b-bf50-0479c3bce3dc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:21.418643 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-03296092-d899-456f-9774-a9bd1702f05d req-f8b16ff5-c5c6-425e-8a9d-d58239cc0b23 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1949215
Jun 03 08:33:21.422289 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] Routers {'02c1b0e4-a9b8-4fc7-af87-8069fb4caced'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:33:21.422968 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86f16040>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:33:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['02c1b0e4-a9b8-4fc7-af87-8069fb4caced'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:21.532879 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] Set router ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:33:21.681964 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] Set router 02c1b0e4-a9b8-4fc7-af87-8069fb4caced gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:33:21.856911 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Allocated IP 172.20.0.1 (4a053960-3cf4-4216-b7a5-291ef61e89b7/fc181126-7c66-44d3-b731-a59036bd562f/ce979b40-484e-45cd-a6cb-a3940bb7a659) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:33:21.869701 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-5c2e098e-b008-4001-8d79-e25198adb79b tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Allocated IP 172.20.0.2 (d6b7a34f-3fa8-4a38-ab72-8c6458a51990/511f126c-ca8b-42fb-80d6-5f4b9a80cf7e/ab26d5bb-6495-4c9b-b134-6612a997f201) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:33:21.986993 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88bb4582-fcc2-472c-8748-0bc9574fad4b req-1e526acc-6672-44b4-8c0d-52b425280dc9 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:21.988583 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-88bb4582-fcc2-472c-8748-0bc9574fad4b req-1e526acc-6672-44b4-8c0d-52b425280dc9 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 945 time: 0.3675189
Jun 03 08:33:21.992157 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device d9c1690f-ea93-4b43-a1b8-643701ef85de up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:22.153777 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86f16040>, [{'id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'name': 'tempest-TestShelveInstance-1807805368-router', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155'}], 'enable_snat': True}, 'gw_port_id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:06Z', 'updated_at': '2021-06-03T08:33:12Z', 'revision_number': 3, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'gw_port': {'id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:4e:b2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:10Z', 'updated_at': '2021-06-03T08:33:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:22.165695 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67e1f6d2-157c-4d9b-a883-344225847a1a None None] The sync data for ids ['02c1b0e4-a9b8-4fc7-af87-8069fb4caced'] in dv-cinder-787262-5-iscsi is: [{'id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'name': 'tempest-TestShelveInstance-1807805368-router', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155'}], 'enable_snat': True}, 'gw_port_id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:06Z', 'updated_at': '2021-06-03T08:33:12Z', 'revision_number': 3, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'gw_port': {'id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:4e:b2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:10Z', 'updated_at': '2021-06-03T08:33:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}] {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:33:22.171090 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port d9c1690f-ea93-4b43-a1b8-643701ef85de triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:22.171531 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:22.219851 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-55554df4-b15d-4c6c-b814-2a42b3cb3dbc req-495b1da4-833f-48a8-b264-88bee4d86927 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 210 time: 0.3474572
Jun 03 08:33:22.271513 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86ee01c0>, [{'id': 'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3', 'name': 'tempest-TestMinimumBasicScenario-86704573-router', 'tenant_id': '7de719cd894b4eff8d1ebe284e30569b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'ddaa7077-d668-4d3b-a8ec-849e13f8a9cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:14Z', 'updated_at': '2021-06-03T08:33:18Z', 'revision_number': 3, 'project_id': '7de719cd894b4eff8d1ebe284e30569b', 'gw_port': {'id': 'ddaa7077-d668-4d3b-a8ec-849e13f8a9cf', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ac:a7:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:17Z', 'updated_at': '2021-06-03T08:33:17Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:22.291194 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] Checking router: ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3 for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:33:22.291562 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] Updating router ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3 port ddaa7077-d668-4d3b-a8ec-849e13f8a9cf binding host dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 03 08:33:22.392831 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-88bb4582-fcc2-472c-8748-0bc9574fad4b req-31a80c83-6ce8-4398-85d6-7378c591c9dd tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2937114
Jun 03 08:33:22.398215 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:22.466179 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 6a3181af-0127-4cce-b71a-90b9c83c8f88 up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:22.480506 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f42c112-71f5-42f2-89d1-35617d22a9cb req-6025f7e6-5d91-4a24-a471-b19081c6c95c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:22.482020 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6f42c112-71f5-42f2-89d1-35617d22a9cb req-6025f7e6-5d91-4a24-a471-b19081c6c95c service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=36c42f532cd14f19811ffbee3a39a208&device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 1098 time: 0.6458712
Jun 03 08:33:22.582746 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:22.734623 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3eb46454-79a2-4785-994c-599888940524 req-b0174f57-d1f4-4f54-baf0-d3894f85d028 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 210 time: 0.1289685
Jun 03 08:33:22.873216 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-a6a1adbd-6f77-434c-8083-4520c43f82f5 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:22.874662 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-a6a1adbd-6f77-434c-8083-4520c43f82f5 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.55 "GET /v2.0/networks?id=9fa75ad7-a669-4187-8c25-4bc1ee5a9f55 HTTP/1.1" status: 200  len: 808 time: 0.9953847
Jun 03 08:33:22.884541 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Transition to ACTIVE for port object ce979b40-484e-45cd-a6cb-a3940bb7a659 will not be triggered until provisioned by entity DHCP. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:33:22.898918 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-d149a831-620d-4758-8637-4b05609da202 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Request body: {'port': {'device_id': '94bade6e-3955-4228-b5ef-3ef8fb278f08', 'network_id': '9fa75ad7-a669-4187-8c25-4bc1ee5a9f55', 'admin_state_up': True, 'tenant_id': '96ee04709f4540ee8818120a88291b46'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:22.900725 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning for port 6a3181af-0127-4cce-b71a-90b9c83c8f88 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:33:22.917474 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f42c112-71f5-42f2-89d1-35617d22a9cb req-677f5af6-b69a-41c8-b003-9f6d770a5447 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:22.923029 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6f42c112-71f5-42f2-89d1-35617d22a9cb req-677f5af6-b69a-41c8-b003-9f6d770a5447 service neutron] 10.222.0.55 "GET /v2.0/networks?id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba HTTP/1.1" status: 200  len: 918 time: 0.4272761
Jun 03 08:33:22.937897 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port 6a3181af-0127-4cce-b71a-90b9c83c8f88 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:22.938288 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:23.228422 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.55', 50117) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:23.268650 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6f42c112-71f5-42f2-89d1-35617d22a9cb req-4173f29f-8c32-411a-bf03-f8224117dba6 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 HTTP/1.1" status: 200  len: 1001 time: 0.3267405
Jun 03 08:33:23.352549 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-5c2e098e-b008-4001-8d79-e25198adb79b tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:23.374787 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:23.383696 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f42c112-71f5-42f2-89d1-35617d22a9cb req-43f8d187-6120-4bea-9f76-33cd152a65d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:23.384988 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6f42c112-71f5-42f2-89d1-35617d22a9cb req-43f8d187-6120-4bea-9f76-33cd152a65d2 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=cff67a13-bc33-4d3e-a796-5829103ca25c HTTP/1.1" status: 200  len: 856 time: 0.1018436
Jun 03 08:33:23.414071 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8ddd6245-fce5-47f9-a7a6-680ac133188d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6a3181af-0127-4cce-b71a-90b9c83c8f88'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:33:23.417935 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-de6fb658-7683-48e7-a69c-740cc2529173" -d '{"events": [{"server_uuid": "8ddd6245-fce5-47f9-a7a6-680ac133188d", "name": "network-vif-plugged", "status": "completed", "tag": "6a3181af-0127-4cce-b71a-90b9c83c8f88"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:33:23.424564 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ed502da-10fc-4d41-9eff-7c2bf197372e req-461544d6-a323-41b6-a757-c43b50e12f8a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:23.430270 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1ed502da-10fc-4d41-9eff-7c2bf197372e req-461544d6-a323-41b6-a757-c43b50e12f8a service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=755371c3d9de4747a47ba62e4d101829&device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 1098 time: 0.1878426
Jun 03 08:33:23.441193 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 6a3181af-0127-4cce-b71a-90b9c83c8f88, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=6a3181af-0127-4cce-b71a-90b9c83c8f88,segment=NetworkSegment(9923ac74-9556-45ec-9044-43728d2a8ec3),segment_id=9923ac74-9556-45ec-9044-43728d2a8ec3)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:33:23.472229 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f81fb2b4-7bf1-4d52-86d9-78aa0bbc8cc3 req-93058804-e056-42d9-9cf4-2e73095ee566 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:23.474215 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f81fb2b4-7bf1-4d52-86d9-78aa0bbc8cc3 req-93058804-e056-42d9-9cf4-2e73095ee566 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.5160413
Jun 03 08:33:23.507709 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-d149a831-620d-4758-8637-4b05609da202 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:23.524077 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] Notify callbacks [] for port, precommit_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:23.526839 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:23.535889 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:23.545206 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-d149a831-620d-4758-8637-4b05609da202 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:23.548063 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:23.557962 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:23.586905 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] Transition to ACTIVE for port object ddaa7077-d668-4d3b-a8ec-849e13f8a9cf will not be triggered until provisioned by entity L2. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:33:23.626278 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=6a3181af-0127-4cce-b71a-90b9c83c8f88,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:23.630041 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:23.684622 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea4c8ac1-2f9d-4d8e-8d24-0bebad132dee req-b793d27d-5725-44bf-8c56-60d6760d646d tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:23.686104 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ea4c8ac1-2f9d-4d8e-8d24-0bebad132dee req-b793d27d-5725-44bf-8c56-60d6760d646d tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.5849092
Jun 03 08:33:23.713194 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f81fb2b4-7bf1-4d52-86d9-78aa0bbc8cc3 req-5e2ae776-ce3d-4314-8c27-c10fc0bf2c21 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2246387
Jun 03 08:33:23.716982 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Network 4a053960-3cf4-4216-b7a5-291ef61e89b7 is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:33:23.721303 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:23.727742 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:23.792668 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Pushing event updated for resources: {'Port': ['ID=ce979b40-484e-45cd-a6cb-a3940bb7a659,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:23.796607 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.238s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:23.801571 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f42c112-71f5-42f2-89d1-35617d22a9cb req-f398f1c1-7c58-42a0-bc99-770b9e349112 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:23.803911 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6f42c112-71f5-42f2-89d1-35617d22a9cb req-f398f1c1-7c58-42a0-bc99-770b9e349112 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.4010844
Jun 03 08:33:23.807577 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] Attempting to bind port ddaa7077-d668-4d3b-a8ec-849e13f8a9cf on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:33:23.807956 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] Attempting to bind port ddaa7077-d668-4d3b-a8ec-849e13f8a9cf by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:33:23.808585 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] Attempting to bind port ddaa7077-d668-4d3b-a8ec-849e13f8a9cf on network 684ef871-89aa-450d-ae0d-e232bfaf51fb {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:33:23.816331 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ea4c8ac1-2f9d-4d8e-8d24-0bebad132dee req-5f478b37-32a3-40b0-87ad-e6edf6d6c59e tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1214731
Jun 03 08:33:23.818434 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52728fea-a257-4d4c-beb6-a303e864a57b None None] Pushing event updated for resources: {'Port': ['ID=ddaa7077-d668-4d3b-a8ec-849e13f8a9cf,revision_number=2']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:23.821243 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 33, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:33:23.821622 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] Checking segment: {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:33:23.822029 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:23.822419 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] Bound using segment: {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:33:23.822930 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] Bound port: ddaa7077-d668-4d3b-a8ec-849e13f8a9cf, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:33:23.823320 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:23.847967 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:33:23.848527 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:33:23.848988 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-16328800'] for router_interface, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:23.866175 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-52728fea-a257-4d4c-beb6-a303e864a57b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:23.874382 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:23.940471 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ed502da-10fc-4d41-9eff-7c2bf197372e req-1f147377-cea3-4bed-911f-ce3eb5710496 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:23.942133 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1ed502da-10fc-4d41-9eff-7c2bf197372e req-1f147377-cea3-4bed-911f-ce3eb5710496 service neutron] 10.222.0.55 "GET /v2.0/networks?id=020eaa43-2d59-46e1-8aec-0a688069f72b HTTP/1.1" status: 200  len: 912 time: 0.5016589
Jun 03 08:33:23.982698 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] For port ddaa7077-d668-4d3b-a8ec-849e13f8a9cf, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:33:23.986594 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] For port ddaa7077-d668-4d3b-a8ec-849e13f8a9cf, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=ddaa7077-d668-4d3b-a8ec-849e13f8a9cf,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:33:24.008553 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device bea952c0-6612-45c9-abe7-1c904d1c4f14 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:24.020001 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b6fd5929-fed0-40e1-a2d2-7ad688582b40 req-d1dfd4a1-0ac6-486f-ab24-bfc9df876681 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 210 time: 0.0684526
Jun 03 08:33:24.107342 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:33:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0942b611-f442-4802-86ef-6433c0c0553f x-openstack-request-id: req-0942b611-f442-4802-86ef-6433c0c0553f {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:33:24.107828 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8ddd6245-fce5-47f9-a7a6-680ac133188d", "name": "network-vif-plugged", "status": "completed", "tag": "6a3181af-0127-4cce-b71a-90b9c83c8f88", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:33:24.109098 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-0942b611-f442-4802-86ef-6433c0c0553f {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:33:24.109606 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8ddd6245-fce5-47f9-a7a6-680ac133188d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6a3181af-0127-4cce-b71a-90b9c83c8f88', 'code': 200}
Jun 03 08:33:24.190995 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-5c2e098e-b008-4001-8d79-e25198adb79b tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:24.192656 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-d149a831-620d-4758-8637-4b05609da202 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Made reservation on behalf of 96ee04709f4540ee8818120a88291b46 for: {'port': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:33:24.196722 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-d149a831-620d-4758-8637-4b05609da202 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:24.207886 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:24.231989 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:24.242664 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f5e8e1ee-423f-4610-9fe0-3f6ba3760d38 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:24.299715 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6f42c112-71f5-42f2-89d1-35617d22a9cb req-8b3ad624-f8ad-4236-b85b-dba0529b065b service neutron] 10.222.0.55 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4738748
Jun 03 08:33:24.331651 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port bea952c0-6612-45c9-abe7-1c904d1c4f14 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:33:24.341407 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-e063cfeb-e4bf-4f02-933f-e37e57cfde6b None None] Provisioning for port ce979b40-484e-45cd-a6cb-a3940bb7a659 completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:33:24.372443 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-e063cfeb-e4bf-4f02-933f-e37e57cfde6b None None] Provisioning complete for port ce979b40-484e-45cd-a6cb-a3940bb7a659 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:24.372900 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-e063cfeb-e4bf-4f02-933f-e37e57cfde6b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:24.398116 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port bea952c0-6612-45c9-abe7-1c904d1c4f14 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:24.398780 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:24.404845 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1ed502da-10fc-4d41-9eff-7c2bf197372e req-9fe1760f-912c-4562-8475-3cdc3875d069 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=19f733be-bd85-43df-86fd-5a9c617b3df4 HTTP/1.1" status: 200  len: 1001 time: 0.3811908
Jun 03 08:33:24.441685 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] Routers {'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:33:24.442341 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86ee01c0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:33:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:24.445895 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-5c2e098e-b008-4001-8d79-e25198adb79b tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Network d6b7a34f-3fa8-4a38-ab72-8c6458a51990 is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:33:24.485302 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-5c2e098e-b008-4001-8d79-e25198adb79b tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:33:24.499535 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef269a6d-cf25-4be1-acd3-7585cdcc1075 req-c65545c3-2825-4bc8-8055-d336b3c4ca72 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:24.507218 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ef269a6d-cf25-4be1-acd3-7585cdcc1075 req-c65545c3-2825-4bc8-8055-d336b3c4ca72 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 946 time: 0.4421453
Jun 03 08:33:24.548057 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-5c2e098e-b008-4001-8d79-e25198adb79b tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:33:24.556132 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.55', 50120) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:24.556242 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-5c2e098e-b008-4001-8d79-e25198adb79b tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:24.556242 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-5c2e098e-b008-4001-8d79-e25198adb79b tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:24.565467 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52728fea-a257-4d4c-beb6-a303e864a57b None None] Pushing event updated for resources: {'Port': ['ID=ddaa7077-d668-4d3b-a8ec-849e13f8a9cf,revision_number=3']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:24.574799 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-52728fea-a257-4d4c-beb6-a303e864a57b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.345s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:24.584547 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-e063cfeb-e4bf-4f02-933f-e37e57cfde6b None None] Port ce979b40-484e-45cd-a6cb-a3940bb7a659 cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:33:24.602356 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:24.652916 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c2e098e-b008-4001-8d79-e25198adb79b tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Pushing event updated for resources: {'Port': ['ID=ab26d5bb-6495-4c9b-b134-6612a997f201,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:24.672620 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-5c2e098e-b008-4001-8d79-e25198adb79b tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.430s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:24.688022 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ed502da-10fc-4d41-9eff-7c2bf197372e req-9818b35f-31e2-4015-942b-75507c8b7284 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:24.689493 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1ed502da-10fc-4d41-9eff-7c2bf197372e req-9818b35f-31e2-4015-942b-75507c8b7284 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=5baf74c9-e686-40a5-b52f-f01da3bd1af9 HTTP/1.1" status: 200  len: 850 time: 0.2624891
Jun 03 08:33:24.738286 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.db_base_plugin_common [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Allocated IP 172.20.0.1 (15e18fdf-cd32-4b01-8841-c321ea578305/12ddd2af-f3e3-46c1-98f9-a99828fc2abc/d52ae51a-5b28-450c-a58c-aff5122faf14) {{(pid=92324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:33:24.744300 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] Set router ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:33:24.757770 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ef269a6d-cf25-4be1-acd3-7585cdcc1075 req-54d8cfa2-dd39-4117-9b3b-8b197f3c8023 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2029624
Jun 03 08:33:24.778325 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6f42c112-71f5-42f2-89d1-35617d22a9cb req-9b6004a2-1ce9-4fdb-a43c-bd6270508ac4 service neutron] 10.222.0.55 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4380198
Jun 03 08:33:24.789880 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f457186a-be5f-4d4d-99d4-981b6a39da06 req-8353682d-c0e1-4208-986b-2cc329194acc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:24.791662 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f457186a-be5f-4d4d-99d4-981b6a39da06 req-8353682d-c0e1-4208-986b-2cc329194acc service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 1099 time: 0.2357793
Jun 03 08:33:24.844675 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-5c2e098e-b008-4001-8d79-e25198adb79b tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.55 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 4.1306033
Jun 03 08:33:24.870610 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Request body: {'port': {'device_id': '7525b38b-62a4-4060-b8e8-f15c49408a7b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:24.876511 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:24.924993 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port bea952c0-6612-45c9-abe7-1c904d1c4f14, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=bea952c0-6612-45c9-abe7-1c904d1c4f14,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:33:24.951258 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f457186a-be5f-4d4d-99d4-981b6a39da06 req-e3246687-18c5-459d-ba97-40ae22962a71 service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1378329
Jun 03 08:33:25.009101 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:25.021431 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:25.021705 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:25.039617 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.provisioning_blocks [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Transition to ACTIVE for port object d52ae51a-5b28-450c-a58c-aff5122faf14 will not be triggered until provisioned by entity DHCP. {{(pid=92324) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:33:25.080125 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cdc4418-b575-40b9-8ac5-23e901f7e9c9 req-6503af2c-4989-4633-a741-8589caf15024 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:25.080849 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-1cdc4418-b575-40b9-8ac5-23e901f7e9c9 req-6503af2c-4989-4633-a741-8589caf15024 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Synchronizing usage tracker for tenant:9a96090cd93b48608ead040676d45129 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:33:25.135382 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=bea952c0-6612-45c9-abe7-1c904d1c4f14,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:25.138897 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:25.140061 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-d149a831-620d-4758-8637-4b05609da202 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Allocated IP 172.20.0.4 (9fa75ad7-a669-4187-8c25-4bc1ee5a9f55/4463a771-9390-43b9-805a-b4b8e5004e4c/f0f9ba57-524d-497e-8230-57c2fa447a6a) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:33:25.157583 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86ee01c0>, [{'id': 'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3', 'name': 'tempest-TestMinimumBasicScenario-86704573-router', 'tenant_id': '7de719cd894b4eff8d1ebe284e30569b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'ddaa7077-d668-4d3b-a8ec-849e13f8a9cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:14Z', 'updated_at': '2021-06-03T08:33:18Z', 'revision_number': 3, 'project_id': '7de719cd894b4eff8d1ebe284e30569b', 'gw_port': {'id': 'ddaa7077-d668-4d3b-a8ec-849e13f8a9cf', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ac:a7:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:17Z', 'updated_at': '2021-06-03T08:33:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:25.162377 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80487b55-9d78-4459-a6af-beaed25e3a16 None None] The sync data for ids ['ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3'] in dv-cinder-787262-5-iscsi is: [{'id': 'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3', 'name': 'tempest-TestMinimumBasicScenario-86704573-router', 'tenant_id': '7de719cd894b4eff8d1ebe284e30569b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'ddaa7077-d668-4d3b-a8ec-849e13f8a9cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:14Z', 'updated_at': '2021-06-03T08:33:18Z', 'revision_number': 3, 'project_id': '7de719cd894b4eff8d1ebe284e30569b', 'gw_port': {'id': 'ddaa7077-d668-4d3b-a8ec-849e13f8a9cf', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ac:a7:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:17Z', 'updated_at': '2021-06-03T08:33:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:33:25.163085 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:25.168457 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-2818e52a-bb97-400b-826a-089a25ccf229 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:25.245682 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Network 15e18fdf-cd32-4b01-8841-c321ea578305 is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:33:25.248775 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:33:25.254311 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Received port after_create {{(pid=92324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:33:25.311558 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Pushing event updated for resources: {'Port': ['ID=d52ae51a-5b28-450c-a58c-aff5122faf14,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:25.331597 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:25.344498 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-16328800'] for router_interface, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:25.391369 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ed502da-10fc-4d41-9eff-7c2bf197372e req-718f705a-24ff-4070-b622-94f69cd37831 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:25.391914 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1ed502da-10fc-4d41-9eff-7c2bf197372e req-718f705a-24ff-4070-b622-94f69cd37831 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=020eaa43-2d59-46e1-8aec-0a688069f72b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.6753371
Jun 03 08:33:25.392501 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:25.539303 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-1cdc4418-b575-40b9-8ac5-23e901f7e9c9 req-6503af2c-4989-4633-a741-8589caf15024 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Unset dirty status for tenant:9a96090cd93b48608ead040676d45129 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:33:25.541942 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1cdc4418-b575-40b9-8ac5-23e901f7e9c9 req-6503af2c-4989-4633-a741-8589caf15024 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 931 time: 1.2575922
Jun 03 08:33:25.669642 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-c6500561-0442-4b7d-ba02-a1b4a8fe6e71 None None] Provisioning for port d52ae51a-5b28-450c-a58c-aff5122faf14 completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:33:25.674643 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-c6500561-0442-4b7d-ba02-a1b4a8fe6e71 None None] Provisioning complete for port d52ae51a-5b28-450c-a58c-aff5122faf14 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:25.675249 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-c6500561-0442-4b7d-ba02-a1b4a8fe6e71 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:25.678949 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:25.781272 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-c6500561-0442-4b7d-ba02-a1b4a8fe6e71 None None] Port d52ae51a-5b28-450c-a58c-aff5122faf14 cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:33:25.810385 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0f6eb08-e54b-477b-8feb-0674dd680043 req-699807c4-7386-45ee-b26a-42341a475b64 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:25.825273 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a0f6eb08-e54b-477b-8feb-0674dd680043 req-699807c4-7386-45ee-b26a-42341a475b64 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 945 time: 0.3476570
Jun 03 08:33:25.825584 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1ed502da-10fc-4d41-9eff-7c2bf197372e req-c6f2400d-1f2d-492d-b6ab-96d590476279 service neutron] 10.222.0.55 "GET /v2.0/networks/020eaa43-2d59-46e1-8aec-0a688069f72b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4032872
Jun 03 08:33:25.841511 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-1cdc4418-b575-40b9-8ac5-23e901f7e9c9 req-53a7c716-d9d4-46bf-ab48-4afa23166ab7 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Synchronizing usage tracker for tenant:9a96090cd93b48608ead040676d45129 on resource:security_group {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:33:25.878160 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddd4a287-7577-447b-90d5-d48900720045 req-1aa7fd4d-2eec-4089-9c51-afabffbafe0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:25.879967 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ddd4a287-7577-447b-90d5-d48900720045 req-1aa7fd4d-2eec-4089-9c51-afabffbafe0b service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=b9cf7834ca79439981d1f8e77b89daed&device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 1099 time: 0.3590472
Jun 03 08:33:25.913460 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:25.932486 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a0f6eb08-e54b-477b-8feb-0674dd680043 req-80bffbcd-f9fd-48a9-8ee0-5387289081c9 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1125555
Jun 03 08:33:26.029458 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:26.054164 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device ddaa7077-d668-4d3b-a8ec-849e13f8a9cf up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:26.169350 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:26.171233 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-16344774', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-16328707'] for router_interface, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:26.202264 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-81b6f518-b42b-413b-b737-90bb3082013c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:26.267666 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-d149a831-620d-4758-8637-4b05609da202 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:26.269277 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port ddaa7077-d668-4d3b-a8ec-849e13f8a9cf completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:33:26.275206 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port ddaa7077-d668-4d3b-a8ec-849e13f8a9cf triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:26.275585 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:26.355512 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-1cdc4418-b575-40b9-8ac5-23e901f7e9c9 req-53a7c716-d9d4-46bf-ab48-4afa23166ab7 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Unset dirty status for tenant:9a96090cd93b48608ead040676d45129 on resource:security_group {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:33:26.356782 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1cdc4418-b575-40b9-8ac5-23e901f7e9c9 req-53a7c716-d9d4-46bf-ab48-4afa23166ab7 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.7783833
Jun 03 08:33:26.375719 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddd4a287-7577-447b-90d5-d48900720045 req-b68d7c17-0f2b-43b1-b516-4b54eea0d13f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:26.377186 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ddd4a287-7577-447b-90d5-d48900720045 req-b68d7c17-0f2b-43b1-b516-4b54eea0d13f service neutron] 10.222.0.55 "GET /v2.0/networks?id=6861b4db-6cd2-4a5b-bf02-87826345c933 HTTP/1.1" status: 200  len: 920 time: 0.4881639
Jun 03 08:33:26.414511 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:33:26.423376 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1ed502da-10fc-4d41-9eff-7c2bf197372e req-50fff9e0-bfdf-47b3-8f8e-d9678e6727d6 service neutron] 10.222.0.55 "GET /v2.0/networks/020eaa43-2d59-46e1-8aec-0a688069f72b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5684836
Jun 03 08:33:26.481312 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ddd4a287-7577-447b-90d5-d48900720045 req-59803b24-4cfc-4d03-8c44-afadcc61f233 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=716f2131-2965-4ead-984f-8ccfcadea071 HTTP/1.1" status: 200  len: 217 time: 0.0956991
Jun 03 08:33:26.501602 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Pushing event updated for resources: {'Port': ['ID=ce979b40-484e-45cd-a6cb-a3940bb7a659,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:26.514448 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:26.542373 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port ddaa7077-d668-4d3b-a8ec-849e13f8a9cf, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=ddaa7077-d668-4d3b-a8ec-849e13f8a9cf,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:33:26.563353 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.361s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:26.592973 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddd4a287-7577-447b-90d5-d48900720045 req-a31513dc-1649-4d17-acbb-2a4888f772ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:26.594426 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ddd4a287-7577-447b-90d5-d48900720045 req-a31513dc-1649-4d17-acbb-2a4888f772ef service neutron] 10.222.0.55 "GET /v2.0/subnets?id=0ea4966f-f9de-4d69-a774-7746b1ee12ee HTTP/1.1" status: 200  len: 859 time: 0.1056466
Jun 03 08:33:26.604505 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f6944a1-6623-44d3-895a-46cd7c6dc744 req-1b965972-18ce-451b-bc31-4b208525e82c tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:26.606105 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-5f6944a1-6623-44d3-895a-46cd7c6dc744 req-1b965972-18ce-451b-bc31-4b208525e82c tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.4668820
Jun 03 08:33:26.618153 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:26.642285 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:26.643154 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device bea952c0-6612-45c9-abe7-1c904d1c4f14 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:26.652590 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-2b00fc8f-8624-4b2e-b683-11c6e3535fce req-d6d2c9ba-26e9-48c8-91ac-d083224bb8e7 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Synchronizing usage tracker for tenant:96ee04709f4540ee8818120a88291b46 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:33:26.676650 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ddd4a287-7577-447b-90d5-d48900720045 req-ced42413-50ce-4d88-b444-3fd7f630c4a3 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=6861b4db-6cd2-4a5b-bf02-87826345c933&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0693798
Jun 03 08:33:26.679049 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:26.679709 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:26.761543 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-d149a831-620d-4758-8637-4b05609da202 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:26.768270 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-413dcec8-3a42-4829-b65d-77589c788a7b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:26.800284 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0c731ecb-c3fc-401e-af74-34336582cf7d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:33:26.803506 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1b502f0d-d17a-47c5-b0ea-7b83330af336" -d '{"events": [{"server_uuid": "0c731ecb-c3fc-401e-af74-34336582cf7d", "name": "network-vif-unplugged", "status": "completed", "tag": "7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:33:26.838104 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:33:26.850215 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15641369'] for port, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:26.860740 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=ddaa7077-d668-4d3b-a8ec-849e13f8a9cf,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:26.864490 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.185s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:26.871866 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port bea952c0-6612-45c9-abe7-1c904d1c4f14 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:26.872251 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:26.913427 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-2b00fc8f-8624-4b2e-b683-11c6e3535fce req-d6d2c9ba-26e9-48c8-91ac-d083224bb8e7 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Unset dirty status for tenant:96ee04709f4540ee8818120a88291b46 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:33:26.915616 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2b00fc8f-8624-4b2e-b683-11c6e3535fce req-d6d2c9ba-26e9-48c8-91ac-d083224bb8e7 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 210 time: 0.3338947
Jun 03 08:33:26.937632 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-22e2c99b-98c3-4a7b-a57e-43aa6ae37583 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:26.975981 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-d149a831-620d-4758-8637-4b05609da202 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Network 9fa75ad7-a669-4187-8c25-4bc1ee5a9f55 is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:33:26.977890 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:26.980540 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-52728fea-a257-4d4c-beb6-a303e864a57b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:27.048204 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ab26d5bb-6495-4c9b-b134-6612a997f201 {{(pid=92323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:33:27.058664 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:27.079561 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Transition to ACTIVE for port object ab26d5bb-6495-4c9b-b134-6612a997f201 will not be triggered until provisioned by entity L2. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:33:27.101149 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Network 4a053960-3cf4-4216-b7a5-291ef61e89b7 is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:33:27.102295 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-d149a831-620d-4758-8637-4b05609da202 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:33:27.117760 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-5f6944a1-6623-44d3-895a-46cd7c6dc744 req-8d32860a-e663-4f16-9b77-3464abd9ad0f tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.4660804
Jun 03 08:33:27.119336 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d149a831-620d-4758-8637-4b05609da202 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Pushing event updated for resources: {'Port': ['ID=f0f9ba57-524d-497e-8230-57c2fa447a6a,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:27.145466 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-d149a831-620d-4758-8637-4b05609da202 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:33:27.145466 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-d149a831-620d-4758-8637-4b05609da202 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:27.145466 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-d149a831-620d-4758-8637-4b05609da202 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:27.175549 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,revision_number=8']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:27.180793 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.200s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:27.207234 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:33:27.217479 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-d149a831-620d-4758-8637-4b05609da202 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.447s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:27.223188 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:27.248021 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b654d229-ed94-41d0-b981-9d219fbaffb5 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:27.251378 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-16344774', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-16328707'] for router_interface, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:27.320520 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-d149a831-620d-4758-8637-4b05609da202 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.55 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 4.4257579
Jun 03 08:33:27.355574 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Pushing event updated for resources: {'Port': ['ID=d52ae51a-5b28-450c-a58c-aff5122faf14,revision_number=2']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:27.359697 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.422s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:27.404088 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ddd4a287-7577-447b-90d5-d48900720045 req-1f561a79-4c11-440d-af13-60082fa72d6d service neutron] 10.222.0.55 "GET /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.7154472
Jun 03 08:33:27.421896 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Request body: {'port': {'device_id': '94bade6e-3955-4228-b5ef-3ef8fb278f08', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:27.523813 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-06898e8d-96de-45a6-a527-de3e2e5f94dc None None] Provisioning complete for port ce979b40-484e-45cd-a6cb-a3940bb7a659 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:27.524230 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-06898e8d-96de-45a6-a527-de3e2e5f94dc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:27.589870 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-06898e8d-96de-45a6-a527-de3e2e5f94dc None None] Port ce979b40-484e-45cd-a6cb-a3940bb7a659 cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:33:27.710981 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Network 15e18fdf-cd32-4b01-8841-c321ea578305 is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:33:27.714457 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:33:27.725001 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ddd4a287-7577-447b-90d5-d48900720045 req-88554c84-f483-4dbd-b011-e9b882791ecc service neutron] 10.222.0.55 "GET /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2303295
Jun 03 08:33:27.792678 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-055af15c-aa40-47c3-9958-e689a975e6ce req-0a490e24-e98c-4981-af29-070b7a8f08cf tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:27.797854 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-055af15c-aa40-47c3-9958-e689a975e6ce req-0a490e24-e98c-4981-af29-070b7a8f08cf tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 946 time: 0.3997836
Jun 03 08:33:27.816425 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Pushing event updated for resources: {'Port': ['ID=ab26d5bb-6495-4c9b-b134-6612a997f201,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:27.862799 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.615s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:27.941009 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device ddaa7077-d668-4d3b-a8ec-849e13f8a9cf up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:27.996515 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Attempting to bind port ab26d5bb-6495-4c9b-b134-6612a997f201 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:33:27.997012 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Attempting to bind port ab26d5bb-6495-4c9b-b134-6612a997f201 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '6978222c-6678-416a-a506-1fa962d91d64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 523, 'network_id': 'd6b7a34f-3fa8-4a38-ab72-8c6458a51990'}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:33:27.997581 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Attempting to bind port ab26d5bb-6495-4c9b-b134-6612a997f201 on network d6b7a34f-3fa8-4a38-ab72-8c6458a51990 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:33:28.001400 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Router ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3 has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:33:28.003784 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:28.014369 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-055af15c-aa40-47c3-9958-e689a975e6ce req-683856d2-f116-4ad1-8372-3a7e21eb86d9 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2067375
Jun 03 08:33:28.031974 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f549967-368b-4a00-8105-f052054f9df7 req-65b6d816-ee60-4fb0-9e40-09cf4b69f563 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:28.031974 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9f549967-368b-4a00-8105-f052054f9df7 req-65b6d816-ee60-4fb0-9e40-09cf4b69f563 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.8612566
Jun 03 08:33:28.031974 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Router 02c1b0e4-a9b8-4fc7-af87-8069fb4caced has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:33:28.034676 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Port ab26d5bb-6495-4c9b-b134-6612a997f201 on network d6b7a34f-3fa8-4a38-ab72-8c6458a51990 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 03 08:33:28.034676 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Attempting to bind port ab26d5bb-6495-4c9b-b134-6612a997f201 on network d6b7a34f-3fa8-4a38-ab72-8c6458a51990 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:33:28.050731 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port ddaa7077-d668-4d3b-a8ec-849e13f8a9cf triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:28.052614 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:28.066600 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Checking agent: {'id': '181c5753-100b-4f03-bda8-e34279b057f4', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'started_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 33, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:33:28.067030 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Checking segment: {'id': '6978222c-6678-416a-a506-1fa962d91d64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 523, 'network_id': 'd6b7a34f-3fa8-4a38-ab72-8c6458a51990'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:33:28.067419 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Bound using segment: {'id': '6978222c-6678-416a-a506-1fa962d91d64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 523, 'network_id': 'd6b7a34f-3fa8-4a38-ab72-8c6458a51990'} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:33:28.067970 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Bound port: ab26d5bb-6495-4c9b-b134-6612a997f201, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6978222c-6678-416a-a506-1fa962d91d64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 523, 'network_id': 'd6b7a34f-3fa8-4a38-ab72-8c6458a51990'}}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:33:28.068321 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:28.168975 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 03 Jun 2021 08:33:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4e0cc321-eb40-4bd6-9cb1-92cf8ce8689d x-openstack-request-id: req-4e0cc321-eb40-4bd6-9cb1-92cf8ce8689d {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:33:28.169534 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0c731ecb-c3fc-401e-af74-34336582cf7d", "name": "network-vif-unplugged", "status": "completed", "tag": "7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:33:28.171700 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-4e0cc321-eb40-4bd6-9cb1-92cf8ce8689d {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:33:28.171700 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0c731ecb-c3fc-401e-af74-34336582cf7d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97', 'code': 200}
Jun 03 08:33:28.231702 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0778bb74-9c33-435c-a972-4de49558bd3d None None] Provisioning complete for port d52ae51a-5b28-450c-a58c-aff5122faf14 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:28.232512 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0778bb74-9c33-435c-a972-4de49558bd3d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:28.316409 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9f549967-368b-4a00-8105-f052054f9df7 req-2de69dfd-9849-40f2-a515-5b3d99bbec94 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2749488
Jun 03 08:33:28.380430 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0778bb74-9c33-435c-a972-4de49558bd3d None None] Port d52ae51a-5b28-450c-a58c-aff5122faf14 cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:33:28.383205 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:33:28.397892 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] Sync routers for ids ['ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3'] in dv-cinder-787262-5-iscsi {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:33:28.407649 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] Routers {'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:33:28.408267 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae87ae8eb0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:33:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:28.425437 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ec5265c-feb5-43ac-aa50-b60004128f57 req-6bca14fd-b346-45c4-bf89-6e8d98f60ce7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:28.432549 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0ec5265c-feb5-43ac-aa50-b60004128f57 req-6bca14fd-b346-45c4-bf89-6e8d98f60ce7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.2319152
Jun 03 08:33:28.461397 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] 10.222.0.11 "PUT /v2.0/routers/ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3/add_router_interface HTTP/1.1" status: 200  len: 503 time: 7.0567482
Jun 03 08:33:28.520325 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] For port ab26d5bb-6495-4c9b-b134-6612a997f201, host hv-cinder-78726, cleared binding levels {{(pid=92323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:33:28.529976 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0ec5265c-feb5-43ac-aa50-b60004128f57 req-8b918f80-348e-451f-8565-c48b5d6f0245 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0964408
Jun 03 08:33:28.539771 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] For port ab26d5bb-6495-4c9b-b134-6612a997f201, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=ab26d5bb-6495-4c9b-b134-6612a997f201,segment=NetworkSegment(6978222c-6678-416a-a506-1fa962d91d64),segment_id=6978222c-6678-416a-a506-1fa962d91d64)] {{(pid=92323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:33:28.659110 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:28.667602 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-33d9baea-6833-46f1-93d1-ff08ed87b7b4 tempest-DeleteServersTestJSON-1668541898 tempest-DeleteServersTestJSON-1668541898-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:28.685015 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] Set router ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:33:28.705150 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:33:28.716000 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] Sync routers for ids ['02c1b0e4-a9b8-4fc7-af87-8069fb4caced'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:33:28.739825 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] Routers {'02c1b0e4-a9b8-4fc7-af87-8069fb4caced'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:33:28.741057 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae8620dd90>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:33:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['02c1b0e4-a9b8-4fc7-af87-8069fb4caced'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:28.784941 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] 10.222.0.11 "PUT /v2.0/routers/02c1b0e4-a9b8-4fc7-af87-8069fb4caced/add_router_interface HTTP/1.1" status: 200  len: 503 time: 10.2158620
Jun 03 08:33:28.837019 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:28.837782 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:28.839392 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] 10.222.0.55 "PUT /v2.0/ports/ab26d5bb-6495-4c9b-b134-6612a997f201 HTTP/1.1" status: 200  len: 1093 time: 3.9783967
Jun 03 08:33:28.842310 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7525b38b-62a4-4060-b8e8-f15c49408a7b', 'tag': 'ab26d5bb-6495-4c9b-b134-6612a997f201'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:33:28.851742 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7a7554fb-7b6c-4ed9-8f42-3483a6101ed0" -d '{"events": [{"name": "network-changed", "server_uuid": "7525b38b-62a4-4060-b8e8-f15c49408a7b", "tag": "ab26d5bb-6495-4c9b-b134-6612a997f201"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:33:28.897271 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Pushing event updated for resources: {'Port': ['ID=ab26d5bb-6495-4c9b-b134-6612a997f201,revision_number=3']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:28.923149 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.255s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:29.034678 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-192d4368-9eab-42d7-ab98-e97520acd6c6 req-e114f0b9-b2db-4b41-a941-dfb48fd56fd0 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:29.046209 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-192d4368-9eab-42d7-ab98-e97520acd6c6 req-e114f0b9-b2db-4b41-a941-dfb48fd56fd0 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 931 time: 0.4094441
Jun 03 08:33:29.103945 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] Set router 02c1b0e4-a9b8-4fc7-af87-8069fb4caced gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:33:29.176542 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-192d4368-9eab-42d7-ab98-e97520acd6c6 req-9461db70-d108-466e-9a8a-f609fedfc61b tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1294742
Jun 03 08:33:29.257832 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0638e320-c933-47b5-a875-9f84bff82df2 req-110a225a-a7e1-42b9-ae44-53d09f11220d tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:29.265502 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0638e320-c933-47b5-a875-9f84bff82df2 req-110a225a-a7e1-42b9-ae44-53d09f11220d tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 943 time: 0.7418120
Jun 03 08:33:29.298201 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f0f9ba57-524d-497e-8230-57c2fa447a6a {{(pid=92323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:33:29.326655 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:29.389999 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae87ae8eb0>, [{'id': 'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3', 'name': 'tempest-TestMinimumBasicScenario-86704573-router', 'tenant_id': '7de719cd894b4eff8d1ebe284e30569b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'ddaa7077-d668-4d3b-a8ec-849e13f8a9cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:14Z', 'updated_at': '2021-06-03T08:33:25Z', 'revision_number': 4, 'project_id': '7de719cd894b4eff8d1ebe284e30569b', 'gw_port': {'id': 'ddaa7077-d668-4d3b-a8ec-849e13f8a9cf', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ac:a7:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:17Z', 'updated_at': '2021-06-03T08:33:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': 'd52ae51a-5b28-450c-a58c-aff5122faf14', 'name': '', 'network_id': '15e18fdf-cd32-4b01-8841-c321ea578305', 'tenant_id': '7de719cd894b4eff8d1ebe284e30569b', 'mac_address': 'fa:16:3e:f2:f8:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3', 'device_owner': 'network:router_interface', 'standard_attr_id': 403, 'fixed_ips': [{'subnet_id': '12ddd2af-f3e3-46c1-98f9-a99828fc2abc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:24Z', 'updated_at': '2021-06-03T08:33:25Z', 'revision_number': 2, 'project_id': '7de719cd894b4eff8d1ebe284e30569b', 'subnets': [{'id': '12ddd2af-f3e3-46c1-98f9-a99828fc2abc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:29.399149 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] Checking router: ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3 for host: dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:33:29.400679 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] Updating router ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3 port d52ae51a-5b28-450c-a58c-aff5122faf14 binding host dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 03 08:33:29.431646 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Transition to ACTIVE for port object f0f9ba57-524d-497e-8230-57c2fa447a6a will not be triggered until provisioned by entity L2. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:33:29.446894 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a10ee5f4-e2f9-4b6f-a93c-9fe6d59a8eac req-927ffe5b-7f43-404a-96ac-3e4d8492d4bd tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:29.453885 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a10ee5f4-e2f9-4b6f-a93c-9fe6d59a8eac req-927ffe5b-7f43-404a-96ac-3e4d8492d4bd tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.1357756
Jun 03 08:33:29.455411 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0638e320-c933-47b5-a875-9f84bff82df2 req-644e9746-553f-4482-b950-af62b0b6b36e tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1887915
Jun 03 08:33:29.498978 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:29.522745 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:29.524331 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a10ee5f4-e2f9-4b6f-a93c-9fe6d59a8eac req-ebc04d15-58a5-469e-8475-a2cd9bd9d23b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0669014
Jun 03 08:33:29.536248 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:29.598701 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-fa48cdc8-22af-4e02-b7fd-c9d7fd0304ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:29.607869 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-fa48cdc8-22af-4e02-b7fd-c9d7fd0304ec service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=9a96090cd93b48608ead040676d45129&device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 1096 time: 0.5377777
Jun 03 08:33:29.609661 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:33:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f0bb9237-242a-460d-bf96-d95f15745f41 x-openstack-request-id: req-f0bb9237-242a-460d-bf96-d95f15745f41 {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:33:29.610088 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7525b38b-62a4-4060-b8e8-f15c49408a7b", "tag": "ab26d5bb-6495-4c9b-b134-6612a997f201", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:33:29.610455 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-f0bb9237-242a-460d-bf96-d95f15745f41 {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:33:29.611051 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7525b38b-62a4-4060-b8e8-f15c49408a7b', 'tag': 'ab26d5bb-6495-4c9b-b134-6612a997f201', 'status': 'completed', 'code': 200}
Jun 03 08:33:29.654863 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae8620dd90>, [{'id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'name': 'tempest-TestShelveInstance-1807805368-router', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155'}], 'enable_snat': True}, 'gw_port_id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:06Z', 'updated_at': '2021-06-03T08:33:23Z', 'revision_number': 4, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'gw_port': {'id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:4e:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:10Z', 'updated_at': '2021-06-03T08:33:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': 'ce979b40-484e-45cd-a6cb-a3940bb7a659', 'name': '', 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'mac_address': 'fa:16:3e:b9:79:71', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'fc181126-7c66-44d3-b731-a59036bd562f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:21Z', 'updated_at': '2021-06-03T08:33:25Z', 'revision_number': 2, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'subnets': [{'id': 'fc181126-7c66-44d3-b731-a59036bd562f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:29.659851 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] Checking router: 02c1b0e4-a9b8-4fc7-af87-8069fb4caced for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:33:29.660272 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] Updating router 02c1b0e4-a9b8-4fc7-af87-8069fb4caced port ce979b40-484e-45cd-a6cb-a3940bb7a659 binding host dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 03 08:33:29.778071 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:29.939825 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea71c234-aec3-4733-841e-6241e26f234d req-b49278ff-ec3a-4d4f-be81-7d08ca003d15 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:29.947479 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ea71c234-aec3-4733-841e-6241e26f234d req-b49278ff-ec3a-4d4f-be81-7d08ca003d15 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1631501
Jun 03 08:33:30.001618 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-56294e8c-7633-4cff-aea8-e705c301f55f service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=ab26d5bb-6495-4c9b-b134-6612a997f201 HTTP/1.1" status: 200  len: 217 time: 0.2383454
Jun 03 08:33:30.034292 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ea71c234-aec3-4733-841e-6241e26f234d req-d3389cef-44e3-4b8e-be11-36921e42ac7b tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0741067
Jun 03 08:33:30.155417 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Pushing event updated for resources: {'Port': ['ID=f0f9ba57-524d-497e-8230-57c2fa447a6a,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:30.178362 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.663s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:30.192340 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Attempting to bind port f0f9ba57-524d-497e-8230-57c2fa447a6a on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:33:30.193375 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Attempting to bind port f0f9ba57-524d-497e-8230-57c2fa447a6a by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '9559424d-973e-4a97-92a4-8a446b0a62b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 513, 'network_id': '9fa75ad7-a669-4187-8c25-4bc1ee5a9f55'}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:33:30.193927 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Attempting to bind port f0f9ba57-524d-497e-8230-57c2fa447a6a on network 9fa75ad7-a669-4187-8c25-4bc1ee5a9f55 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:33:30.207851 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Port f0f9ba57-524d-497e-8230-57c2fa447a6a on network 9fa75ad7-a669-4187-8c25-4bc1ee5a9f55 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 03 08:33:30.208525 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Attempting to bind port f0f9ba57-524d-497e-8230-57c2fa447a6a on network 9fa75ad7-a669-4187-8c25-4bc1ee5a9f55 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:33:30.211806 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-b55f1165-6762-46a7-b58a-ea326edf969e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:30.213480 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-b55f1165-6762-46a7-b58a-ea326edf969e service neutron] 10.222.0.55 "GET /v2.0/subnets?id=511f126c-ca8b-42fb-80d6-5f4b9a80cf7e HTTP/1.1" status: 200  len: 854 time: 0.2015533
Jun 03 08:33:30.218092 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Checking agent: {'id': '181c5753-100b-4f03-bda8-e34279b057f4', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'started_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 33, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:33:30.218576 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Checking segment: {'id': '9559424d-973e-4a97-92a4-8a446b0a62b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 513, 'network_id': '9fa75ad7-a669-4187-8c25-4bc1ee5a9f55'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:33:30.219038 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Bound using segment: {'id': '9559424d-973e-4a97-92a4-8a446b0a62b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 513, 'network_id': '9fa75ad7-a669-4187-8c25-4bc1ee5a9f55'} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:33:30.219533 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Bound port: f0f9ba57-524d-497e-8230-57c2fa447a6a, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9559424d-973e-4a97-92a4-8a446b0a62b5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 513, 'network_id': '9fa75ad7-a669-4187-8c25-4bc1ee5a9f55'}}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:33:30.220104 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:30.262931 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] Notify callbacks [] for port, precommit_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:30.285254 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-7e8e63ac-a092-4fce-b9e6-b13072d38d28 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=d6b7a34f-3fa8-4a38-ab72-8c6458a51990&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0552561
Jun 03 08:33:30.292232 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.provisioning_blocks [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] Transition to ACTIVE for port object d52ae51a-5b28-450c-a58c-aff5122faf14 will not be triggered until provisioned by entity L2. {{(pid=92326) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:33:30.401461 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:30.409870 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-bce8eae0-16f6-4ddd-9809-76c8dc5e970d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:30.438946 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:33:30.567055 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] For port f0f9ba57-524d-497e-8230-57c2fa447a6a, host hv-cinder-78726, cleared binding levels {{(pid=92323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:33:30.588324 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] For port f0f9ba57-524d-497e-8230-57c2fa447a6a, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=f0f9ba57-524d-497e-8230-57c2fa447a6a,segment=NetworkSegment(9559424d-973e-4a97-92a4-8a446b0a62b5),segment_id=9559424d-973e-4a97-92a4-8a446b0a62b5)] {{(pid=92323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:33:30.597727 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 50184) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:30.614225 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1063943176-network', 'tenant_id': '66cedbb00e294ca49bf37a7789202b7f'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:30.626958 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:30.642128 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1410765f-dd08-481e-baf2-9f9b6574b5f6 req-eaf0aea8-1e98-4814-b06b-c963ca0cd4c6 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:30.654961 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-1410765f-dd08-481e-baf2-9f9b6574b5f6 req-eaf0aea8-1e98-4814-b06b-c963ca0cd4c6 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 943 time: 0.2263520
Jun 03 08:33:30.676596 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-d5c184a3-1f5e-4551-9a09-d96b2a663322 service neutron] 10.222.0.55 "GET /v2.0/networks/d6b7a34f-3fa8-4a38-ab72-8c6458a51990?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3402622
Jun 03 08:33:30.695915 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Usage tracker for resource:network and tenant:66cedbb00e294ca49bf37a7789202b7f is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:30.728336 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:30.738346 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] Notify callbacks [] for port, precommit_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:30.757949 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-1410765f-dd08-481e-baf2-9f9b6574b5f6 req-cdd9fd9b-aaa3-4e61-88eb-917e59b3ec7e tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1013362
Jun 03 08:33:30.770567 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:30.777686 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] Transition to ACTIVE for port object ce979b40-484e-45cd-a6cb-a3940bb7a659 will not be triggered until provisioned by entity L2. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:33:30.868329 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e2ff8069-2f74-4fb4-8575-84c4265faa92 req-b82ff4a4-fcd2-486d-bd60-4cfc035640eb service neutron] 10.222.0.55 "GET /v2.0/networks/d6b7a34f-3fa8-4a38-ab72-8c6458a51990?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1822858
Jun 03 08:33:30.870061 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:30.877949 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:30.927903 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Made reservation on behalf of 66cedbb00e294ca49bf37a7789202b7f for: {'network': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:33:30.936259 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-676039'] for network, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:30.961669 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:30.980658 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:30.985681 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Usage tracker for resource:security_group_rule and tenant:66cedbb00e294ca49bf37a7789202b7f is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:30.990189 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:30.997339 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:31.024575 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abaf8e02-1c64-472d-a19a-222315473fa7 None None] Pushing event updated for resources: {'Port': ['ID=d52ae51a-5b28-450c-a58c-aff5122faf14,revision_number=3']} {{(pid=92326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:31.030084 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-abaf8e02-1c64-472d-a19a-222315473fa7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.620s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:31.033961 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:31.042519 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-4c1261a5-a635-4e39-b01c-d2d9510e2470 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:31.101902 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:31.186569 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Pushing event updated for resources: {'Port': ['ID=f0f9ba57-524d-497e-8230-57c2fa447a6a,revision_number=3']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:31.200680 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:31.201202 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.323s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:31.215203 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:31.219583 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:31.219583 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] 10.222.0.55 "PUT /v2.0/ports/f0f9ba57-524d-497e-8230-57c2fa447a6a HTTP/1.1" status: 200  len: 1093 time: 3.8086228
Jun 03 08:33:31.236825 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] vlan segment allocate from pool success with {'vlan_id': 524, 'physical_network': 'physnet1'}  {{(pid=92324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 03 08:33:31.249076 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:31.249705 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.segments_db [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Added segment eb60ee44-2fee-4938-bb69-42ff628ee059 of type vlan for network 05b59006-52ce-4932-9534-4293d40c8ece
Jun 03 08:33:31.269752 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a7554fb-7b6c-4ed9-8f42-3483a6101ed0 req-c95c80d9-36e4-40fd-88c2-c8a91dff0181 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:31.271736 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7a7554fb-7b6c-4ed9-8f42-3483a6101ed0 req-c95c80d9-36e4-40fd-88c2-c8a91dff0181 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=9a96090cd93b48608ead040676d45129&device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 1096 time: 0.1777163
Jun 03 08:33:31.280065 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8774223827658'] for network, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:31.322632 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-2b94e5c8-9ea9-4887-8c91-9b6640295c5b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:31.359517 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=603bdbfc-de30-4376-8820-20a98f093de4,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:31.363584 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:31.374981 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac62d933-6d83-4e0f-b501-4a6eb418cb9e None None] Pushing event updated for resources: {'Port': ['ID=ce979b40-484e-45cd-a6cb-a3940bb7a659,revision_number=3']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:31.386229 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-ac62d933-6d83-4e0f-b501-4a6eb418cb9e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.344s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:31.404573 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] Attempting to bind port ce979b40-484e-45cd-a6cb-a3940bb7a659 on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:33:31.405274 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] Attempting to bind port ce979b40-484e-45cd-a6cb-a3940bb7a659 by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': 'aaa5b128-9aff-431e-b567-4ca42a016de6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7'}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:33:31.405824 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] Attempting to bind port ce979b40-484e-45cd-a6cb-a3940bb7a659 on network 4a053960-3cf4-4216-b7a5-291ef61e89b7 {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:33:31.415671 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 33, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:33:31.416208 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] Checking segment: {'id': 'aaa5b128-9aff-431e-b567-4ca42a016de6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:33:31.416737 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:31.417239 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] Bound using segment: {'id': 'aaa5b128-9aff-431e-b567-4ca42a016de6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7'} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:33:31.417830 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] Bound port: ce979b40-484e-45cd-a6cb-a3940bb7a659, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aaa5b128-9aff-431e-b567-4ca42a016de6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7'}}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:33:31.420336 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:31.468767 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820'] for network, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:31.470291 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:31.471140 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:31.478882 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-7e89e746-2662-425b-bcb7-5c82eb768bad admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:31.548360 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] Attempting to bind port d52ae51a-5b28-450c-a58c-aff5122faf14 on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:33:31.549006 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] Attempting to bind port d52ae51a-5b28-450c-a58c-aff5122faf14 by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '8acb7a59-d9f0-4604-be49-ed0601f465ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '15e18fdf-cd32-4b01-8841-c321ea578305'}] {{(pid=92326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:33:31.550813 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] Attempting to bind port d52ae51a-5b28-450c-a58c-aff5122faf14 on network 15e18fdf-cd32-4b01-8841-c321ea578305 {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:33:31.554242 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] For port ce979b40-484e-45cd-a6cb-a3940bb7a659, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:33:31.560351 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] For port ce979b40-484e-45cd-a6cb-a3940bb7a659, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=ce979b40-484e-45cd-a6cb-a3940bb7a659,segment=NetworkSegment(aaa5b128-9aff-431e-b567-4ca42a016de6),segment_id=aaa5b128-9aff-431e-b567-4ca42a016de6)] {{(pid=92325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:33:31.563062 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 33, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:33:31.563719 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] Checking segment: {'id': '8acb7a59-d9f0-4604-be49-ed0601f465ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '15e18fdf-cd32-4b01-8841-c321ea578305'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92326) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:33:31.564223 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:31.564714 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] Bound using segment: {'id': '8acb7a59-d9f0-4604-be49-ed0601f465ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '15e18fdf-cd32-4b01-8841-c321ea578305'} {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:33:31.565298 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] Bound port: d52ae51a-5b28-450c-a58c-aff5122faf14, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8acb7a59-d9f0-4604-be49-ed0601f465ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 504, 'network_id': '15e18fdf-cd32-4b01-8841-c321ea578305'}}] {{(pid=92326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:33:31.565774 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:31.621617 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '94bade6e-3955-4228-b5ef-3ef8fb278f08', 'tag': 'f0f9ba57-524d-497e-8230-57c2fa447a6a'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:33:31.625617 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b46c546c-8acf-4fb8-807e-7d05d5fc44b2" -d '{"events": [{"name": "network-changed", "server_uuid": "94bade6e-3955-4228-b5ef-3ef8fb278f08", "tag": "f0f9ba57-524d-497e-8230-57c2fa447a6a"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:33:31.649069 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a7554fb-7b6c-4ed9-8f42-3483a6101ed0 req-2ef8653d-45a9-42ca-b8fa-8af8810effea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:31.650651 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7a7554fb-7b6c-4ed9-8f42-3483a6101ed0 req-2ef8653d-45a9-42ca-b8fa-8af8810effea service neutron] 10.222.0.55 "GET /v2.0/networks?id=d6b7a34f-3fa8-4a38-ab72-8c6458a51990 HTTP/1.1" status: 200  len: 915 time: 0.3450763
Jun 03 08:33:31.673679 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-076bfa0c-999a-4959-96c5-8a5da5b91815 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:31.676383 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:31.680951 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:31.682690 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-076bfa0c-999a-4959-96c5-8a5da5b91815 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=96ee04709f4540ee8818120a88291b46&device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 1096 time: 0.1822169
Jun 03 08:33:31.768978 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 1.1700981
Jun 03 08:33:31.777759 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 50200) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:31.791215 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-a946c209-642d-4f62-a667-1d940c9ce8d0 admin admin] Request body: {'subnet': {'network_id': '05b59006-52ce-4932-9534-4293d40c8ece', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1063943176-subnet', 'tenant_id': '66cedbb00e294ca49bf37a7789202b7f', 'ip_version': 4}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:31.792484 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.db [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] For port d52ae51a-5b28-450c-a58c-aff5122faf14, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92326) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:33:31.799515 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Pushing event updated for resources: {'Network': ['ID=05b59006-52ce-4932-9534-4293d40c8ece,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:31.804224 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.326s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:31.809670 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-a946c209-642d-4f62-a667-1d940c9ce8d0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:31.815112 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.db [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] For port d52ae51a-5b28-450c-a58c-aff5122faf14, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=d52ae51a-5b28-450c-a58c-aff5122faf14,segment=NetworkSegment(8acb7a59-d9f0-4604-be49-ed0601f465ae),segment_id=8acb7a59-d9f0-4604-be49-ed0601f465ae)] {{(pid=92326) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:33:31.826188 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-a946c209-642d-4f62-a667-1d940c9ce8d0 admin admin] Usage tracker for resource:subnet and tenant:66cedbb00e294ca49bf37a7789202b7f is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:31.831594 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-a946c209-642d-4f62-a667-1d940c9ce8d0 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:31.846374 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-a946c209-642d-4f62-a667-1d940c9ce8d0 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:31.865875 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Network 05b59006-52ce-4932-9534-4293d40c8ece details requested by agent ovs-agent-dv-cinder-787262-5-iscsi with host dv-cinder-787262-5-iscsi {{(pid=92325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 03 08:33:31.922680 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:31.925356 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-188f721b-9b60-4b9b-825f-52cbd4982e21 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f0f9ba57-524d-497e-8230-57c2fa447a6a HTTP/1.1" status: 200  len: 217 time: 0.1492653
Jun 03 08:33:31.927203 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:31.929054 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7a7554fb-7b6c-4ed9-8f42-3483a6101ed0 req-e785c5ae-661d-4719-8e88-3580be361cf6 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=ab26d5bb-6495-4c9b-b134-6612a997f201 HTTP/1.1" status: 200  len: 217 time: 0.2581604
Jun 03 08:33:31.955319 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a946c209-642d-4f62-a667-1d940c9ce8d0 admin admin] Made reservation on behalf of 66cedbb00e294ca49bf37a7789202b7f for: {'subnet': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:33:31.958929 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a946c209-642d-4f62-a667-1d940c9ce8d0 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14870279'] for subnet, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:31.975677 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac62d933-6d83-4e0f-b501-4a6eb418cb9e None None] Pushing event updated for resources: {'Port': ['ID=ce979b40-484e-45cd-a6cb-a3940bb7a659,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:32.001048 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-ac62d933-6d83-4e0f-b501-4a6eb418cb9e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.320s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:32.091446 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] Routers {'02c1b0e4-a9b8-4fc7-af87-8069fb4caced'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:33:32.092206 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae8620dd90>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:33:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['02c1b0e4-a9b8-4fc7-af87-8069fb4caced'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:32.220491 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] Routers {'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:33:32.221050 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae87ae8eb0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:33:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:32.325375 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-f61f106c-761a-4d6a-b29d-c1d8a5178b7c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:32.327219 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-f61f106c-761a-4d6a-b29d-c1d8a5178b7c service neutron] 10.222.0.55 "GET /v2.0/subnets?id=4463a771-9390-43b9-805a-b4b8e5004e4c HTTP/1.1" status: 200  len: 848 time: 0.3352180
Jun 03 08:33:32.348005 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a7554fb-7b6c-4ed9-8f42-3483a6101ed0 req-745d9392-ec52-4f21-a829-553dd46ff214 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:32.349532 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7a7554fb-7b6c-4ed9-8f42-3483a6101ed0 req-745d9392-ec52-4f21-a829-553dd46ff214 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=511f126c-ca8b-42fb-80d6-5f4b9a80cf7e HTTP/1.1" status: 200  len: 854 time: 0.3493893
Jun 03 08:33:32.439704 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] Set router 02c1b0e4-a9b8-4fc7-af87-8069fb4caced gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:33:32.455110 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abaf8e02-1c64-472d-a19a-222315473fa7 None None] Pushing event updated for resources: {'Port': ['ID=d52ae51a-5b28-450c-a58c-aff5122faf14,revision_number=4']} {{(pid=92326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:32.479966 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-abaf8e02-1c64-472d-a19a-222315473fa7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.553s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:32.531012 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5de263ed-b0f7-4bf7-9071-c9dd8632b750 req-e83ae2a6-fd65-4218-b37f-1e531a0d2fd0 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:32.539475 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5de263ed-b0f7-4bf7-9071-c9dd8632b750 req-e83ae2a6-fd65-4218-b37f-1e531a0d2fd0 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 943 time: 0.6128554
Jun 03 08:33:32.564482 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-116be820-ad66-4f45-8492-530c851cc276 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=9fa75ad7-a669-4187-8c25-4bc1ee5a9f55&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.2032838
Jun 03 08:33:32.623425 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7a7554fb-7b6c-4ed9-8f42-3483a6101ed0 req-7e5796bb-b7ca-4439-83fe-18a8a4661b51 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=d6b7a34f-3fa8-4a38-ab72-8c6458a51990&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1709094
Jun 03 08:33:32.756812 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-f7367643-77bb-43b5-8821-d3df1b91f5af None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:32.812378 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] Set router ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:33:33.052668 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe6ef8b2-4a01-443b-b328-8aa6fcd6d720 req-d609d44a-01fa-4839-a085-9967f18bd21f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:33.067349 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-fe6ef8b2-4a01-443b-b328-8aa6fcd6d720 req-d609d44a-01fa-4839-a085-9967f18bd21f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.2713547
Jun 03 08:33:33.083293 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5de263ed-b0f7-4bf7-9071-c9dd8632b750 req-d499bf69-37f0-468e-9792-aa2596eaac60 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.5428965
Jun 03 08:33:33.201829 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:33:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-abc53409-f39a-4fab-8172-8c622dd3b006 x-openstack-request-id: req-abc53409-f39a-4fab-8172-8c622dd3b006 {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:33:33.202145 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "94bade6e-3955-4228-b5ef-3ef8fb278f08", "tag": "f0f9ba57-524d-497e-8230-57c2fa447a6a", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:33:33.202425 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-abc53409-f39a-4fab-8172-8c622dd3b006 {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:33:33.202858 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '94bade6e-3955-4228-b5ef-3ef8fb278f08', 'tag': 'f0f9ba57-524d-497e-8230-57c2fa447a6a', 'status': 'completed', 'code': 200}
Jun 03 08:33:33.208048 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae8620dd90>, [{'id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'name': 'tempest-TestShelveInstance-1807805368-router', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155'}], 'enable_snat': True}, 'gw_port_id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:06Z', 'updated_at': '2021-06-03T08:33:23Z', 'revision_number': 4, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'gw_port': {'id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:4e:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:10Z', 'updated_at': '2021-06-03T08:33:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': 'ce979b40-484e-45cd-a6cb-a3940bb7a659', 'name': '', 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'mac_address': 'fa:16:3e:b9:79:71', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'fc181126-7c66-44d3-b731-a59036bd562f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:21Z', 'updated_at': '2021-06-03T08:33:31Z', 'revision_number': 4, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'subnets': [{'id': 'fc181126-7c66-44d3-b731-a59036bd562f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:33.222231 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab2eefcb-9247-4337-8570-c4009148ec48 None None] The sync data for ids ['02c1b0e4-a9b8-4fc7-af87-8069fb4caced'] in dv-cinder-787262-5-iscsi is: [{'id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'name': 'tempest-TestShelveInstance-1807805368-router', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155'}], 'enable_snat': True}, 'gw_port_id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:06Z', 'updated_at': '2021-06-03T08:33:23Z', 'revision_number': 4, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'gw_port': {'id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:4e:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:10Z', 'updated_at': '2021-06-03T08:33:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': 'ce979b40-484e-45cd-a6cb-a3940bb7a659', 'name': '', 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'mac_address': 'fa:16:3e:b9:79:71', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'fc181126-7c66-44d3-b731-a59036bd562f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:21Z', 'updated_at': '2021-06-03T08:33:31Z', 'revision_number': 4, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'subnets': [{'id': 'fc181126-7c66-44d3-b731-a59036bd562f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:33:33.238529 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-801c3c70-bb19-4299-be6c-a8c84cd16612 service neutron] 10.222.0.55 "GET /v2.0/networks/9fa75ad7-a669-4187-8c25-4bc1ee5a9f55?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.6729095
Jun 03 08:33:33.326619 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-fe6ef8b2-4a01-443b-b328-8aa6fcd6d720 req-a221479e-50e6-47d3-81d3-53bf3df6bbab tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2446496
Jun 03 08:33:33.369049 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7a7554fb-7b6c-4ed9-8f42-3483a6101ed0 req-2b0315c7-9b65-4590-a661-c59375804933 service neutron] 10.222.0.55 "GET /v2.0/networks/d6b7a34f-3fa8-4a38-ab72-8c6458a51990?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.7302151
Jun 03 08:33:33.395593 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a946c209-642d-4f62-a667-1d940c9ce8d0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15641492', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14870385'] for subnet, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:33.401144 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-3dc76132-0b4a-454d-96f1-00896dc04d69 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:33.435476 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae87ae8eb0>, [{'id': 'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3', 'name': 'tempest-TestMinimumBasicScenario-86704573-router', 'tenant_id': '7de719cd894b4eff8d1ebe284e30569b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'ddaa7077-d668-4d3b-a8ec-849e13f8a9cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:14Z', 'updated_at': '2021-06-03T08:33:25Z', 'revision_number': 4, 'project_id': '7de719cd894b4eff8d1ebe284e30569b', 'gw_port': {'id': 'ddaa7077-d668-4d3b-a8ec-849e13f8a9cf', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ac:a7:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:17Z', 'updated_at': '2021-06-03T08:33:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': 'd52ae51a-5b28-450c-a58c-aff5122faf14', 'name': '', 'network_id': '15e18fdf-cd32-4b01-8841-c321ea578305', 'tenant_id': '7de719cd894b4eff8d1ebe284e30569b', 'mac_address': 'fa:16:3e:f2:f8:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3', 'device_owner': 'network:router_interface', 'standard_attr_id': 403, 'fixed_ips': [{'subnet_id': '12ddd2af-f3e3-46c1-98f9-a99828fc2abc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:24Z', 'updated_at': '2021-06-03T08:33:31Z', 'revision_number': 4, 'project_id': '7de719cd894b4eff8d1ebe284e30569b', 'subnets': [{'id': '12ddd2af-f3e3-46c1-98f9-a99828fc2abc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:33.456935 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5cf3a65-acf1-4999-abbe-b90f204e2219 None None] The sync data for ids ['ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3'] in dv-cinder-787262-5-iscsi is: [{'id': 'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3', 'name': 'tempest-TestMinimumBasicScenario-86704573-router', 'tenant_id': '7de719cd894b4eff8d1ebe284e30569b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'ddaa7077-d668-4d3b-a8ec-849e13f8a9cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:14Z', 'updated_at': '2021-06-03T08:33:25Z', 'revision_number': 4, 'project_id': '7de719cd894b4eff8d1ebe284e30569b', 'gw_port': {'id': 'ddaa7077-d668-4d3b-a8ec-849e13f8a9cf', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ac:a7:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:17Z', 'updated_at': '2021-06-03T08:33:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': 'd52ae51a-5b28-450c-a58c-aff5122faf14', 'name': '', 'network_id': '15e18fdf-cd32-4b01-8841-c321ea578305', 'tenant_id': '7de719cd894b4eff8d1ebe284e30569b', 'mac_address': 'fa:16:3e:f2:f8:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3', 'device_owner': 'network:router_interface', 'standard_attr_id': 403, 'fixed_ips': [{'subnet_id': '12ddd2af-f3e3-46c1-98f9-a99828fc2abc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:24Z', 'updated_at': '2021-06-03T08:33:31Z', 'revision_number': 4, 'project_id': '7de719cd894b4eff8d1ebe284e30569b', 'subnets': [{'id': '12ddd2af-f3e3-46c1-98f9-a99828fc2abc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:33:33.623527 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a946c209-642d-4f62-a667-1d940c9ce8d0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=03214dfb-e3b6-4e72-b0b6-6d9e375b3f62,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:33.629431 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-a946c209-642d-4f62-a667-1d940c9ce8d0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.228s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:33.632753 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a946c209-642d-4f62-a667-1d940c9ce8d0 admin admin] Checking segment: {'id': 'eb60ee44-2fee-4938-bb69-42ff628ee059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '05b59006-52ce-4932-9534-4293d40c8ece'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:33:33.633113 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a946c209-642d-4f62-a667-1d940c9ce8d0 admin admin] Network hostable DHCP agents. Network: 05b59006-52ce-4932-9534-4293d40c8ece, hostable agents: ['07372699-02ac-4239-816f-84b3a5b0eff9'], hosted agents: [] {{(pid=92324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 03 08:33:33.716598 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6397bd2e-bc32-48b3-82fc-da410e57a288 req-933e9870-f4a3-4785-bf83-c567a0ce3002 service neutron] 10.222.0.55 "GET /v2.0/networks/9fa75ad7-a669-4187-8c25-4bc1ee5a9f55?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4550946
Jun 03 08:33:33.790783 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a946c209-642d-4f62-a667-1d940c9ce8d0 admin admin] Network 05b59006-52ce-4932-9534-4293d40c8ece is scheduled to be hosted by DHCP agent 07372699-02ac-4239-816f-84b3a5b0eff9 with binding_index 1 {{(pid=92324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 03 08:33:33.929856 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-a946c209-642d-4f62-a667-1d940c9ce8d0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-5-iscsi, 05b59006-52ce-4932-9534-4293d40c8ece) {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:33:33.941580 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53c9afe7-bac9-485c-9d1b-5b85bda1706d None None] Network 05b59006-52ce-4932-9534-4293d40c8ece requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:33:34.029352 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a946c209-642d-4f62-a667-1d940c9ce8d0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:34.029352 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a946c209-642d-4f62-a667-1d940c9ce8d0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:34.199839 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-a946c209-642d-4f62-a667-1d940c9ce8d0 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 2.4198904
Jun 03 08:33:34.202421 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 50214) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:34.216160 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1063943176-router', 'tenant_id': '66cedbb00e294ca49bf37a7789202b7f', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:34.234543 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:34.251971 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Usage tracker for resource:router and tenant:66cedbb00e294ca49bf37a7789202b7f is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:34.257062 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:34.265243 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:34.268549 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7a7554fb-7b6c-4ed9-8f42-3483a6101ed0 req-df636b2d-5c21-423b-919f-4eefea6d860b service neutron] 10.222.0.55 "GET /v2.0/networks/d6b7a34f-3fa8-4a38-ab72-8c6458a51990?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.8910956
Jun 03 08:33:34.303402 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device ce979b40-484e-45cd-a6cb-a3940bb7a659 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:34.328519 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a6c2d74-6c46-4759-a725-49cc924809ec req-48405959-174e-4b30-abac-2a9f5f9a414e tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:34.336999 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2a6c2d74-6c46-4759-a725-49cc924809ec req-48405959-174e-4b30-abac-2a9f5f9a414e tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 943 time: 0.8867915
Jun 03 08:33:34.424153 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-16388154', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2397'] for router, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:34.425112 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-16389011', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-16327785', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-16383573', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2340'] for router, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:34.465145 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device ab26d5bb-6495-4c9b-b134-6612a997f201 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:33:34.488235 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2a6c2d74-6c46-4759-a725-49cc924809ec req-c6a75ea1-9ae5-4a76-bfc9-76847399657d tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1490133
Jun 03 08:33:34.502054 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b46c546c-8acf-4fb8-807e-7d05d5fc44b2 req-a43db608-0069-4465-be8f-0a858d1557d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:34.504649 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b46c546c-8acf-4fb8-807e-7d05d5fc44b2 req-a43db608-0069-4465-be8f-0a858d1557d4 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=96ee04709f4540ee8818120a88291b46&device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 1096 time: 0.5026717
Jun 03 08:33:34.555212 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:34.672369 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfce693d-faa4-43f2-8845-df99e914202c req-4d2b5e2f-4c2b-4835-9cc4-b279f3c27c31 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:34.674049 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-bfce693d-faa4-43f2-8845-df99e914202c req-4d2b5e2f-4c2b-4835-9cc4-b279f3c27c31 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.3893638
Jun 03 08:33:34.690601 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.db.resource_extend [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 03 08:33:34.939533 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port ab26d5bb-6495-4c9b-b134-6612a997f201, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=ab26d5bb-6495-4c9b-b134-6612a997f201,segment=NetworkSegment(6978222c-6678-416a-a506-1fa962d91d64),segment_id=6978222c-6678-416a-a506-1fa962d91d64)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:33:34.947197 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-bfce693d-faa4-43f2-8845-df99e914202c req-714e2cb0-4d4a-4eb8-9fe0-ee51a96c68f5 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2661173
Jun 03 08:33:34.970004 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': 'ab26d5bb-6495-4c9b-b134-6612a997f201', 'network_id': 'd6b7a34f-3fa8-4a38-ab72-8c6458a51990', 'port_id': 'ab26d5bb-6495-4c9b-b134-6612a997f201', 'mac_address': 'fa:16:3e:d0:02:f6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 523, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '511f126c-ca8b-42fb-80d6-5f4b9a80cf7e', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:33:35.015620 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b46c546c-8acf-4fb8-807e-7d05d5fc44b2 req-e69f70ba-fb46-45ce-a70b-97dbfc19806f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:35.021623 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b46c546c-8acf-4fb8-807e-7d05d5fc44b2 req-e69f70ba-fb46-45ce-a70b-97dbfc19806f service neutron] 10.222.0.55 "GET /v2.0/networks?id=9fa75ad7-a669-4187-8c25-4bc1ee5a9f55 HTTP/1.1" status: 200  len: 909 time: 0.5080922
Jun 03 08:33:35.146325 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:35.167219 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:35.183636 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp3789a88e-0f76-536c-9507-4ab4ace56879-05b59006-52ce-4932-9534-4293d40c8ece', 'network_id': '05b59006-52ce-4932-9534-4293d40c8ece', 'tenant_id': '66cedbb00e294ca49bf37a7789202b7f', 'fixed_ips': [{'subnet_id': '03214dfb-e3b6-4e72-b0b6-6d9e375b3f62'}]}} from dv-cinder-787262-5-iscsi. {{(pid=92325) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 03 08:33:35.184666 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:35.204075 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port ce979b40-484e-45cd-a6cb-a3940bb7a659 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:33:35.277924 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6865a722-07f4-4ad5-a33a-02de52cb35d1 req-53747831-8f05-478f-8193-89da693c41a8 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:35.285332 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6865a722-07f4-4ad5-a33a-02de52cb35d1 req-53747831-8f05-478f-8193-89da693c41a8 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 943 time: 0.5073557
Jun 03 08:33:35.311382 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port ce979b40-484e-45cd-a6cb-a3940bb7a659 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:35.315072 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:35.396827 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-16327803', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-16388116', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2358'] for router, precommit_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:35.496895 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e9e405-9f2a-4b03-b0fb-4d33298d0382 req-79c827f7-ed3e-438a-ac63-d9f35645101c tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:35.502760 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f8e9e405-9f2a-4b03-b0fb-4d33298d0382 req-79c827f7-ed3e-438a-ac63-d9f35645101c tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.2886906
Jun 03 08:33:35.509246 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6865a722-07f4-4ad5-a33a-02de52cb35d1 req-63bb28d3-fc8e-4326-90bd-f6f76cc71070 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2032232
Jun 03 08:33:35.515861 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b46c546c-8acf-4fb8-807e-7d05d5fc44b2 req-3a749e79-baa8-4fc2-ac89-a9befe94ddb7 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f0f9ba57-524d-497e-8230-57c2fa447a6a HTTP/1.1" status: 200  len: 217 time: 0.4861829
Jun 03 08:33:35.545068 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 50238) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:35.636535 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f8e9e405-9f2a-4b03-b0fb-4d33298d0382 req-493122d7-4114-4dd4-bddb-4195084e22a8 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1164322
Jun 03 08:33:35.651212 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.db_base_plugin_common [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Allocated IP 172.20.0.2 (05b59006-52ce-4932-9534-4293d40c8ece/03214dfb-e3b6-4e72-b0b6-6d9e375b3f62/e43bae4c-7900-439e-b7f0-47c23744c6f6) {{(pid=92325) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:33:35.668504 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ab26d5bb-6495-4c9b-b134-6612a997f201 {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:33:35.686087 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b46c546c-8acf-4fb8-807e-7d05d5fc44b2 req-73ec79ab-3232-4882-84b6-5094e1c98f8c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:35.688159 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b46c546c-8acf-4fb8-807e-7d05d5fc44b2 req-73ec79ab-3232-4882-84b6-5094e1c98f8c service neutron] 10.222.0.55 "GET /v2.0/subnets?id=4463a771-9390-43b9-805a-b4b8e5004e4c HTTP/1.1" status: 200  len: 848 time: 0.1655350
Jun 03 08:33:35.693734 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port ab26d5bb-6495-4c9b-b134-6612a997f201, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=ab26d5bb-6495-4c9b-b134-6612a997f201,segment=NetworkSegment(6978222c-6678-416a-a506-1fa962d91d64),segment_id=6978222c-6678-416a-a506-1fa962d91d64)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:33:35.798883 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b46c546c-8acf-4fb8-807e-7d05d5fc44b2 req-4212c8fc-16ef-46e6-aea2-5a442924c5d7 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=9fa75ad7-a669-4187-8c25-4bc1ee5a9f55&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1032760
Jun 03 08:33:35.840095 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-9417b6f8-a598-48f6-8a66-c4bb16b81930 req-25b38b58-969b-4e56-a0f4-5cfdb87fc34e service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.2890265
Jun 03 08:33:35.982451 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:36.028449 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b46c546c-8acf-4fb8-807e-7d05d5fc44b2 req-509a132f-1910-4c69-aba7-23af16a2b788 service neutron] 10.222.0.55 "GET /v2.0/networks/9fa75ad7-a669-4187-8c25-4bc1ee5a9f55?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2214658
Jun 03 08:33:36.075897 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port ce979b40-484e-45cd-a6cb-a3940bb7a659, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=ce979b40-484e-45cd-a6cb-a3940bb7a659,segment=NetworkSegment(aaa5b128-9aff-431e-b567-4ca42a016de6),segment_id=aaa5b128-9aff-431e-b567-4ca42a016de6)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:33:36.238209 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Notify callbacks [] for port, precommit_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:36.238209 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:36.238209 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-fde677f1-d0a4-4f49-82fb-c2893fa4bced None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:36.241310 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:36.242170 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device d52ae51a-5b28-450c-a58c-aff5122faf14 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:36.314512 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Transition to ACTIVE for port object e43bae4c-7900-439e-b7f0-47c23744c6f6 will not be triggered until provisioned by entity L2. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:33:36.377352 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Transition to ACTIVE for port object e43bae4c-7900-439e-b7f0-47c23744c6f6 will not be triggered until provisioned by entity DHCP. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:33:36.421601 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:36.421850 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b46c546c-8acf-4fb8-807e-7d05d5fc44b2 req-9675f853-9124-4fdb-8ad8-0f9e5172d78e service neutron] 10.222.0.55 "GET /v2.0/networks/9fa75ad7-a669-4187-8c25-4bc1ee5a9f55?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2901864
Jun 03 08:33:36.421850 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eca1bbe-98f3-4a8e-8366-cf825e3bce7f req-8e4466af-6fae-4e86-9917-66d9df7a3de3 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:36.429409 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2eca1bbe-98f3-4a8e-8366-cf825e3bce7f req-8e4466af-6fae-4e86-9917-66d9df7a3de3 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 943 time: 0.3979228
Jun 03 08:33:36.509741 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device f0f9ba57-524d-497e-8230-57c2fa447a6a details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:33:36.537451 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2eca1bbe-98f3-4a8e-8366-cf825e3bce7f req-305b3746-f466-46dd-93cb-f3420c51dbf8 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1032369
Jun 03 08:33:36.540382 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17d73290-a1b1-467f-aafb-352e0254dde8 req-0e1c33f3-49a7-4024-b0d9-9608afc04f1d tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:36.543069 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-17d73290-a1b1-467f-aafb-352e0254dde8 req-0e1c33f3-49a7-4024-b0d9-9608afc04f1d tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.3331609
Jun 03 08:33:36.580247 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:36.630438 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=ab26d5bb-6495-4c9b-b134-6612a997f201,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:36.795233 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-17d73290-a1b1-467f-aafb-352e0254dde8 req-80e32cd7-7f91-4291-8301-6632f108828a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2389755
Jun 03 08:33:36.806228 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=ce979b40-484e-45cd-a6cb-a3940bb7a659,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:36.819273 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['ab26d5bb-6495-4c9b-b134-6612a997f201'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:33:36.940970 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.559s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:36.949865 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:36.962143 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd1ea454-34bf-40b4-8ac3-eca0b594c3b2 req-b24aa398-8de1-421a-860f-cbbb3fc8ce32 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:36.969531 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fd1ea454-34bf-40b4-8ac3-eca0b594c3b2 req-b24aa398-8de1-421a-860f-cbbb3fc8ce32 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 944 time: 0.2410319
Jun 03 08:33:36.978093 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.507s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:37.057664 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fd1ea454-34bf-40b4-8ac3-eca0b594c3b2 req-eeebdc8c-a704-4082-b726-3c588f69ced3 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0871446
Jun 03 08:33:37.167524 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Network 05b59006-52ce-4932-9534-4293d40c8ece is already hosted by enough agents. {{(pid=92325) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:33:37.180014 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.scheduler.base_scheduler [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Resources bound (agent type, host, resource id):  {{(pid=92325) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:33:37.183556 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Received port after_create {{(pid=92325) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:33:37.200159 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:37.239015 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:37.298334 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port d52ae51a-5b28-450c-a58c-aff5122faf14 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:33:37.308549 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Pushing event updated for resources: {'Port': ['ID=e43bae4c-7900-439e-b7f0-47c23744c6f6,revision_number=1']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:37.318472 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.340s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:37.318880 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a6a12a1-1444-486b-9ae4-c28ac593e244 req-b373eb63-2b99-4fad-ae56-879fabb5e4f4 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:37.320674 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-7a6a12a1-1444-486b-9ae4-c28ac593e244 req-b373eb63-2b99-4fad-ae56-879fabb5e4f4 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.2974434
Jun 03 08:33:37.335653 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-6ac5cbae-0034-4682-ba8b-aea818db239d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.195s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:37.336017 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-6ac5cbae-0034-4682-ba8b-aea818db239d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.001s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:37.384461 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-7a6a12a1-1444-486b-9ae4-c28ac593e244 req-44f60893-4db4-4226-a055-5f6859e2ddda tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0548520
Jun 03 08:33:37.394465 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port d52ae51a-5b28-450c-a58c-aff5122faf14 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:37.398188 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:37.495845 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.db_base_plugin_common [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Allocated IP 172.27.0.10 (684ef871-89aa-450d-ae0d-e232bfaf51fb/e7b58fba-1ed5-483b-b341-7736b2ffb853/095583d3-03e5-4580-b9d0-ed2b9e85e4a7) {{(pid=92324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:33:37.505954 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port f0f9ba57-524d-497e-8230-57c2fa447a6a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=f0f9ba57-524d-497e-8230-57c2fa447a6a,segment=NetworkSegment(9559424d-973e-4a97-92a4-8a446b0a62b5),segment_id=9559424d-973e-4a97-92a4-8a446b0a62b5)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:33:37.515125 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Attempting to bind port e43bae4c-7900-439e-b7f0-47c23744c6f6 on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:33:37.515664 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Attempting to bind port e43bae4c-7900-439e-b7f0-47c23744c6f6 by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': 'eb60ee44-2fee-4938-bb69-42ff628ee059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '05b59006-52ce-4932-9534-4293d40c8ece'}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:33:37.516149 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Attempting to bind port e43bae4c-7900-439e-b7f0-47c23744c6f6 on network 05b59006-52ce-4932-9534-4293d40c8ece {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:33:37.537274 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 33, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:33:37.537860 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Checking segment: {'id': 'eb60ee44-2fee-4938-bb69-42ff628ee059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '05b59006-52ce-4932-9534-4293d40c8ece'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:33:37.538244 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:37.538674 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Bound using segment: {'id': 'eb60ee44-2fee-4938-bb69-42ff628ee059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '05b59006-52ce-4932-9534-4293d40c8ece'} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:33:37.539425 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Bound port: e43bae4c-7900-439e-b7f0-47c23744c6f6, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'eb60ee44-2fee-4938-bb69-42ff628ee059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '05b59006-52ce-4932-9534-4293d40c8ece'}}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:33:37.539813 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:37.565181 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': 'f0f9ba57-524d-497e-8230-57c2fa447a6a', 'network_id': '9fa75ad7-a669-4187-8c25-4bc1ee5a9f55', 'port_id': 'f0f9ba57-524d-497e-8230-57c2fa447a6a', 'mac_address': 'fa:16:3e:34:ad:19', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 513, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4463a771-9390-43b9-805a-b4b8e5004e4c', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:33:37.675717 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:37.758602 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19b5d9e2-76a4-4c8f-8696-690c3e350341 req-66b02959-1cf1-4b5d-91f7-276e6fc733c1 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:37.760273 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-19b5d9e2-76a4-4c8f-8696-690c3e350341 req-66b02959-1cf1-4b5d-91f7-276e6fc733c1 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 943 time: 0.0972431
Jun 03 08:33:37.783712 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:37.824545 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-19b5d9e2-76a4-4c8f-8696-690c3e350341 req-a33f9c92-24a7-4528-aebc-9d68746a158f tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0476053
Jun 03 08:33:37.851847 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:37.851847 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:37.852031 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f0f9ba57-524d-497e-8230-57c2fa447a6a {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:33:37.852031 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] For port e43bae4c-7900-439e-b7f0-47c23744c6f6, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:33:37.857614 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:37.893195 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port f0f9ba57-524d-497e-8230-57c2fa447a6a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=f0f9ba57-524d-497e-8230-57c2fa447a6a,segment=NetworkSegment(9559424d-973e-4a97-92a4-8a446b0a62b5),segment_id=9559424d-973e-4a97-92a4-8a446b0a62b5)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:33:37.895012 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] For port e43bae4c-7900-439e-b7f0-47c23744c6f6, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=e43bae4c-7900-439e-b7f0-47c23744c6f6,segment=NetworkSegment(eb60ee44-2fee-4938-bb69-42ff628ee059),segment_id=eb60ee44-2fee-4938-bb69-42ff628ee059)] {{(pid=92325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:33:37.919039 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port d52ae51a-5b28-450c-a58c-aff5122faf14, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=d52ae51a-5b28-450c-a58c-aff5122faf14,segment=NetworkSegment(8acb7a59-d9f0-4604-be49-ed0601f465ae),segment_id=8acb7a59-d9f0-4604-be49-ed0601f465ae)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:33:37.978007 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:37.980901 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:33:37.981235 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-e05eaaa8-64d4-42de-b214-8cb4ecc91820 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:37.984658 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:33:37.988573 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Received port after_create {{(pid=92324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:33:38.071780 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:38.074942 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:38.091390 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:38.097943 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=f0f9ba57-524d-497e-8230-57c2fa447a6a,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:38.107477 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:38.108170 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.021s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:38.228246 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Pushing event updated for resources: {'Port': ['ID=095583d3-03e5-4580-b9d0-ed2b9e85e4a7,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:38.263482 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=d52ae51a-5b28-450c-a58c-aff5122faf14,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:38.279352 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device ce979b40-484e-45cd-a6cb-a3940bb7a659 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:38.353433 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['f0f9ba57-524d-497e-8230-57c2fa447a6a'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:33:38.405021 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-812dc651-ad81-495f-80c6-4efcfdcb6068 req-aab50c26-528c-4e94-91ed-d3540d0182a2 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:38.407453 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-812dc651-ad81-495f-80c6-4efcfdcb6068 req-aab50c26-528c-4e94-91ed-d3540d0182a2 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 944 time: 0.1136811
Jun 03 08:33:38.521930 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.686s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:38.594389 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Pushing event updated for resources: {'Port': ['ID=e43bae4c-7900-439e-b7f0-47c23744c6f6,revision_number=2']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:38.609199 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.501s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:38.620756 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-52728fea-a257-4d4c-beb6-a303e864a57b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.534s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:38.621439 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-52728fea-a257-4d4c-beb6-a303e864a57b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.001s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:38.663374 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-812dc651-ad81-495f-80c6-4efcfdcb6068 req-b053ea89-ef98-48f3-94a0-aa1c49f20a7f tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2415867
Jun 03 08:33:38.674532 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port ce979b40-484e-45cd-a6cb-a3940bb7a659 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:38.674532 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:38.762317 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df6c8c2d-98dc-440e-a40c-7af9632917a0 req-4fd229b2-2b2e-4068-a056-a57e892918c5 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:38.780191 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-df6c8c2d-98dc-440e-a40c-7af9632917a0 req-4fd229b2-2b2e-4068-a056-a57e892918c5 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.7607269
Jun 03 08:33:38.870791 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-df6c8c2d-98dc-440e-a40c-7af9632917a0 req-4657d3b3-bc94-4234-ba52-6a993e23e2df tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0887175
Jun 03 08:33:38.956354 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee94f022-9966-4327-9396-b869f42cb0a8 req-3f8e16f1-aac2-4826-b5f1-45e6e5c3252f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:38.956354 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ee94f022-9966-4327-9396-b869f42cb0a8 req-3f8e16f1-aac2-4826-b5f1-45e6e5c3252f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1344385
Jun 03 08:33:38.999511 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ee94f022-9966-4327-9396-b869f42cb0a8 req-0c2dfcf2-dea2-4b4c-a538-72d675ae45f5 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0560787
Jun 03 08:33:39.211807 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:39.349962 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94aa79e5-ac0b-4236-aebb-592e1d52a90b req-a3258d04-0d85-4ad0-a833-4a9bbf64cd55 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:39.350622 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-94aa79e5-ac0b-4236-aebb-592e1d52a90b req-a3258d04-0d85-4ad0-a833-4a9bbf64cd55 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 944 time: 0.3122814
Jun 03 08:33:39.538391 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-94aa79e5-ac0b-4236-aebb-592e1d52a90b req-5f1c7ebb-214c-469c-a5d8-d06f73cc220c tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1709509
Jun 03 08:33:39.679649 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8afd66a-c9ca-4ef5-a09b-89ceaba6682d None None] Network 05b59006-52ce-4932-9534-4293d40c8ece requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:33:39.845016 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-16388099', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-16327774'] for router, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:39.986592 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-2da40cbb-616a-4f9c-a0f9-afba99594da2 None None] Provisioning for port e43bae4c-7900-439e-b7f0-47c23744c6f6 completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:33:39.995522 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad4da777-c430-479f-88a0-e22be1dd0560 req-cdb8f3e3-ff09-477e-a5f1-03cb079724cf tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:39.997851 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ad4da777-c430-479f-88a0-e22be1dd0560 req-cdb8f3e3-ff09-477e-a5f1-03cb079724cf tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 944 time: 0.1886816
Jun 03 08:33:40.079012 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ad4da777-c430-479f-88a0-e22be1dd0560 req-b63faca9-9bb8-4647-aaf3-d7b1f26812ed tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0702014
Jun 03 08:33:40.345981 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b78b4720-44f7-4f04-84d2-cc6227750489 req-b269cc98-61f3-41be-aa07-40774abfe24b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:40.356863 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b78b4720-44f7-4f04-84d2-cc6227750489 req-b269cc98-61f3-41be-aa07-40774abfe24b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.2094634
Jun 03 08:33:40.370905 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device d52ae51a-5b28-450c-a58c-aff5122faf14 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:40.424699 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b78b4720-44f7-4f04-84d2-cc6227750489 req-f510b627-4074-4050-96db-15235899f2b6 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0646834
Jun 03 08:33:40.475163 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-073325e4-707f-4fb3-8848-c88c4be761de req-d1e93b89-6967-42cf-aae1-ef38c040c027 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:40.487221 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-073325e4-707f-4fb3-8848-c88c4be761de req-d1e93b89-6967-42cf-aae1-ef38c040c027 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1914175
Jun 03 08:33:40.509824 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device f0f9ba57-524d-497e-8230-57c2fa447a6a up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:40.520637 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Router c27a2266-4ade-41da-82ca-580ead33a547 is scheduled to L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 with binding_index 1 {{(pid=92324) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 03 08:33:40.554711 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port d52ae51a-5b28-450c-a58c-aff5122faf14 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:40.555612 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:40.567431 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-073325e4-707f-4fb3-8848-c88c4be761de req-0d7e1774-00f1-422a-b26b-4b1b857d1ddb tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0789180
Jun 03 08:33:40.744560 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device e43bae4c-7900-439e-b7f0-47c23744c6f6 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:40.825308 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:33:40.836380 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] Sync routers for ids ['c27a2266-4ade-41da-82ca-580ead33a547'] in dv-cinder-787262-5-iscsi {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:33:40.850735 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] Routers {'c27a2266-4ade-41da-82ca-580ead33a547'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:33:40.851759 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae87a36040>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:33:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['c27a2266-4ade-41da-82ca-580ead33a547'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:40.870076 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning for port f0f9ba57-524d-497e-8230-57c2fa447a6a completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:33:40.876512 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port f0f9ba57-524d-497e-8230-57c2fa447a6a triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:40.876894 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:40.941421 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63883b43-8988-4852-a896-b7763a9a0d80 req-0ba67c97-ca1f-43a3-893a-6364d65406e3 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:40.944327 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-63883b43-8988-4852-a896-b7763a9a0d80 req-0ba67c97-ca1f-43a3-893a-6364d65406e3 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 944 time: 0.1164665
Jun 03 08:33:41.004276 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-63883b43-8988-4852-a896-b7763a9a0d80 req-41e17c01-6c31-4793-ab48-45ac53bdc673 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0536888
Jun 03 08:33:41.041724 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port e43bae4c-7900-439e-b7f0-47c23744c6f6 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:33:41.042932 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Notify callbacks [] for router, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:41.044423 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201  len: 920 time: 6.8391013
Jun 03 08:33:41.047240 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 50286) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:41.048777 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port e43bae4c-7900-439e-b7f0-47c23744c6f6 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:41.049209 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:41.089831 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:41.222277 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '94bade6e-3955-4228-b5ef-3ef8fb278f08', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f0f9ba57-524d-497e-8230-57c2fa447a6a'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:33:41.228733 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6940b831-ffd3-4eb5-928d-00ac0cb28425" -d '{"events": [{"server_uuid": "94bade6e-3955-4228-b5ef-3ef8fb278f08", "name": "network-vif-plugged", "status": "completed", "tag": "f0f9ba57-524d-497e-8230-57c2fa447a6a"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:33:41.294543 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port f0f9ba57-524d-497e-8230-57c2fa447a6a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=f0f9ba57-524d-497e-8230-57c2fa447a6a,segment=NetworkSegment(9559424d-973e-4a97-92a4-8a446b0a62b5),segment_id=9559424d-973e-4a97-92a4-8a446b0a62b5)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:33:41.312746 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] Set router c27a2266-4ade-41da-82ca-580ead33a547 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:33:41.420694 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:33:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7b23aaff-6e77-4d17-a72b-c8563b98e356 x-openstack-request-id: req-7b23aaff-6e77-4d17-a72b-c8563b98e356 {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:33:41.421059 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "94bade6e-3955-4228-b5ef-3ef8fb278f08", "name": "network-vif-plugged", "status": "completed", "tag": "f0f9ba57-524d-497e-8230-57c2fa447a6a", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:33:41.421453 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-7b23aaff-6e77-4d17-a72b-c8563b98e356 {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:33:41.421852 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '94bade6e-3955-4228-b5ef-3ef8fb278f08', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f0f9ba57-524d-497e-8230-57c2fa447a6a', 'code': 200}
Jun 03 08:33:41.434456 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:41.435359 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device ab26d5bb-6495-4c9b-b134-6612a997f201 up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:41.465127 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e9c9b9-6326-4343-afb1-d429a7797daa req-74917fb0-cde4-48da-bc6a-e276641f3af0 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:41.475987 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b8e9c9b9-6326-4343-afb1-d429a7797daa req-74917fb0-cde4-48da-bc6a-e276641f3af0 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 944 time: 0.1495705
Jun 03 08:33:41.567929 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b8e9c9b9-6326-4343-afb1-d429a7797daa req-7af51fc0-e475-4764-950d-078db40e314a tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0901146
Jun 03 08:33:41.637690 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-20577996-cc94-44e8-8114-647485d5ac28 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:41.756430 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:41.930563 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port e43bae4c-7900-439e-b7f0-47c23744c6f6, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=e43bae4c-7900-439e-b7f0-47c23744c6f6,segment=NetworkSegment(eb60ee44-2fee-4938-bb69-42ff628ee059),segment_id=eb60ee44-2fee-4938-bb69-42ff628ee059)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:33:41.974191 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=f0f9ba57-524d-497e-8230-57c2fa447a6a,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:41.988153 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.350s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:42.003273 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b5c864c-4f22-4586-9540-e18a5b483de5 req-bbaaeb10-a5e9-41ba-88a8-0ffd008bfd27 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:42.005512 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8b5c864c-4f22-4586-9540-e18a5b483de5 req-bbaaeb10-a5e9-41ba-88a8-0ffd008bfd27 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.2679253
Jun 03 08:33:42.023182 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae87a36040>, [{'id': 'c27a2266-4ade-41da-82ca-580ead33a547', 'name': 'tempest-TestShelveInstance-1063943176-router', 'tenant_id': '66cedbb00e294ca49bf37a7789202b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.10'}], 'enable_snat': True}, 'gw_port_id': '095583d3-03e5-4580-b9d0-ed2b9e85e4a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:34Z', 'updated_at': '2021-06-03T08:33:38Z', 'revision_number': 3, 'project_id': '66cedbb00e294ca49bf37a7789202b7f', 'gw_port': {'id': '095583d3-03e5-4580-b9d0-ed2b9e85e4a7', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:13:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c27a2266-4ade-41da-82ca-580ead33a547', 'device_owner': 'network:router_gateway', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:37Z', 'updated_at': '2021-06-03T08:33:37Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:42.041983 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] Checking router: c27a2266-4ade-41da-82ca-580ead33a547 for host: dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:33:42.042294 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] Updating router c27a2266-4ade-41da-82ca-580ead33a547 port 095583d3-03e5-4580-b9d0-ed2b9e85e4a7 binding host dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 03 08:33:42.075075 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:42.077331 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:42.161213 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:42.164526 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b24f8049-af84-4768-94f2-b4019332b32a req-46260f19-3d55-40e9-8d6c-bbe44ac408ee tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:42.166084 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b24f8049-af84-4768-94f2-b4019332b32a req-46260f19-3d55-40e9-8d6c-bbe44ac408ee tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.2842522
Jun 03 08:33:42.174818 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning for port ab26d5bb-6495-4c9b-b134-6612a997f201 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:33:42.214476 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port ab26d5bb-6495-4c9b-b134-6612a997f201 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:42.219058 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:42.224608 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c2aa643-1a4d-47d8-a66f-7d6ab0c3b2eb req-2cf99cd4-15bc-45cf-b39c-a57da57bba1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:42.226090 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8c2aa643-1a4d-47d8-a66f-7d6ab0c3b2eb req-2cf99cd4-15bc-45cf-b39c-a57da57bba1f service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 1098 time: 0.2596319
Jun 03 08:33:42.232169 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b24f8049-af84-4768-94f2-b4019332b32a req-2d7035ca-e665-407c-b417-813decaef0b6 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0530784
Jun 03 08:33:42.299290 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8b5c864c-4f22-4586-9540-e18a5b483de5 req-843a7d72-35fa-4dc1-96d6-4c54a375958b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1962483
Jun 03 08:33:42.305331 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8c2aa643-1a4d-47d8-a66f-7d6ab0c3b2eb req-7b3a11b4-b873-4f28-abc5-fd379c1dcab3 service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0707979
Jun 03 08:33:42.339089 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=e43bae4c-7900-439e-b7f0-47c23744c6f6,revision_number=3']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:42.349302 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.272s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:42.496072 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:42.567649 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port ab26d5bb-6495-4c9b-b134-6612a997f201, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=ab26d5bb-6495-4c9b-b134-6612a997f201,segment=NetworkSegment(6978222c-6678-416a-a506-1fa962d91d64),segment_id=6978222c-6678-416a-a506-1fa962d91d64)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:33:42.582809 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b344cc9a-7a79-451a-be1b-5242f2f7ab50 req-7410310b-5380-4914-b2d9-c421016a1e33 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:42.588946 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b344cc9a-7a79-451a-be1b-5242f2f7ab50 req-7410310b-5380-4914-b2d9-c421016a1e33 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 945 time: 0.1570544
Jun 03 08:33:42.673147 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b344cc9a-7a79-451a-be1b-5242f2f7ab50 req-e79ee79b-27ac-4526-8abf-49fdd2c6c186 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0797074
Jun 03 08:33:42.695181 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:42.695181 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:42.862114 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=ab26d5bb-6495-4c9b-b134-6612a997f201,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:42.875548 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:42.942899 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:42.961057 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] Notify callbacks [] for port, precommit_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:42.962268 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c04c3574-4200-46ae-8f54-f6e7ae9fcc46 req-99c731b3-3fe4-457c-b374-314663beba9e tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:42.964103 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c04c3574-4200-46ae-8f54-f6e7ae9fcc46 req-99c731b3-3fe4-457c-b374-314663beba9e tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 945 time: 0.1593335
Jun 03 08:33:43.004574 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.provisioning_blocks [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] Transition to ACTIVE for port object 095583d3-03e5-4580-b9d0-ed2b9e85e4a7 will not be triggered until provisioned by entity L2. {{(pid=92326) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:33:43.070556 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c04c3574-4200-46ae-8f54-f6e7ae9fcc46 req-cc214d90-eed3-4590-a53a-73f9c99ef48a tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0957077
Jun 03 08:33:43.162897 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:43.214228 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:43.422653 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7525b38b-62a4-4060-b8e8-f15c49408a7b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ab26d5bb-6495-4c9b-b134-6612a997f201'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:33:43.425027 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-13e5b955-9ff9-406f-84f9-11a87841e665" -d '{"events": [{"server_uuid": "7525b38b-62a4-4060-b8e8-f15c49408a7b", "name": "network-vif-plugged", "status": "completed", "tag": "ab26d5bb-6495-4c9b-b134-6612a997f201"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:33:43.442661 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcdb8e31-6d40-40da-80a1-dba89fb145fd None None] Pushing event updated for resources: {'Port': ['ID=095583d3-03e5-4580-b9d0-ed2b9e85e4a7,revision_number=2']} {{(pid=92326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:43.452084 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-bcdb8e31-6d40-40da-80a1-dba89fb145fd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.277s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:43.467154 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] Attempting to bind port 095583d3-03e5-4580-b9d0-ed2b9e85e4a7 on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:33:43.467524 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] Attempting to bind port 095583d3-03e5-4580-b9d0-ed2b9e85e4a7 by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}] {{(pid=92326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:33:43.467884 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] Attempting to bind port 095583d3-03e5-4580-b9d0-ed2b9e85e4a7 on network 684ef871-89aa-450d-ae0d-e232bfaf51fb {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:33:43.481930 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.db_base_plugin_common [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Allocated IP 172.20.0.1 (05b59006-52ce-4932-9534-4293d40c8ece/03214dfb-e3b6-4e72-b0b6-6d9e375b3f62/11f176f0-69e3-4e65-9c89-e099ea83fe6a) {{(pid=92324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:33:43.484650 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 33, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:33:43.485033 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] Checking segment: {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92326) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:33:43.485432 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:43.485823 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] Bound using segment: {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'} {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:33:43.486301 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] Bound port: 095583d3-03e5-4580-b9d0-ed2b9e85e4a7, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}}] {{(pid=92326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:33:43.486696 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:43.576846 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.db [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] For port 095583d3-03e5-4580-b9d0-ed2b9e85e4a7, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92326) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:33:43.581798 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.db [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] For port 095583d3-03e5-4580-b9d0-ed2b9e85e4a7, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=095583d3-03e5-4580-b9d0-ed2b9e85e4a7,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92326) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:33:43.780355 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f758f22-f572-44f3-8f3f-872bed54fa83 req-d74345de-72b8-4586-bfd4-3661f96453fd tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:43.780355 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8f758f22-f572-44f3-8f3f-872bed54fa83 req-d74345de-72b8-4586-bfd4-3661f96453fd tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1436510
Jun 03 08:33:43.781882 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Notify callbacks [] for port, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:43.797841 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.provisioning_blocks [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Transition to ACTIVE for port object 11f176f0-69e3-4e65-9c89-e099ea83fe6a will not be triggered until provisioned by entity DHCP. {{(pid=92324) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:33:43.812901 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8f758f22-f572-44f3-8f3f-872bed54fa83 req-8d4dadfd-1ecd-4e26-a829-209c10b14a04 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0684953
Jun 03 08:33:43.880261 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:33:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d9217eae-cac0-4e59-b879-163e34c48e2d x-openstack-request-id: req-d9217eae-cac0-4e59-b879-163e34c48e2d {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:33:43.880813 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7525b38b-62a4-4060-b8e8-f15c49408a7b", "name": "network-vif-plugged", "status": "completed", "tag": "ab26d5bb-6495-4c9b-b134-6612a997f201", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:33:43.880813 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-d9217eae-cac0-4e59-b879-163e34c48e2d {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:33:43.881331 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7525b38b-62a4-4060-b8e8-f15c49408a7b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ab26d5bb-6495-4c9b-b134-6612a997f201', 'code': 200}
Jun 03 08:33:43.942798 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a23c6529-8af9-4b65-b929-16f0a799b25d req-6dc1b72c-14f7-48a9-8710-86b9acc4dbe5 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:43.944810 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a23c6529-8af9-4b65-b929-16f0a799b25d req-6dc1b72c-14f7-48a9-8710-86b9acc4dbe5 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.1107037
Jun 03 08:33:43.992509 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a23c6529-8af9-4b65-b929-16f0a799b25d req-892dd711-0b74-478f-af5f-e7b346024de1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0416422
Jun 03 08:33:44.063379 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-726b0af9-ebd3-4d11-a93d-7574be102a89 req-50310c97-daac-4381-99f1-04f775a9e6d4 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:44.064847 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-726b0af9-ebd3-4d11-a93d-7574be102a89 req-50310c97-daac-4381-99f1-04f775a9e6d4 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 945 time: 0.0977013
Jun 03 08:33:44.115113 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:44.119238 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:44.120189 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-726b0af9-ebd3-4d11-a93d-7574be102a89 req-5f3b4b8c-7cb6-4a64-9f38-368794932690 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0489836
Jun 03 08:33:44.195904 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device e43bae4c-7900-439e-b7f0-47c23744c6f6 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:44.213238 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] Routers {'c27a2266-4ade-41da-82ca-580ead33a547'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:33:44.213946 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae87a36040>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:33:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['c27a2266-4ade-41da-82ca-580ead33a547'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:44.281651 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcdb8e31-6d40-40da-80a1-dba89fb145fd None None] Pushing event updated for resources: {'Port': ['ID=095583d3-03e5-4580-b9d0-ed2b9e85e4a7,revision_number=3']} {{(pid=92326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:44.286895 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-bcdb8e31-6d40-40da-80a1-dba89fb145fd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:44.287579 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port e43bae4c-7900-439e-b7f0-47c23744c6f6 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:44.288340 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:44.295624 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3c00f78-e1b5-4cda-817b-d75662855ec8 req-224e58ea-3194-4661-b029-f46961e640ba tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:44.297205 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a3c00f78-e1b5-4cda-817b-d75662855ec8 req-224e58ea-3194-4661-b029-f46961e640ba tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 945 time: 0.1140935
Jun 03 08:33:44.356599 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a3c00f78-e1b5-4cda-817b-d75662855ec8 req-c288fb36-b330-40b7-bcdd-717ece4637a0 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0520015
Jun 03 08:33:44.396298 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:44.401278 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:44.430200 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] Set router c27a2266-4ade-41da-82ca-580ead33a547 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:33:44.484146 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Network 05b59006-52ce-4932-9534-4293d40c8ece is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:33:44.487567 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:33:44.498744 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Received port after_create {{(pid=92324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:33:44.585660 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Pushing event updated for resources: {'Port': ['ID=11f176f0-69e3-4e65-9c89-e099ea83fe6a,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:44.604552 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:44.605177 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:44.605741 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:44.606270 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:44.611390 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:44.612335 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:44.612626 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:44.613143 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:44.613716 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:44.616198 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:44.616777 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:44.617302 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:44.623366 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:44.680392 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-16328800'] for router_interface, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:44.792311 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62ac9dc1-2ed6-4ced-92a0-f2eee978f7d1 req-0279bb56-555c-4a23-8f59-86bbe4de76b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:44.794565 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-62ac9dc1-2ed6-4ced-92a0-f2eee978f7d1 req-0279bb56-555c-4a23-8f59-86bbe4de76b2 service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 1098 time: 0.1255100
Jun 03 08:33:44.854716 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-62ac9dc1-2ed6-4ced-92a0-f2eee978f7d1 req-6f04ad49-d1b5-4ca0-992f-9de428030f93 service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0494030
Jun 03 08:33:44.907429 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae87a36040>, [{'id': 'c27a2266-4ade-41da-82ca-580ead33a547', 'name': 'tempest-TestShelveInstance-1063943176-router', 'tenant_id': '66cedbb00e294ca49bf37a7789202b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.10'}], 'enable_snat': True}, 'gw_port_id': '095583d3-03e5-4580-b9d0-ed2b9e85e4a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:34Z', 'updated_at': '2021-06-03T08:33:38Z', 'revision_number': 3, 'project_id': '66cedbb00e294ca49bf37a7789202b7f', 'gw_port': {'id': '095583d3-03e5-4580-b9d0-ed2b9e85e4a7', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:13:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c27a2266-4ade-41da-82ca-580ead33a547', 'device_owner': 'network:router_gateway', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:37Z', 'updated_at': '2021-06-03T08:33:43Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:44.921446 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0eea6d1-53a1-4041-9271-38fe417220ca None None] The sync data for ids ['c27a2266-4ade-41da-82ca-580ead33a547'] in dv-cinder-787262-5-iscsi is: [{'id': 'c27a2266-4ade-41da-82ca-580ead33a547', 'name': 'tempest-TestShelveInstance-1063943176-router', 'tenant_id': '66cedbb00e294ca49bf37a7789202b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.10'}], 'enable_snat': True}, 'gw_port_id': '095583d3-03e5-4580-b9d0-ed2b9e85e4a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:34Z', 'updated_at': '2021-06-03T08:33:38Z', 'revision_number': 3, 'project_id': '66cedbb00e294ca49bf37a7789202b7f', 'gw_port': {'id': '095583d3-03e5-4580-b9d0-ed2b9e85e4a7', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:13:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c27a2266-4ade-41da-82ca-580ead33a547', 'device_owner': 'network:router_gateway', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:37Z', 'updated_at': '2021-06-03T08:33:43Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}] {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:33:44.982897 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-05f15265-7829-488a-8b27-3bb499385d93 None None] Provisioning for port 11f176f0-69e3-4e65-9c89-e099ea83fe6a completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:33:44.997748 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-05f15265-7829-488a-8b27-3bb499385d93 None None] Provisioning complete for port 11f176f0-69e3-4e65-9c89-e099ea83fe6a triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:44.999409 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-05f15265-7829-488a-8b27-3bb499385d93 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:45.136364 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bbb4206-aff4-41c7-880b-86ef012a4e3e req-5807c68f-7487-4299-acba-ea5d0279c585 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:45.138304 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6bbb4206-aff4-41c7-880b-86ef012a4e3e req-5807c68f-7487-4299-acba-ea5d0279c585 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1412778
Jun 03 08:33:45.215216 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-05f15265-7829-488a-8b27-3bb499385d93 None None] Port 11f176f0-69e3-4e65-9c89-e099ea83fe6a cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:33:45.456292 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6bbb4206-aff4-41c7-880b-86ef012a4e3e req-b9f34528-fc2c-4233-9bb6-1205d0a66c33 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3073347
Jun 03 08:33:45.485128 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:45.499098 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9417b6f8-a598-48f6-8a66-c4bb16b81930 req-a996bfe1-54b5-4812-9325-b04574b2c60e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:45.500674 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9417b6f8-a598-48f6-8a66-c4bb16b81930 req-a996bfe1-54b5-4812-9325-b04574b2c60e service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d&tenant_id=36c42f532cd14f19811ffbee3a39a208 HTTP/1.1" status: 200  len: 1096 time: 0.2848632
Jun 03 08:33:45.513054 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7544f380-2da1-483d-b68d-4220ab8fb5ff req-d9817751-46d6-445c-96fd-4084efeefddc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:45.514619 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7544f380-2da1-483d-b68d-4220ab8fb5ff req-d9817751-46d6-445c-96fd-4084efeefddc service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 1099 time: 0.1760652
Jun 03 08:33:45.771779 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7544f380-2da1-483d-b68d-4220ab8fb5ff req-d8638fe7-cba9-4d9e-9de3-f5f0cac9ede4 service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2416902
Jun 03 08:33:45.789361 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3be38d51-f8c4-42d2-8a82-30c0880f4c2b req-9524dba8-4a1e-4ae3-b8a5-f48e8c51734c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:45.791705 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3be38d51-f8c4-42d2-8a82-30c0880f4c2b req-9524dba8-4a1e-4ae3-b8a5-f48e8c51734c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.5146537
Jun 03 08:33:45.838051 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9417b6f8-a598-48f6-8a66-c4bb16b81930 req-2a0546dd-5136-44e1-baeb-5930ea9edbd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:45.840199 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9417b6f8-a598-48f6-8a66-c4bb16b81930 req-2a0546dd-5136-44e1-baeb-5930ea9edbd1 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=36c42f532cd14f19811ffbee3a39a208&device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 1096 time: 0.2679262
Jun 03 08:33:45.854389 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-126752a2-e91d-4483-b8c4-820d3f58d9d4 req-6a55eb2f-3dc9-46e2-8814-2f664d84d805 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:45.858219 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-126752a2-e91d-4483-b8c4-820d3f58d9d4 req-6a55eb2f-3dc9-46e2-8814-2f664d84d805 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 945 time: 0.1981742
Jun 03 08:33:45.866586 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3be38d51-f8c4-42d2-8a82-30c0880f4c2b req-064fc3b5-4f3d-41e1-bbad-952545942c29 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0682039
Jun 03 08:33:45.875623 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Notify callbacks [] for port, precommit_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:46.007091 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15641369'] for port, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:46.055994 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9417b6f8-a598-48f6-8a66-c4bb16b81930 req-192cd5df-f0e2-446d-827e-3c0dd52b707f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:46.057500 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9417b6f8-a598-48f6-8a66-c4bb16b81930 req-192cd5df-f0e2-446d-827e-3c0dd52b707f service neutron] 10.222.0.55 "GET /v2.0/networks?id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba HTTP/1.1" status: 200  len: 918 time: 0.1980741
Jun 03 08:33:46.137871 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:46.322446 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-16344774', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-16328707'] for router_interface, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:46.326444 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Pushing event updated for resources: {'Port': ['ID=11f176f0-69e3-4e65-9c89-e099ea83fe6a,revision_number=2']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:46.331829 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.194s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:46.335076 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9417b6f8-a598-48f6-8a66-c4bb16b81930 req-e5d75bec-cba1-41e2-8d38-7f62685c97a4 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 HTTP/1.1" status: 200  len: 999 time: 0.2527514
Jun 03 08:33:46.362674 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 095583d3-03e5-4580-b9d0-ed2b9e85e4a7 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:46.473111 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-126752a2-e91d-4483-b8c4-820d3f58d9d4 req-e73eed80-d2ed-467a-9d49-0bc118bee680 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3873887
Jun 03 08:33:46.473111 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9417b6f8-a598-48f6-8a66-c4bb16b81930 req-9ac78192-09c9-4195-9f12-9076755acc76 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:46.473111 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9417b6f8-a598-48f6-8a66-c4bb16b81930 req-9ac78192-09c9-4195-9f12-9076755acc76 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=cff67a13-bc33-4d3e-a796-5829103ca25c HTTP/1.1" status: 200  len: 856 time: 0.0834937
Jun 03 08:33:46.524317 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13ca8fcd-12fc-440f-ad98-7229ad281c49 req-b475bbde-bb59-4c66-98ca-63d2bb875d7a tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:46.534324 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-13ca8fcd-12fc-440f-ad98-7229ad281c49 req-b475bbde-bb59-4c66-98ca-63d2bb875d7a tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 945 time: 0.4721305
Jun 03 08:33:46.600155 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9417b6f8-a598-48f6-8a66-c4bb16b81930 req-1ba5748d-02b0-44af-a47b-063708e64e59 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:46.601707 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9417b6f8-a598-48f6-8a66-c4bb16b81930 req-1ba5748d-02b0-44af-a47b-063708e64e59 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1167412
Jun 03 08:33:46.655389 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-13ca8fcd-12fc-440f-ad98-7229ad281c49 req-702ce5d5-cf64-4682-9dc7-3b47f02a76ec tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1195624
Jun 03 08:33:46.686350 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Network 05b59006-52ce-4932-9534-4293d40c8ece is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:33:46.688270 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:33:46.812060 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port 095583d3-03e5-4580-b9d0-ed2b9e85e4a7 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:33:46.825997 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 095583d3-03e5-4580-b9d0-ed2b9e85e4a7 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:46.826525 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:46.909367 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9417b6f8-a598-48f6-8a66-c4bb16b81930 req-6eba0252-1b2b-4643-bd25-ff2020a8e6c3 service neutron] 10.222.0.55 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2915804
Jun 03 08:33:47.018330 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Router c27a2266-4ade-41da-82ca-580ead33a547 has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:33:47.273061 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:47.287871 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-ff7286d1-918d-4f1c-805b-92caa351f9a8 None None] Provisioning complete for port 11f176f0-69e3-4e65-9c89-e099ea83fe6a triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:47.293428 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-ff7286d1-918d-4f1c-805b-92caa351f9a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:47.415643 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e59554fe-b2a9-4ac9-9ec4-4acc310c1483 req-d0f179ad-c15b-452f-8012-1065bf5dcb44 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:47.425763 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e59554fe-b2a9-4ac9-9ec4-4acc310c1483 req-d0f179ad-c15b-452f-8012-1065bf5dcb44 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.6648326
Jun 03 08:33:47.460837 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port 095583d3-03e5-4580-b9d0-ed2b9e85e4a7, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=095583d3-03e5-4580-b9d0-ed2b9e85e4a7,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:33:47.487187 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-ff7286d1-918d-4f1c-805b-92caa351f9a8 None None] Port 11f176f0-69e3-4e65-9c89-e099ea83fe6a cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:33:47.595221 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:47.604061 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-99e4a3ff-b7dd-4177-823b-bd0534070b5c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:47.605078 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e59554fe-b2a9-4ac9-9ec4-4acc310c1483 req-c3f880cd-0d3d-4f3a-84e7-e5b9b4fc9953 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1758134
Jun 03 08:33:47.611531 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9417b6f8-a598-48f6-8a66-c4bb16b81930 req-9bb2c388-75a6-4e14-a038-710c325fb29b service neutron] 10.222.0.55 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6940112
Jun 03 08:33:47.657098 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:33:47.668050 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72502344-9291-4ec2-854b-1141076c9dd4 req-6492ab81-4f87-47fd-9bfd-f009ec3db6ee tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:47.669897 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-72502344-9291-4ec2-854b-1141076c9dd4 req-6492ab81-4f87-47fd-9bfd-f009ec3db6ee tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.4818568
Jun 03 08:33:47.689698 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] 10.222.0.11 "PUT /v2.0/routers/c27a2266-4ade-41da-82ca-580ead33a547/add_router_interface HTTP/1.1" status: 200  len: 503 time: 6.6321800
Jun 03 08:33:47.790479 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=095583d3-03e5-4580-b9d0-ed2b9e85e4a7,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:47.799353 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:47.802279 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-72502344-9291-4ec2-854b-1141076c9dd4 req-2e2f57e0-3ab8-41c9-86ee-71157d9c7c15 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1194913
Jun 03 08:33:47.944660 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] Sync routers for ids ['c27a2266-4ade-41da-82ca-580ead33a547'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:33:47.966794 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] Routers {'c27a2266-4ade-41da-82ca-580ead33a547'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:33:47.967795 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86d84880>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:33:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['c27a2266-4ade-41da-82ca-580ead33a547'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:48.071028 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-549188e2-9315-47f2-9e60-2529abce115d req-34896994-8028-44e9-8ef7-841aa20e3d99 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:48.078711 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-549188e2-9315-47f2-9e60-2529abce115d req-34896994-8028-44e9-8ef7-841aa20e3d99 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 945 time: 0.1883245
Jun 03 08:33:48.166073 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-549188e2-9315-47f2-9e60-2529abce115d req-97dbde14-d800-401a-b405-9ede5aac08f1 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0862260
Jun 03 08:33:48.263658 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 095583d3-03e5-4580-b9d0-ed2b9e85e4a7 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:48.407109 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] Set router c27a2266-4ade-41da-82ca-580ead33a547 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:33:48.787186 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 095583d3-03e5-4580-b9d0-ed2b9e85e4a7 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:48.787186 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:49.156218 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 50410) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:49.228879 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-805455383', 'description': 'tempest-secgroup-smoke-805455383 description', 'project_id': '0e5e096a327f421e9b0a02235740cc36'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:49.239705 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:49.244338 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Usage tracker for resource:security_group and tenant:0e5e096a327f421e9b0a02235740cc36 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:49.247721 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:49.280392 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:49.313733 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86d84880>, [{'id': 'c27a2266-4ade-41da-82ca-580ead33a547', 'name': 'tempest-TestShelveInstance-1063943176-router', 'tenant_id': '66cedbb00e294ca49bf37a7789202b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.10'}], 'enable_snat': True}, 'gw_port_id': '095583d3-03e5-4580-b9d0-ed2b9e85e4a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:34Z', 'updated_at': '2021-06-03T08:33:44Z', 'revision_number': 4, 'project_id': '66cedbb00e294ca49bf37a7789202b7f', 'gw_port': {'id': '095583d3-03e5-4580-b9d0-ed2b9e85e4a7', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:13:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c27a2266-4ade-41da-82ca-580ead33a547', 'device_owner': 'network:router_gateway', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:37Z', 'updated_at': '2021-06-03T08:33:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '11f176f0-69e3-4e65-9c89-e099ea83fe6a', 'name': '', 'network_id': '05b59006-52ce-4932-9534-4293d40c8ece', 'tenant_id': '66cedbb00e294ca49bf37a7789202b7f', 'mac_address': 'fa:16:3e:6c:38:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c27a2266-4ade-41da-82ca-580ead33a547', 'device_owner': 'network:router_interface', 'standard_attr_id': 416, 'fixed_ips': [{'subnet_id': '03214dfb-e3b6-4e72-b0b6-6d9e375b3f62', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:43Z', 'updated_at': '2021-06-03T08:33:45Z', 'revision_number': 2, 'project_id': '66cedbb00e294ca49bf37a7789202b7f', 'subnets': [{'id': '03214dfb-e3b6-4e72-b0b6-6d9e375b3f62', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:49.329117 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] Checking router: c27a2266-4ade-41da-82ca-580ead33a547 for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:33:49.329417 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] Updating router c27a2266-4ade-41da-82ca-580ead33a547 port 11f176f0-69e3-4e65-9c89-e099ea83fe6a binding host dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 03 08:33:49.393180 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:49.745978 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] Notify callbacks [] for port, precommit_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:49.759625 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] Transition to ACTIVE for port object 11f176f0-69e3-4e65-9c89-e099ea83fe6a will not be triggered until provisioned by entity L2. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:33:50.382985 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:50.414613 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:50.419118 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Usage tracker for resource:security_group_rule and tenant:0e5e096a327f421e9b0a02235740cc36 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:50.422240 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:50.428884 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:50.499162 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:50.538578 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:50.543859 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-8258f603-c73d-4af9-9330-d5179534d3d0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:50.744365 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-413fa614-603e-4020-a053-720fef8e9f68 None None] Pushing event updated for resources: {'Port': ['ID=11f176f0-69e3-4e65-9c89-e099ea83fe6a,revision_number=3']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:50.760077 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:50.771385 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:50.813226 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-413fa614-603e-4020-a053-720fef8e9f68 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.269s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:50.943780 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] Attempting to bind port 11f176f0-69e3-4e65-9c89-e099ea83fe6a on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:33:50.944685 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] Attempting to bind port 11f176f0-69e3-4e65-9c89-e099ea83fe6a by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': 'eb60ee44-2fee-4938-bb69-42ff628ee059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '05b59006-52ce-4932-9534-4293d40c8ece'}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:33:50.945607 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] Attempting to bind port 11f176f0-69e3-4e65-9c89-e099ea83fe6a on network 05b59006-52ce-4932-9534-4293d40c8ece {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:33:50.963599 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 33, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:33:50.964402 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] Checking segment: {'id': 'eb60ee44-2fee-4938-bb69-42ff628ee059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '05b59006-52ce-4932-9534-4293d40c8ece'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:33:50.965260 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:50.965972 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] Bound using segment: {'id': 'eb60ee44-2fee-4938-bb69-42ff628ee059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '05b59006-52ce-4932-9534-4293d40c8ece'} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:33:50.967893 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] Bound port: 11f176f0-69e3-4e65-9c89-e099ea83fe6a, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'eb60ee44-2fee-4938-bb69-42ff628ee059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 524, 'network_id': '05b59006-52ce-4932-9534-4293d40c8ece'}}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:33:50.968732 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:50.996902 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c0e8810d-eeaf-4d32-941d-aa11dff38d92,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:51.014536 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:51.014909 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:51.015240 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:51.015580 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:51.015917 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:51.016476 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:51.016818 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:51.017273 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:51.017834 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:51.018173 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:51.018519 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:51.019060 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:33:51.027843 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.256s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:51.058716 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:51.061249 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1792 time: 1.9029610
Jun 03 08:33:51.063978 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 50422) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:51.070410 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-f01aa4bc-6713-4f75-9b56-b1da46423491 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Request body: {'security_group_rule': {'security_group_id': 'c0e8810d-eeaf-4d32-941d-aa11dff38d92', 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:51.085434 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-f01aa4bc-6713-4f75-9b56-b1da46423491 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:51.101674 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f2737d9-0eca-4d60-8e37-27059f0e0923 req-42d50734-1d8a-4c6a-929c-66faf12fb00f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:51.108778 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-f01aa4bc-6713-4f75-9b56-b1da46423491 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Usage tracker for resource:security_group_rule and tenant:0e5e096a327f421e9b0a02235740cc36 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:51.111587 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8f2737d9-0eca-4d60-8e37-27059f0e0923 req-42d50734-1d8a-4c6a-929c-66faf12fb00f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.2643905
Jun 03 08:33:51.125805 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-f01aa4bc-6713-4f75-9b56-b1da46423491 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:51.143425 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-f01aa4bc-6713-4f75-9b56-b1da46423491 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:51.146538 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] For port 11f176f0-69e3-4e65-9c89-e099ea83fe6a, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:33:51.152692 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] For port 11f176f0-69e3-4e65-9c89-e099ea83fe6a, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=11f176f0-69e3-4e65-9c89-e099ea83fe6a,segment=NetworkSegment(eb60ee44-2fee-4938-bb69-42ff628ee059),segment_id=eb60ee44-2fee-4938-bb69-42ff628ee059)] {{(pid=92325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:33:51.182260 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8f2737d9-0eca-4d60-8e37-27059f0e0923 req-4a71ef1f-c3e9-448d-a973-f4d676664575 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0683243
Jun 03 08:33:51.293041 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:51.299952 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:51.337039 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f01aa4bc-6713-4f75-9b56-b1da46423491 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:51.394831 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] Routers {'c27a2266-4ade-41da-82ca-580ead33a547'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:33:51.396530 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86d84880>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:33:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['c27a2266-4ade-41da-82ca-580ead33a547'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:51.400733 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-500b2b19-5ad1-4930-b36f-e317a1b83e96 req-6d60d143-3984-4554-a88a-3c79f93c3205 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:51.400929 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeb5be88-5173-4308-b3a1-6828b625a05c req-72efd52d-3ef6-46f0-892c-52b35631af8b tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:51.402998 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-eeb5be88-5173-4308-b3a1-6828b625a05c req-72efd52d-3ef6-46f0-892c-52b35631af8b tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 946 time: 0.0871394
Jun 03 08:33:51.407709 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-500b2b19-5ad1-4930-b36f-e317a1b83e96 req-6d60d143-3984-4554-a88a-3c79f93c3205 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.1486108
Jun 03 08:33:51.479799 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-413fa614-603e-4020-a053-720fef8e9f68 None None] Pushing event updated for resources: {'Port': ['ID=11f176f0-69e3-4e65-9c89-e099ea83fe6a,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:51.485679 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-eeb5be88-5173-4308-b3a1-6828b625a05c req-8d08b4da-dc4c-47ab-bff5-faa7a98630e4 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0704010
Jun 03 08:33:51.491339 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-413fa614-603e-4020-a053-720fef8e9f68 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:51.499126 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-500b2b19-5ad1-4930-b36f-e317a1b83e96 req-bae329c8-998d-4ffe-94bc-29b5daf71fed tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0848844
Jun 03 08:33:51.505858 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f01aa4bc-6713-4f75-9b56-b1da46423491 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:51.638104 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f01aa4bc-6713-4f75-9b56-b1da46423491 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:51.638104 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:51.699291 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f01aa4bc-6713-4f75-9b56-b1da46423491 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=20f1e0df-6524-41e5-a6cb-b30d43a5b785,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:51.726762 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f01aa4bc-6713-4f75-9b56-b1da46423491 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:51.727765 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] Set router c27a2266-4ade-41da-82ca-580ead33a547 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:33:51.871755 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f01aa4bc-6713-4f75-9b56-b1da46423491 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:51.871755 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-f01aa4bc-6713-4f75-9b56-b1da46423491 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.8056393
Jun 03 08:33:51.874189 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 50434) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:51.879508 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-8ee641ab-55c0-4cb6-9d59-77e37c6377d2 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Request body: {'security_group_rule': {'security_group_id': 'c0e8810d-eeaf-4d32-941d-aa11dff38d92', 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:51.890704 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-8ee641ab-55c0-4cb6-9d59-77e37c6377d2 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:51.896938 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-8ee641ab-55c0-4cb6-9d59-77e37c6377d2 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Usage tracker for resource:security_group_rule and tenant:0e5e096a327f421e9b0a02235740cc36 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:51.901219 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-8ee641ab-55c0-4cb6-9d59-77e37c6377d2 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:51.906465 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a4b75c4-4f75-462f-8235-2a062b066201 req-cf02a277-d875-492d-aa92-5091f0ff4d27 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:51.909119 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2a4b75c4-4f75-462f-8235-2a062b066201 req-cf02a277-d875-492d-aa92-5091f0ff4d27 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 945 time: 0.1019683
Jun 03 08:33:51.909330 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-8ee641ab-55c0-4cb6-9d59-77e37c6377d2 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:51.983075 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2a4b75c4-4f75-462f-8235-2a062b066201 req-ac765547-b0d8-4950-8583-1b5e7ccd90c5 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0672934
Jun 03 08:33:52.033677 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8ee641ab-55c0-4cb6-9d59-77e37c6377d2 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:52.135734 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8ee641ab-55c0-4cb6-9d59-77e37c6377d2 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:52.199229 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86d84880>, [{'id': 'c27a2266-4ade-41da-82ca-580ead33a547', 'name': 'tempest-TestShelveInstance-1063943176-router', 'tenant_id': '66cedbb00e294ca49bf37a7789202b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.10'}], 'enable_snat': True}, 'gw_port_id': '095583d3-03e5-4580-b9d0-ed2b9e85e4a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:34Z', 'updated_at': '2021-06-03T08:33:44Z', 'revision_number': 4, 'project_id': '66cedbb00e294ca49bf37a7789202b7f', 'gw_port': {'id': '095583d3-03e5-4580-b9d0-ed2b9e85e4a7', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:13:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c27a2266-4ade-41da-82ca-580ead33a547', 'device_owner': 'network:router_gateway', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:37Z', 'updated_at': '2021-06-03T08:33:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '11f176f0-69e3-4e65-9c89-e099ea83fe6a', 'name': '', 'network_id': '05b59006-52ce-4932-9534-4293d40c8ece', 'tenant_id': '66cedbb00e294ca49bf37a7789202b7f', 'mac_address': 'fa:16:3e:6c:38:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c27a2266-4ade-41da-82ca-580ead33a547', 'device_owner': 'network:router_interface', 'standard_attr_id': 416, 'fixed_ips': [{'subnet_id': '03214dfb-e3b6-4e72-b0b6-6d9e375b3f62', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:43Z', 'updated_at': '2021-06-03T08:33:51Z', 'revision_number': 4, 'project_id': '66cedbb00e294ca49bf37a7789202b7f', 'subnets': [{'id': '03214dfb-e3b6-4e72-b0b6-6d9e375b3f62', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:33:52.203350 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f42d0d0b-2568-4af8-a2b3-03c576256f7c None None] The sync data for ids ['c27a2266-4ade-41da-82ca-580ead33a547'] in dv-cinder-787262-5-iscsi is: [{'id': 'c27a2266-4ade-41da-82ca-580ead33a547', 'name': 'tempest-TestShelveInstance-1063943176-router', 'tenant_id': '66cedbb00e294ca49bf37a7789202b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.10'}], 'enable_snat': True}, 'gw_port_id': '095583d3-03e5-4580-b9d0-ed2b9e85e4a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:34Z', 'updated_at': '2021-06-03T08:33:44Z', 'revision_number': 4, 'project_id': '66cedbb00e294ca49bf37a7789202b7f', 'gw_port': {'id': '095583d3-03e5-4580-b9d0-ed2b9e85e4a7', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:13:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c27a2266-4ade-41da-82ca-580ead33a547', 'device_owner': 'network:router_gateway', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:37Z', 'updated_at': '2021-06-03T08:33:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '11f176f0-69e3-4e65-9c89-e099ea83fe6a', 'name': '', 'network_id': '05b59006-52ce-4932-9534-4293d40c8ece', 'tenant_id': '66cedbb00e294ca49bf37a7789202b7f', 'mac_address': 'fa:16:3e:6c:38:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c27a2266-4ade-41da-82ca-580ead33a547', 'device_owner': 'network:router_interface', 'standard_attr_id': 416, 'fixed_ips': [{'subnet_id': '03214dfb-e3b6-4e72-b0b6-6d9e375b3f62', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:43Z', 'updated_at': '2021-06-03T08:33:51Z', 'revision_number': 4, 'project_id': '66cedbb00e294ca49bf37a7789202b7f', 'subnets': [{'id': '03214dfb-e3b6-4e72-b0b6-6d9e375b3f62', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:33:52.281117 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8ee641ab-55c0-4cb6-9d59-77e37c6377d2 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:52.283857 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:52.314463 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ee641ab-55c0-4cb6-9d59-77e37c6377d2 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9f61836f-3620-46c5-a391-d4c68cd9823c,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:52.318676 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-8ee641ab-55c0-4cb6-9d59-77e37c6377d2 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:52.478039 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5c43de2-6961-4d22-9f84-24caf96f2b99 req-d4bf21fc-c353-4236-96c0-2da31d00c07e tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:52.480574 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8ee641ab-55c0-4cb6-9d59-77e37c6377d2 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:52.485211 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-8ee641ab-55c0-4cb6-9d59-77e37c6377d2 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.6092558
Jun 03 08:33:52.485378 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b5c43de2-6961-4d22-9f84-24caf96f2b99 req-d4bf21fc-c353-4236-96c0-2da31d00c07e tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.2608116
Jun 03 08:33:52.485832 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 50458) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:52.501072 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-04edfe5a-6f41-4f64-b18b-88dcf8a8d86b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Request body: {'security_group_rule': {'security_group_id': 'c0e8810d-eeaf-4d32-941d-aa11dff38d92', 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:52.508083 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-04edfe5a-6f41-4f64-b18b-88dcf8a8d86b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:52.519531 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-04edfe5a-6f41-4f64-b18b-88dcf8a8d86b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Usage tracker for resource:security_group_rule and tenant:0e5e096a327f421e9b0a02235740cc36 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:52.525650 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-04edfe5a-6f41-4f64-b18b-88dcf8a8d86b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:52.541779 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b5c43de2-6961-4d22-9f84-24caf96f2b99 req-1b11dc0d-9d2c-4b5e-9b2c-22153062d395 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0558612
Jun 03 08:33:52.541957 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-04edfe5a-6f41-4f64-b18b-88dcf8a8d86b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:52.694114 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-04edfe5a-6f41-4f64-b18b-88dcf8a8d86b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:52.970390 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-868177a9-69fd-4a81-bfca-93f13fcff31a req-13ac7ccc-90e6-4802-b9d7-3f3699af35e0 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:52.975661 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-868177a9-69fd-4a81-bfca-93f13fcff31a req-13ac7ccc-90e6-4802-b9d7-3f3699af35e0 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 946 time: 0.1908319
Jun 03 08:33:53.084906 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-868177a9-69fd-4a81-bfca-93f13fcff31a req-e03807e8-0623-4d6e-bf4a-3ff017833605 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1027491
Jun 03 08:33:53.150722 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-04edfe5a-6f41-4f64-b18b-88dcf8a8d86b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:53.287435 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-04edfe5a-6f41-4f64-b18b-88dcf8a8d86b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:53.290010 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-759c0ea3-1358-4f01-b607-43761bcef660 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:53.321624 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:33:53.330992 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-665f7de4-8f87-4597-9882-73018b753d01 req-c211c1e8-4533-4d22-bbac-eeee707f969b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:53.333375 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-665f7de4-8f87-4597-9882-73018b753d01 req-c211c1e8-4533-4d22-bbac-eeee707f969b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.1348059
Jun 03 08:33:53.356862 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04edfe5a-6f41-4f64-b18b-88dcf8a8d86b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e0fd600f-49fb-4e12-a669-029834d33800,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:53.372573 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-04edfe5a-6f41-4f64-b18b-88dcf8a8d86b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:53.432229 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-665f7de4-8f87-4597-9882-73018b753d01 req-da9b20a8-b810-48fd-8919-0230035bf8d9 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0923588
Jun 03 08:33:53.474339 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-04edfe5a-6f41-4f64-b18b-88dcf8a8d86b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:53.476067 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-04edfe5a-6f41-4f64-b18b-88dcf8a8d86b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.9884624
Jun 03 08:33:53.479105 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 50488) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:53.492642 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-db9f2e45-877d-459c-837e-016242ac7d4a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Request body: {'security_group_rule': {'security_group_id': 'c0e8810d-eeaf-4d32-941d-aa11dff38d92', 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:53.507561 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-db9f2e45-877d-459c-837e-016242ac7d4a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:53.517705 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-db9f2e45-877d-459c-837e-016242ac7d4a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Usage tracker for resource:security_group_rule and tenant:0e5e096a327f421e9b0a02235740cc36 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:53.527107 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-db9f2e45-877d-459c-837e-016242ac7d4a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:53.540718 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-db9f2e45-877d-459c-837e-016242ac7d4a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:53.572836 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b14fc2bf-baf1-46d6-915a-3a81d9a03e1d req-ef17ddd0-e214-44f5-b34f-2c850c86a49e tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:53.574825 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b14fc2bf-baf1-46d6-915a-3a81d9a03e1d req-ef17ddd0-e214-44f5-b34f-2c850c86a49e tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 945 time: 0.1700115
Jun 03 08:33:53.636410 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b14fc2bf-baf1-46d6-915a-3a81d9a03e1d req-a674ac38-e1c2-4cce-bd46-53dcf58b8a85 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0543630
Jun 03 08:33:53.731540 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-db9f2e45-877d-459c-837e-016242ac7d4a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:53.868395 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e04c47c-df16-47ae-a401-68c83f7faeb5 req-58077220-9760-4a33-b296-69ff9a5a842f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:53.887856 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2e04c47c-df16-47ae-a401-68c83f7faeb5 req-58077220-9760-4a33-b296-69ff9a5a842f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1436565
Jun 03 08:33:53.951233 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-db9f2e45-877d-459c-837e-016242ac7d4a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:53.959651 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2e04c47c-df16-47ae-a401-68c83f7faeb5 req-ccb258ce-011d-408a-b618-3d5d50aff68d tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0701046
Jun 03 08:33:54.006925 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-d6855d32-5e29-413b-911d-31fe128efcd8 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:54.022300 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-d6855d32-5e29-413b-911d-31fe128efcd8 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/networks?id=113ded30-096c-4860-8773-fb717f3ea4c6 HTTP/1.1" status: 200  len: 814 time: 0.3794258
Jun 03 08:33:54.143525 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-27eff72b-d59f-4c8b-be2b-72b7e76a30cf tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/quotas/96a989a900784d61a1475d86dd209c5f HTTP/1.1" status: 200  len: 375 time: 0.0094514
Jun 03 08:33:54.175274 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-f35eff7a-443e-4f40-b6fd-1ebf7ab7b872 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=96a989a900784d61a1475d86dd209c5f&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1288080
Jun 03 08:33:54.275168 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 11f176f0-69e3-4e65-9c89-e099ea83fe6a up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:54.431766 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d70d55f8-322d-4d79-ba9f-6e599806fb4a req-e8057bd2-8084-4e29-bbca-fb658168d22f tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:54.433983 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d70d55f8-322d-4d79-ba9f-6e599806fb4a req-e8057bd2-8084-4e29-bbca-fb658168d22f tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 946 time: 0.1361213
Jun 03 08:33:54.459103 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-8b9bb7d6-e297-4ffc-b0eb-acbd4301b096 service neutron] 10.222.0.11 "GET /v2.0/networks/113ded30-096c-4860-8773-fb717f3ea4c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2787378
Jun 03 08:33:54.485425 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-db9f2e45-877d-459c-837e-016242ac7d4a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:54.493085 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c66ace08-28aa-4b6d-9085-0c719d035f81 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:54.501448 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d70d55f8-322d-4d79-ba9f-6e599806fb4a req-60c86094-a9f0-4e63-a260-9bda7484fb6d tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0513051
Jun 03 08:33:54.605832 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db9f2e45-877d-459c-837e-016242ac7d4a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1fac3100-2872-4191-9e9f-bd209b8b1b75,revision_number=0']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:54.612183 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-db9f2e45-877d-459c-837e-016242ac7d4a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:54.656296 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-e8286875-3f6e-49ce-9ee6-727123ca672e service neutron] 10.222.0.11 "GET /v2.0/networks/113ded30-096c-4860-8773-fb717f3ea4c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1908870
Jun 03 08:33:54.702384 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ee9c664-f7f5-4b51-b587-21f01cd4bc05 req-df67cda7-ea0b-4136-8f80-da041926dd31 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:54.710004 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8ee9c664-f7f5-4b51-b587-21f01cd4bc05 req-df67cda7-ea0b-4136-8f80-da041926dd31 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0902822
Jun 03 08:33:54.765376 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8ee9c664-f7f5-4b51-b587-21f01cd4bc05 req-19fe494b-0e86-47a3-97a3-e9c8e715e18b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0544741
Jun 03 08:33:54.863540 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port 11f176f0-69e3-4e65-9c89-e099ea83fe6a completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:33:54.863927 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-db9f2e45-877d-459c-837e-016242ac7d4a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:54.867262 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-db9f2e45-877d-459c-837e-016242ac7d4a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 1.3844059
Jun 03 08:33:54.868252 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 50512) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:54.869373 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 11f176f0-69e3-4e65-9c89-e099ea83fe6a triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:54.869842 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:54.872887 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-b90eb328-02ed-4e45-94b5-e7aa06f1ec64 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Request body: {'security_group_rule': {'security_group_id': 'c0e8810d-eeaf-4d32-941d-aa11dff38d92', 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:54.879518 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-b90eb328-02ed-4e45-94b5-e7aa06f1ec64 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:54.886318 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-b90eb328-02ed-4e45-94b5-e7aa06f1ec64 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Usage tracker for resource:security_group_rule and tenant:0e5e096a327f421e9b0a02235740cc36 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:54.887865 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-b90eb328-02ed-4e45-94b5-e7aa06f1ec64 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:54.914968 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-b90eb328-02ed-4e45-94b5-e7aa06f1ec64 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:55.026106 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:55.067455 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30d689b1-dc68-43be-ad13-5c930d3b79f1 req-44cca35b-5ddd-4180-880b-cf1e4175227a tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:55.069170 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-30d689b1-dc68-43be-ad13-5c930d3b79f1 req-44cca35b-5ddd-4180-880b-cf1e4175227a tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 945 time: 0.1963973
Jun 03 08:33:55.084550 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port 11f176f0-69e3-4e65-9c89-e099ea83fe6a, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=11f176f0-69e3-4e65-9c89-e099ea83fe6a,segment=NetworkSegment(eb60ee44-2fee-4938-bb69-42ff628ee059),segment_id=eb60ee44-2fee-4938-bb69-42ff628ee059)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:33:55.144278 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.db.securitygroups_db [None req-b90eb328-02ed-4e45-94b5-e7aa06f1ec64 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Project 0e5e096a327f421e9b0a02235740cc36 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 03 08:33:55.151107 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-30d689b1-dc68-43be-ad13-5c930d3b79f1 req-d9bbbf80-a726-40c1-88c7-c487e54392ba tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0757599
Jun 03 08:33:55.163741 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b90eb328-02ed-4e45-94b5-e7aa06f1ec64 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:55.180754 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4eed8449-478d-4a0a-8420-1d6313c2b428 req-48c169f1-319e-4057-b15e-1e7641f3ba73 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 210 time: 0.0854471
Jun 03 08:33:55.257566 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b90eb328-02ed-4e45-94b5-e7aa06f1ec64 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:55.343490 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:55.351372 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-e05eaaa8-64d4-42de-b214-8cb4ecc91820 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:55.360619 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b90eb328-02ed-4e45-94b5-e7aa06f1ec64 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:55.368826 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:55.390192 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b90eb328-02ed-4e45-94b5-e7aa06f1ec64 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f8704414-0d68-438f-b097-929daabf2d4e,revision_number=0']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:55.393286 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b90eb328-02ed-4e45-94b5-e7aa06f1ec64 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:55.399787 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af5bb83f-afb2-4b40-bb79-81dcfa8ddd30 req-dbee3c56-9f4b-49fd-8aca-6bb4d799d808 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:55.409011 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-af5bb83f-afb2-4b40-bb79-81dcfa8ddd30 req-dbee3c56-9f4b-49fd-8aca-6bb4d799d808 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1138535
Jun 03 08:33:55.462941 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-af5bb83f-afb2-4b40-bb79-81dcfa8ddd30 req-881e9830-572f-464e-9e1b-1195342152f9 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0504410
Jun 03 08:33:55.467454 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=11f176f0-69e3-4e65-9c89-e099ea83fe6a,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:55.496175 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:55.498135 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b90eb328-02ed-4e45-94b5-e7aa06f1ec64 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:55.499847 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-b90eb328-02ed-4e45-94b5-e7aa06f1ec64 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.6305671
Jun 03 08:33:55.502776 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 50542) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:33:55.508816 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-62c9e840-e2b8-48d3-a7cf-503dc82c764c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Request body: {'security_group_rule': {'security_group_id': 'c0e8810d-eeaf-4d32-941d-aa11dff38d92', 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:33:55.522871 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-62c9e840-e2b8-48d3-a7cf-503dc82c764c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:33:55.527061 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-62c9e840-e2b8-48d3-a7cf-503dc82c764c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Usage tracker for resource:security_group_rule and tenant:0e5e096a327f421e9b0a02235740cc36 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:33:55.530473 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-62c9e840-e2b8-48d3-a7cf-503dc82c764c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:33:55.537722 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-62c9e840-e2b8-48d3-a7cf-503dc82c764c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:33:55.708799 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dec11c2a-9a83-4e5d-a074-f21aa45d0ff4 req-9f983996-9628-4fa9-9709-2189c9fa2a6f tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:55.710256 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-dec11c2a-9a83-4e5d-a074-f21aa45d0ff4 req-9f983996-9628-4fa9-9709-2189c9fa2a6f tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 946 time: 0.0940361
Jun 03 08:33:55.765331 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-dec11c2a-9a83-4e5d-a074-f21aa45d0ff4 req-237dbf2e-eb3d-44e7-963e-d6d7af549e16 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0477195
Jun 03 08:33:55.852030 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.securitygroups_db [None req-62c9e840-e2b8-48d3-a7cf-503dc82c764c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Project 0e5e096a327f421e9b0a02235740cc36 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 03 08:33:55.858176 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-62c9e840-e2b8-48d3-a7cf-503dc82c764c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:56.031446 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-62c9e840-e2b8-48d3-a7cf-503dc82c764c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:56.048579 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dd0cab8-327f-4d39-af94-97e0dc67f201 req-150fbc79-3750-4e2a-bcee-11293229e7c2 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:56.050040 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0dd0cab8-327f-4d39-af94-97e0dc67f201 req-150fbc79-3750-4e2a-bcee-11293229e7c2 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.1407077
Jun 03 08:33:56.109509 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0dd0cab8-327f-4d39-af94-97e0dc67f201 req-6e712a33-5733-4cbb-a76d-f15ade00278a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0533702
Jun 03 08:33:56.192706 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 11f176f0-69e3-4e65-9c89-e099ea83fe6a up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:33:56.247868 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-62c9e840-e2b8-48d3-a7cf-503dc82c764c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:56.248299 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:33:56.281782 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:56.306544 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 11f176f0-69e3-4e65-9c89-e099ea83fe6a triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:33:56.307078 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:56.368051 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-7f659d5c-2973-4be4-9351-ff02c459c039 req-cee607db-6dfb-44ea-a0c4-dcb50135b9ae tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Synchronizing usage tracker for tenant:96a989a900784d61a1475d86dd209c5f on resource:port {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:33:56.375644 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-62c9e840-e2b8-48d3-a7cf-503dc82c764c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:33:56.383370 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-62c9e840-e2b8-48d3-a7cf-503dc82c764c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.8730702
Jun 03 08:33:56.383370 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62c9e840-e2b8-48d3-a7cf-503dc82c764c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ec86ccb9-2dd5-4180-920d-20ebc76c2cc8,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:33:56.383370 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-62c9e840-e2b8-48d3-a7cf-503dc82c764c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:33:56.484198 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d58e2a9-a178-43f0-9f66-6f3665627ccc req-920610fc-3636-4934-9aee-a4aefc7bdd77 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:56.485854 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4d58e2a9-a178-43f0-9f66-6f3665627ccc req-920610fc-3636-4934-9aee-a4aefc7bdd77 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 945 time: 0.1159623
Jun 03 08:33:56.537174 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4d58e2a9-a178-43f0-9f66-6f3665627ccc req-fb1a9a4d-4931-42e3-8085-802dbb67733f tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0444677
Jun 03 08:33:56.640361 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-7f659d5c-2973-4be4-9351-ff02c459c039 req-cee607db-6dfb-44ea-a0c4-dcb50135b9ae tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Unset dirty status for tenant:96a989a900784d61a1475d86dd209c5f on resource:port {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:33:56.641543 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-7f659d5c-2973-4be4-9351-ff02c459c039 req-cee607db-6dfb-44ea-a0c4-dcb50135b9ae tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 210 time: 0.3582160
Jun 03 08:33:56.722544 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a8d33bb-2a72-450c-8022-ff4d3fb0bb49 req-c486a7a2-532a-4279-91ac-f150a3427a29 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:56.724095 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0a8d33bb-2a72-450c-8022-ff4d3fb0bb49 req-c486a7a2-532a-4279-91ac-f150a3427a29 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.0852792
Jun 03 08:33:56.777633 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0a8d33bb-2a72-450c-8022-ff4d3fb0bb49 req-15da74c6-eb2a-43e8-8aa0-bcf41aa58fc2 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0418818
Jun 03 08:33:56.985909 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ece7d96e-8e0d-4f30-ae79-cf90b69484e1 req-a21783d3-87fb-419b-b0c5-ad1453368f25 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:56.987452 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ece7d96e-8e0d-4f30-ae79-cf90b69484e1 req-a21783d3-87fb-419b-b0c5-ad1453368f25 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 946 time: 0.0899146
Jun 03 08:33:57.043876 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ece7d96e-8e0d-4f30-ae79-cf90b69484e1 req-fca2d896-3bef-44b5-89c9-24a84f68d20e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0495739
Jun 03 08:33:57.356977 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f0b35ed-2083-4a96-9a65-25372b487db0 req-33399a9d-01f6-4940-a637-0da4e5bb6a13 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:57.358645 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3f0b35ed-2083-4a96-9a65-25372b487db0 req-33399a9d-01f6-4940-a637-0da4e5bb6a13 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0974441
Jun 03 08:33:57.409967 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3f0b35ed-2083-4a96-9a65-25372b487db0 req-34805ea3-d48a-44b5-b2bc-84635efce435 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0450611
Jun 03 08:33:57.812107 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1942ba92-41d8-4ca2-b3e9-0e760cb1bcee req-d1bd23cf-ae0a-4d36-a764-8b39fa58e3a1 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:57.819930 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-1942ba92-41d8-4ca2-b3e9-0e760cb1bcee req-d1bd23cf-ae0a-4d36-a764-8b39fa58e3a1 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 945 time: 0.1476307
Jun 03 08:33:57.839816 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d223ce39-3ad0-4efb-9416-a4c058f7db27 req-f1e3d6ed-763d-40e2-b93b-a8f4bc74a49f tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 210 time: 0.0621519
Jun 03 08:33:57.948587 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-1942ba92-41d8-4ca2-b3e9-0e760cb1bcee req-2ce7c8d9-8e91-47a4-a1d6-de048cc41cd0 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1275067
Jun 03 08:33:58.107325 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3a4c762-dd92-42d6-a7d4-51fb90f01793 req-c56dcdcd-0926-4eb3-ad76-d8b7aba529a6 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:58.110782 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c3a4c762-dd92-42d6-a7d4-51fb90f01793 req-c56dcdcd-0926-4eb3-ad76-d8b7aba529a6 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1165292
Jun 03 08:33:58.184008 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c3a4c762-dd92-42d6-a7d4-51fb90f01793 req-a2de24aa-aa00-4976-b32a-ba9f62513b8d tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0660048
Jun 03 08:33:58.313808 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0edae45-0430-4bf3-858c-da3ee905d3b3 req-2cdaf707-545c-48fe-b401-817db4e3aef4 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:58.315705 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a0edae45-0430-4bf3-858c-da3ee905d3b3 req-2cdaf707-545c-48fe-b401-817db4e3aef4 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 946 time: 0.1112695
Jun 03 08:33:58.380596 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a0edae45-0430-4bf3-858c-da3ee905d3b3 req-c6ffb774-d0c6-46b1-9be9-e64c5f31ca70 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0529189
Jun 03 08:33:58.639274 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f6c0ec3-ad18-4827-b525-66d9b069d000 req-b6485569-f5fd-40d3-90d7-37d44f43406e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:58.640918 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7f6c0ec3-ad18-4827-b525-66d9b069d000 req-b6485569-f5fd-40d3-90d7-37d44f43406e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0857036
Jun 03 08:33:58.689007 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7f6c0ec3-ad18-4827-b525-66d9b069d000 req-6da614b7-6e81-4f0e-a12a-f005a090e32e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0419025
Jun 03 08:33:58.996782 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2c1cec44-09f0-4d30-bd50-83d497cccc62 req-6c283882-6adb-41d3-834d-abd44460d531 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 210 time: 0.0468919
Jun 03 08:33:59.219897 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b2c60de-860a-499b-ba1b-bdc17f1d2ece req-b857a811-30cc-4ee0-8ba7-ac703c9e41ec tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:59.222370 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8b2c60de-860a-499b-ba1b-bdc17f1d2ece req-b857a811-30cc-4ee0-8ba7-ac703c9e41ec tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 945 time: 0.0987880
Jun 03 08:33:59.287275 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8b2c60de-860a-499b-ba1b-bdc17f1d2ece req-80f04baf-7447-46cb-8e4d-0aba8cdbd130 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0545554
Jun 03 08:33:59.397914 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d300b21f-45e2-4295-822c-ab0c7f9e846a req-a62063c2-6091-4cc3-8e15-267f133b9814 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:59.400222 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d300b21f-45e2-4295-822c-ab0c7f9e846a req-a62063c2-6091-4cc3-8e15-267f133b9814 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.0874043
Jun 03 08:33:59.470900 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d300b21f-45e2-4295-822c-ab0c7f9e846a req-7daa43ad-a558-4b43-9587-c0db2bf5673e tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0643501
Jun 03 08:33:59.624269 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1beea889-a608-423e-89ae-a6cfe154581a req-c7ea2514-b338-4650-8f13-6281cc7934d5 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:59.625895 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1beea889-a608-423e-89ae-a6cfe154581a req-c7ea2514-b338-4650-8f13-6281cc7934d5 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 946 time: 0.0884714
Jun 03 08:33:59.684623 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1beea889-a608-423e-89ae-a6cfe154581a req-fbc95c16-4760-465c-973a-1d097fa9b893 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0517068
Jun 03 08:33:59.892150 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc754eda-6050-4626-b897-c6b60fd48323 req-fbfa95b5-59f2-417a-bc15-ea69e41d722e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:33:59.893544 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-fc754eda-6050-4626-b897-c6b60fd48323 req-fbfa95b5-59f2-417a-bc15-ea69e41d722e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0846019
Jun 03 08:33:59.940857 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-fc754eda-6050-4626-b897-c6b60fd48323 req-4065e5e0-2425-4ca2-a0ce-32aa2ca237b3 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0410843
Jun 03 08:34:00.154998 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-97288d8e-8b74-469a-9e81-61d7b8100a52 req-36eaddde-f6c7-4afd-8551-a6151b1245c7 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 210 time: 0.0448782
Jun 03 08:34:00.488324 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-416657c7-b11e-49e0-9490-3d5b6dfe5278 req-3b9870c1-40e9-4df5-8d98-5447e43da593 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:00.492589 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-416657c7-b11e-49e0-9490-3d5b6dfe5278 req-3b9870c1-40e9-4df5-8d98-5447e43da593 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 945 time: 0.0916746
Jun 03 08:34:00.540531 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-416657c7-b11e-49e0-9490-3d5b6dfe5278 req-2ed9b625-78cc-4127-912b-f40ca106c94f tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433748
Jun 03 08:34:00.692437 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0adb113c-9ce5-4281-8e0c-34402673df6a req-3426bbb7-1e77-4ad6-bb0b-031dea64365b tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:00.694072 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0adb113c-9ce5-4281-8e0c-34402673df6a req-3426bbb7-1e77-4ad6-bb0b-031dea64365b tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1073246
Jun 03 08:34:00.752577 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0adb113c-9ce5-4281-8e0c-34402673df6a req-d78a8e53-9885-470d-9890-2132553a9195 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0524998
Jun 03 08:34:00.906625 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1be20eb-d02b-442c-a194-261a7012fc12 req-621545a3-6655-4095-83a0-cb6cfcfd3dd6 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:00.946335 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c1be20eb-d02b-442c-a194-261a7012fc12 req-621545a3-6655-4095-83a0-cb6cfcfd3dd6 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 946 time: 0.1075077
Jun 03 08:34:00.967259 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c1be20eb-d02b-442c-a194-261a7012fc12 req-3de875ba-8dd7-4dcf-a0e7-ca033fe538f6 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0525463
Jun 03 08:34:01.172909 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb151da0-390d-4667-be28-3c2fac13f5d3 req-005bb669-4694-4890-8fb9-2d66b6a0b24e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:01.174523 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-bb151da0-390d-4667-be28-3c2fac13f5d3 req-005bb669-4694-4890-8fb9-2d66b6a0b24e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0932772
Jun 03 08:34:01.226330 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-bb151da0-390d-4667-be28-3c2fac13f5d3 req-06e41ad8-1709-4a41-b180-5d1afa9ca7c3 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0449564
Jun 03 08:34:01.329451 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a67e696c-d7fe-4fd6-a0f5-1eb0ae892af1 req-7bae7fff-6827-42a6-a9db-bb7f2de1113b tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 210 time: 0.0596268
Jun 03 08:34:01.733225 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a0705d0-2bdb-488e-92f2-dadda151b4d2 req-b968651d-a084-4743-9f0f-a90a6cba4b2e tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:01.734741 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1a0705d0-2bdb-488e-92f2-dadda151b4d2 req-b968651d-a084-4743-9f0f-a90a6cba4b2e tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 945 time: 0.0854285
Jun 03 08:34:01.795480 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1a0705d0-2bdb-488e-92f2-dadda151b4d2 req-8a9593de-5300-4e4b-b4ae-e1407dece42e tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0542300
Jun 03 08:34:01.974848 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faa6bca0-892e-44eb-ae3e-ec2914d1ddad req-7f04d0f7-499f-442a-996b-1cae1f0144a9 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:01.976257 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-faa6bca0-892e-44eb-ae3e-ec2914d1ddad req-7f04d0f7-499f-442a-996b-1cae1f0144a9 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.0882146
Jun 03 08:34:02.029861 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-faa6bca0-892e-44eb-ae3e-ec2914d1ddad req-7fabed3a-462a-45fe-9a9d-be5ea488a71d tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0458422
Jun 03 08:34:02.172483 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61cbb72f-6637-4176-8b13-f2e6d6d3eae6 req-11363483-d0f4-4e0d-ae80-dda186fb4304 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:02.179266 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-61cbb72f-6637-4176-8b13-f2e6d6d3eae6 req-11363483-d0f4-4e0d-ae80-dda186fb4304 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 946 time: 0.0906172
Jun 03 08:34:02.222076 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-61cbb72f-6637-4176-8b13-f2e6d6d3eae6 req-dd2f9699-f869-45f4-946d-7b165cea2c04 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403230
Jun 03 08:34:02.502801 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8ccbf673-e98a-4d53-9bb3-4dc817d92d0a req-2b164cfb-f4c9-41bb-a22b-d81663311483 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 210 time: 0.0664680
Jun 03 08:34:02.521197 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9082df86-32f4-4581-b748-7538cb669563 req-c0fba804-3566-4f3b-9704-5b3fdd2b5819 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:02.522696 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-9082df86-32f4-4581-b748-7538cb669563 req-c0fba804-3566-4f3b-9704-5b3fdd2b5819 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.1666296
Jun 03 08:34:02.525992 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-f4bd141e-d35e-451a-802e-09b4f4f93d45 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:02.579246 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-9082df86-32f4-4581-b748-7538cb669563 req-40dd32a4-ab46-49e3-8089-3fe4a99eba96 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0497365
Jun 03 08:34:03.074260 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0daf34a-8e96-4f95-80f7-80f00627aa0e req-3143fcc8-f6d3-4db2-9053-1aeba99a5171 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:03.075883 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d0daf34a-8e96-4f95-80f7-80f00627aa0e req-3143fcc8-f6d3-4db2-9053-1aeba99a5171 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 945 time: 0.1696553
Jun 03 08:34:03.151507 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d0daf34a-8e96-4f95-80f7-80f00627aa0e req-68de87b5-19cb-402a-a21e-dad49ae2fed4 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0689216
Jun 03 08:34:03.282752 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1d9785d-55d0-4930-9a01-6dab91ed0645 req-24aa1bcb-254a-4f05-81f9-de2caa735382 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:03.284410 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d1d9785d-55d0-4930-9a01-6dab91ed0645 req-24aa1bcb-254a-4f05-81f9-de2caa735382 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.0974462
Jun 03 08:34:03.338396 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d1d9785d-55d0-4930-9a01-6dab91ed0645 req-deea1737-169b-4139-88b3-1d8bc3de3035 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0467069
Jun 03 08:34:03.440639 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b20109c-a0ef-4f63-8c1f-1b4de0dc2c7b req-0c4d2134-0b29-4a92-ac75-39e25277cc55 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:03.443072 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4b20109c-a0ef-4f63-8c1f-1b4de0dc2c7b req-0c4d2134-0b29-4a92-ac75-39e25277cc55 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 946 time: 0.0907226
Jun 03 08:34:03.490803 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4b20109c-a0ef-4f63-8c1f-1b4de0dc2c7b req-dd1a6ce6-03dc-4b3a-9357-b10029a6221a tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0415242
Jun 03 08:34:03.675751 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-83fc3536-c28d-47b7-882d-7fd1f7ca9a86 req-2381a179-2a3f-490c-a19b-4e77e352340f tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 210 time: 0.0602276
Jun 03 08:34:03.797675 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b306fe0f-689c-486d-83a2-e6af22545d4a req-2abfc707-6baa-4f4c-85bc-037c8b14b80b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:03.800157 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b306fe0f-689c-486d-83a2-e6af22545d4a req-2abfc707-6baa-4f4c-85bc-037c8b14b80b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0933180
Jun 03 08:34:03.851331 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b306fe0f-689c-486d-83a2-e6af22545d4a req-fff5593a-a6fa-4517-9e15-72179cc0b196 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0451038
Jun 03 08:34:04.365768 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0694f03d-0348-4efd-98d0-0b5c2a02b1b8 req-d5083f91-a8f8-4ba6-95f1-722f7a87e0fe tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:04.374481 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0694f03d-0348-4efd-98d0-0b5c2a02b1b8 req-d5083f91-a8f8-4ba6-95f1-722f7a87e0fe tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 945 time: 0.0934055
Jun 03 08:34:04.422526 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0694f03d-0348-4efd-98d0-0b5c2a02b1b8 req-217d5f8d-fb17-489a-8934-dfc810638481 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0471222
Jun 03 08:34:04.560230 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76182df5-82e9-45d3-8750-c025d2ad06b0 req-5597cf05-7f3e-4b2c-97ba-6755a782fd79 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:04.561779 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-76182df5-82e9-45d3-8750-c025d2ad06b0 req-5597cf05-7f3e-4b2c-97ba-6755a782fd79 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.0858228
Jun 03 08:34:04.609078 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-76182df5-82e9-45d3-8750-c025d2ad06b0 req-e2dfa85d-17cd-4ddd-b9b5-10f3a5bf4d81 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408187
Jun 03 08:34:04.696049 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64ba11a5-8158-45be-bbee-a806cf0859fd req-81f2124e-8f69-4994-83b7-8caeb97dc12f tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:04.697539 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-64ba11a5-8158-45be-bbee-a806cf0859fd req-81f2124e-8f69-4994-83b7-8caeb97dc12f tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 946 time: 0.0918448
Jun 03 08:34:04.746335 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-64ba11a5-8158-45be-bbee-a806cf0859fd req-a46d3fb1-a2ff-4e5c-b10b-01135fe9b29f tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0431113
Jun 03 08:34:04.839867 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-76d71d20-704e-43f1-953b-c0e88cc3c809 req-f4cb2359-3aa7-4fd6-b332-1bfda82e4fae tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 210 time: 0.0437729
Jun 03 08:34:04.869049 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:05.123213 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-390806e7-0d8b-4bf5-be4a-c6b89ef1c85b req-086a3ef8-7365-4d65-9806-510863df1b96 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:05.124912 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-390806e7-0d8b-4bf5-be4a-c6b89ef1c85b req-086a3ef8-7365-4d65-9806-510863df1b96 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.1264887
Jun 03 08:34:05.180694 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-390806e7-0d8b-4bf5-be4a-c6b89ef1c85b req-bec1d2b9-b099-4a03-b295-a4f8f132a8e0 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0450308
Jun 03 08:34:05.246129 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-433a25df-f35c-46d8-91f8-a1f274e5238c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:05.625523 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97d5db93-5e5b-4db0-b109-70eb92e3a5f6 req-356ef902-c96d-4ed5-887a-58a08bef4051 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:05.627200 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-97d5db93-5e5b-4db0-b109-70eb92e3a5f6 req-356ef902-c96d-4ed5-887a-58a08bef4051 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 945 time: 0.0896862
Jun 03 08:34:05.683115 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-97d5db93-5e5b-4db0-b109-70eb92e3a5f6 req-bf9b076d-8638-45be-8c92-086ce6ecbb44 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0487251
Jun 03 08:34:05.853389 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aeb292f-260d-49b1-bc79-1e4859b67d51 req-db732c6d-c4bc-458c-9a08-4887f92988d4 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:05.854912 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-1aeb292f-260d-49b1-bc79-1e4859b67d51 req-db732c6d-c4bc-458c-9a08-4887f92988d4 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1151071
Jun 03 08:34:05.904285 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-1aeb292f-260d-49b1-bc79-1e4859b67d51 req-920f4991-626f-4fb2-a3f0-4863b56a5f4c tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0439091
Jun 03 08:34:05.952963 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eb5ca37-d2f6-48be-b4cd-af14e8fea476 req-fa7cd816-791c-4089-ab59-5b572fefe524 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:05.954511 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3eb5ca37-d2f6-48be-b4cd-af14e8fea476 req-fa7cd816-791c-4089-ab59-5b572fefe524 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 946 time: 0.0905290
Jun 03 08:34:06.006426 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3eb5ca37-d2f6-48be-b4cd-af14e8fea476 req-ee5f7b68-4e62-4ecf-a9cf-20ca23dd9366 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0454850
Jun 03 08:34:06.080451 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-81462703-792f-4fda-96cd-c23d1bbd1775 req-459637d1-25b9-454f-81d3-5efd6ea5ef12 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 210 time: 0.0532753
Jun 03 08:34:06.200713 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:06.395906 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c80615d3-e49a-4a4f-bd91-44171dc1b06c req-32d4cc2f-7d55-48b6-bf24-808d0f8af828 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:06.397476 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c80615d3-e49a-4a4f-bd91-44171dc1b06c req-32d4cc2f-7d55-48b6-bf24-808d0f8af828 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0915275
Jun 03 08:34:06.443869 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c80615d3-e49a-4a4f-bd91-44171dc1b06c req-e050ca6c-995b-48c8-8ed4-27445f446e4c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0403571
Jun 03 08:34:06.905802 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d791f812-151d-45ea-9e75-41d3d8671c25 req-8d7c82ba-a07a-482f-8d1f-a0dddf62c884 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:06.907508 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d791f812-151d-45ea-9e75-41d3d8671c25 req-8d7c82ba-a07a-482f-8d1f-a0dddf62c884 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 945 time: 0.0854437
Jun 03 08:34:06.975526 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d791f812-151d-45ea-9e75-41d3d8671c25 req-49b0fc57-2c11-4be4-b1dc-6e70f960c31e tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0614977
Jun 03 08:34:07.154285 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65de01d1-1c2f-46c5-a63f-4f812a79ed4b req-1a4e94c2-c8b7-4857-8385-f2d0a88c8f74 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:07.156916 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-65de01d1-1c2f-46c5-a63f-4f812a79ed4b req-1a4e94c2-c8b7-4857-8385-f2d0a88c8f74 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1228251
Jun 03 08:34:07.207932 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-65de01d1-1c2f-46c5-a63f-4f812a79ed4b req-b3ce5675-93a7-4245-b92c-e927bae89bd0 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0434284
Jun 03 08:34:07.231191 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3adfb048-53bf-4140-8622-bc9525f1ccfb req-0888eff6-90e6-47de-be81-5c1d19f55ea3 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:07.239345 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3adfb048-53bf-4140-8622-bc9525f1ccfb req-0888eff6-90e6-47de-be81-5c1d19f55ea3 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 946 time: 0.0983753
Jun 03 08:34:07.286877 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3adfb048-53bf-4140-8622-bc9525f1ccfb req-652fdb1d-fffc-4b82-b547-28c8431cefa9 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0460641
Jun 03 08:34:07.373241 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-97136649-5936-4cbb-97c1-03568c8d4032 req-7a9829f7-87f2-46bd-bfe0-c2674ab761aa tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 210 time: 0.0449979
Jun 03 08:34:07.540030 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc9f1ca4-374c-4aeb-9e58-fa2f1ef19c2f req-27a16408-3c76-4b4f-aa9d-54302ec30902 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:07.541567 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fc9f1ca4-374c-4aeb-9e58-fa2f1ef19c2f req-27a16408-3c76-4b4f-aa9d-54302ec30902 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=b9cf7834ca79439981d1f8e77b89daed&device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 1099 time: 0.0775399
Jun 03 08:34:07.648343 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-528006fd-9f94-46a1-8b50-f4e0219c0d9e req-3a7df222-0a0c-4b79-89dd-cd52215aef54 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:07.650336 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-528006fd-9f94-46a1-8b50-f4e0219c0d9e req-3a7df222-0a0c-4b79-89dd-cd52215aef54 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0890408
Jun 03 08:34:07.698710 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-528006fd-9f94-46a1-8b50-f4e0219c0d9e req-e5c6b8c7-76e3-4917-b436-42921f3faf19 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0425000
Jun 03 08:34:07.714870 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc9f1ca4-374c-4aeb-9e58-fa2f1ef19c2f req-b975acb1-cf0e-49cf-96b3-5040e20a1794 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:07.716274 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fc9f1ca4-374c-4aeb-9e58-fa2f1ef19c2f req-b975acb1-cf0e-49cf-96b3-5040e20a1794 service neutron] 10.222.0.55 "GET /v2.0/networks?id=6861b4db-6cd2-4a5b-bf02-87826345c933 HTTP/1.1" status: 200  len: 920 time: 0.1676378
Jun 03 08:34:07.795111 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fc9f1ca4-374c-4aeb-9e58-fa2f1ef19c2f req-3bf29f54-6797-4aa7-8bfa-555d9de7d513 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=716f2131-2965-4ead-984f-8ccfcadea071 HTTP/1.1" status: 200  len: 217 time: 0.0716217
Jun 03 08:34:07.887259 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc9f1ca4-374c-4aeb-9e58-fa2f1ef19c2f req-7217b30e-6d70-451c-8cbe-702a826e6e4f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:07.887259 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fc9f1ca4-374c-4aeb-9e58-fa2f1ef19c2f req-7217b30e-6d70-451c-8cbe-702a826e6e4f service neutron] 10.222.0.55 "GET /v2.0/subnets?id=0ea4966f-f9de-4d69-a774-7746b1ee12ee HTTP/1.1" status: 200  len: 859 time: 0.0757613
Jun 03 08:34:07.951509 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fc9f1ca4-374c-4aeb-9e58-fa2f1ef19c2f req-81906330-cd1b-4133-b1de-e986424f5375 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=6861b4db-6cd2-4a5b-bf02-87826345c933&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0540855
Jun 03 08:34:08.028941 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:08.151989 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fc9f1ca4-374c-4aeb-9e58-fa2f1ef19c2f req-3315f1e7-875e-46b2-8708-63a33d71c230 service neutron] 10.222.0.55 "GET /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1898479
Jun 03 08:34:08.413503 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08f1dabb-c58a-46b9-a67f-75315cbab2f2 req-a9626d94-c581-436f-adbf-95d41afb5f3f tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:08.415829 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-08f1dabb-c58a-46b9-a67f-75315cbab2f2 req-a9626d94-c581-436f-adbf-95d41afb5f3f tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 945 time: 0.2993538
Jun 03 08:34:08.417922 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fc9f1ca4-374c-4aeb-9e58-fa2f1ef19c2f req-3e316982-1821-4b8e-9510-6d012813eafa service neutron] 10.222.0.55 "GET /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2521672
Jun 03 08:34:08.433992 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a0f3934-7482-4270-8297-085ab669190d req-42290038-4b2b-4bbe-b261-8ad5010d0b58 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:08.436360 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3a0f3934-7482-4270-8297-085ab669190d req-42290038-4b2b-4bbe-b261-8ad5010d0b58 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1072168
Jun 03 08:34:08.479529 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-08f1dabb-c58a-46b9-a67f-75315cbab2f2 req-5fd59f41-3398-4558-945a-3036737f6ae7 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0519333
Jun 03 08:34:08.501364 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3a0f3934-7482-4270-8297-085ab669190d req-46909815-fa88-4679-b9ae-a179293c740c tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0521300
Jun 03 08:34:08.642562 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-fdccef34-9ef6-44c2-9854-b2326f4cc7be req-cd136303-dc96-42f4-a146-59faa8e0e366 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 210 time: 0.0417078
Jun 03 08:34:08.686577 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caa7de0a-451c-4b51-8dd5-9e967689a3fb req-6844a826-2d10-477b-be96-b0eaff230282 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:08.688066 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-caa7de0a-451c-4b51-8dd5-9e967689a3fb req-6844a826-2d10-477b-be96-b0eaff230282 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 946 time: 0.0880158
Jun 03 08:34:08.747887 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-caa7de0a-451c-4b51-8dd5-9e967689a3fb req-97530d47-ab3a-4943-9a7a-afca01d49629 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0532968
Jun 03 08:34:08.917345 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7db028ff-c12a-476d-8038-fbcd034b9322 req-83342ec3-2ea0-4bfb-a337-0e3666842ac7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:08.918724 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-7db028ff-c12a-476d-8038-fbcd034b9322 req-83342ec3-2ea0-4bfb-a337-0e3666842ac7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0894954
Jun 03 08:34:08.966226 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-7db028ff-c12a-476d-8038-fbcd034b9322 req-e993363f-25e8-4e46-9aef-f857ad2b1339 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0418134
Jun 03 08:34:09.241632 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-17588e70-a0fd-40ba-ab69-27761fe2349f req-e4e206d1-3ed3-4683-b194-4d5e05e1e161 service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0902190
Jun 03 08:34:09.399194 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adaad5db-1b3b-4ba2-a2c9-1318d137af36 req-363d5fb2-2ea0-488e-873f-03ac65fc421d tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:09.400727 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-adaad5db-1b3b-4ba2-a2c9-1318d137af36 req-363d5fb2-2ea0-488e-873f-03ac65fc421d tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.55 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 945 time: 0.1481466
Jun 03 08:34:09.403809 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17588e70-a0fd-40ba-ab69-27761fe2349f req-a3789ef2-5539-4975-8106-2608e1159b85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:09.405364 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-17588e70-a0fd-40ba-ab69-27761fe2349f req-a3789ef2-5539-4975-8106-2608e1159b85 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=755371c3d9de4747a47ba62e4d101829&device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 1098 time: 0.1214893
Jun 03 08:34:09.450768 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-744a500e-c907-416e-98d6-92ed4e17da82 req-47ed7b0a-0046-4497-98e8-335216ebb423 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:09.452402 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-744a500e-c907-416e-98d6-92ed4e17da82 req-47ed7b0a-0046-4497-98e8-335216ebb423 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.55 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 946 time: 0.1029832
Jun 03 08:34:09.636340 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [req-744a500e-c907-416e-98d6-92ed4e17da82 req-42e0780c-7efe-4dd7-a443-dc03105b28e1 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Deleting port 6a3181af-0127-4cce-b71a-90b9c83c8f88 {{(pid=92324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:34:09.637097 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-744a500e-c907-416e-98d6-92ed4e17da82 req-42e0780c-7efe-4dd7-a443-dc03105b28e1 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:09.752019 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17588e70-a0fd-40ba-ab69-27761fe2349f req-e8fd21f9-8ca8-424f-af5c-58d2f4439dbd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:09.753619 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-17588e70-a0fd-40ba-ab69-27761fe2349f req-e8fd21f9-8ca8-424f-af5c-58d2f4439dbd service neutron] 10.222.0.55 "GET /v2.0/networks?id=020eaa43-2d59-46e1-8aec-0a688069f72b HTTP/1.1" status: 200  len: 912 time: 0.3030398
Jun 03 08:34:09.755305 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-adaad5db-1b3b-4ba2-a2c9-1318d137af36 req-2846eee4-0eaf-42d3-8f04-da05f5d66cdf tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Deleting port f0f9ba57-524d-497e-8230-57c2fa447a6a {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:34:09.755650 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-adaad5db-1b3b-4ba2-a2c9-1318d137af36 req-2846eee4-0eaf-42d3-8f04-da05f5d66cdf tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:09.871464 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.db [req-744a500e-c907-416e-98d6-92ed4e17da82 req-42e0780c-7efe-4dd7-a443-dc03105b28e1 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] For port 6a3181af-0127-4cce-b71a-90b9c83c8f88, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=6a3181af-0127-4cce-b71a-90b9c83c8f88,segment=NetworkSegment(9923ac74-9556-45ec-9044-43728d2a8ec3),segment_id=9923ac74-9556-45ec-9044-43728d2a8ec3)] {{(pid=92324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:34:09.871829 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-744a500e-c907-416e-98d6-92ed4e17da82 req-42e0780c-7efe-4dd7-a443-dc03105b28e1 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:09.893372 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43b5cd43-0812-42f2-8fc0-fbc7ac7b1259 req-8aa71fae-93ae-4ecd-a5de-90d60a13c2e5 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:09.895656 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-43b5cd43-0812-42f2-8fc0-fbc7ac7b1259 req-8aa71fae-93ae-4ecd-a5de-90d60a13c2e5 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.2261865
Jun 03 08:34:10.026069 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-17588e70-a0fd-40ba-ab69-27761fe2349f req-e275c03f-ac44-44a0-8570-3178ae77bd68 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=19f733be-bd85-43df-86fd-5a9c617b3df4 HTTP/1.1" status: 200  len: 1001 time: 0.2335236
Jun 03 08:34:10.113037 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [req-744a500e-c907-416e-98d6-92ed4e17da82 req-42e0780c-7efe-4dd7-a443-dc03105b28e1 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Calling delete_port for 6a3181af-0127-4cce-b71a-90b9c83c8f88 owned by compute:nova {{(pid=92324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:34:10.151058 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-43b5cd43-0812-42f2-8fc0-fbc7ac7b1259 req-30970327-1f3b-4bef-9731-dfaa04948cc3 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2050014
Jun 03 08:34:10.205977 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeded868-1f58-440c-ba9d-67f2b01401f1 req-27ffcff8-f093-41dc-8663-1f367caf7c28 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:10.208113 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-aeded868-1f58-440c-ba9d-67f2b01401f1 req-27ffcff8-f093-41dc-8663-1f367caf7c28 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 945 time: 0.5344832
Jun 03 08:34:10.236820 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-adaad5db-1b3b-4ba2-a2c9-1318d137af36 req-2846eee4-0eaf-42d3-8f04-da05f5d66cdf tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] For port f0f9ba57-524d-497e-8230-57c2fa447a6a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=f0f9ba57-524d-497e-8230-57c2fa447a6a,segment=NetworkSegment(9559424d-973e-4a97-92a4-8a446b0a62b5),segment_id=9559424d-973e-4a97-92a4-8a446b0a62b5)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:34:10.237180 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-adaad5db-1b3b-4ba2-a2c9-1318d137af36 req-2846eee4-0eaf-42d3-8f04-da05f5d66cdf tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:10.341945 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17588e70-a0fd-40ba-ab69-27761fe2349f req-a72d151c-4f5f-4307-a40d-d5d989e236a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:10.343620 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-17588e70-a0fd-40ba-ab69-27761fe2349f req-a72d151c-4f5f-4307-a40d-d5d989e236a5 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=5baf74c9-e686-40a5-b52f-f01da3bd1af9 HTTP/1.1" status: 200  len: 850 time: 0.3017387
Jun 03 08:34:10.349967 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b76d0ce9-1705-4591-95ef-ec13bfeec396 req-0e2c4cc8-4b9c-4679-865f-5ce33bf00296 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 210 time: 0.0458205
Jun 03 08:34:10.370521 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-744a500e-c907-416e-98d6-92ed4e17da82 req-42e0780c-7efe-4dd7-a443-dc03105b28e1 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:10.378368 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-abec9ab5-6e84-4431-b8e0-50ddbe3d4848 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:34:10.381670 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['24826ba2-ee17-4774-b5ca-2cd1675f325a', 'a309b335-7644-4c59-8d6b-90e763827a25', '4da2f73c-9644-4280-92c1-e0be72f1fdad', '6a3181af-0127-4cce-b71a-90b9c83c8f88'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:34:10.434363 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42e0780c-7efe-4dd7-a443-dc03105b28e1 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Pushing event deleted for resources: {'Port': ['ID=6a3181af-0127-4cce-b71a-90b9c83c8f88,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:34:10.444065 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-42e0780c-7efe-4dd7-a443-dc03105b28e1 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:34:10.471965 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-adaad5db-1b3b-4ba2-a2c9-1318d137af36 req-2846eee4-0eaf-42d3-8f04-da05f5d66cdf tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Calling delete_port for f0f9ba57-524d-497e-8230-57c2fa447a6a owned by compute:nova {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:34:10.527220 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-aeded868-1f58-440c-ba9d-67f2b01401f1 req-536d7728-9834-45a7-8fb8-7b7053d555b6 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/security-groups?id=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2956386
Jun 03 08:34:10.581087 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-36a332e2-9099-4d3a-a69b-b78602283d1b req-64d35a41-e808-482a-9760-d6e72cf5eb97 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 210 time: 0.1044347
Jun 03 08:34:10.583051 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [req-744a500e-c907-416e-98d6-92ed4e17da82 req-42e0780c-7efe-4dd7-a443-dc03105b28e1 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] No DVR routers for this DVR port 6a3181af-0127-4cce-b71a-90b9c83c8f88 on host hv-cinder-78726 {{(pid=92324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:34:10.587819 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-744a500e-c907-416e-98d6-92ed4e17da82 req-42e0780c-7efe-4dd7-a443-dc03105b28e1 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:10.591332 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8ddd6245-fce5-47f9-a7a6-680ac133188d', 'name': 'network-vif-deleted', 'tag': '6a3181af-0127-4cce-b71a-90b9c83c8f88'}] {{(pid=92324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:34:10.593644 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}25ad023063ed160b339e2d2d51ef3e5c51250aece1f4db0a35843dff1b64291a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-841e4c90-98c9-4261-a9d4-9998240b925c" -d '{"events": [{"server_uuid": "8ddd6245-fce5-47f9-a7a6-680ac133188d", "name": "network-vif-deleted", "tag": "6a3181af-0127-4cce-b71a-90b9c83c8f88"}]}' {{(pid=92324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:34:10.635264 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-30ca677a-0f46-4495-b901-9ce0b9bcc2d6 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:10.636797 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-30ca677a-0f46-4495-b901-9ce0b9bcc2d6 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.55 "GET /v2.0/networks?id=113ded30-096c-4860-8773-fb717f3ea4c6 HTTP/1.1" status: 200  len: 814 time: 0.6520903
Jun 03 08:34:10.658472 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-23dea6be-8eea-4bdb-9d49-0634e882a047 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Request body: {'port': {'device_id': '529b1368-4218-45b2-ac64-62f1d985b8b2', 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6', 'admin_state_up': True, 'tenant_id': '96a989a900784d61a1475d86dd209c5f'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:34:10.676763 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:34:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-789844b8-4fd3-42f7-941f-89be17c08138 x-openstack-request-id: req-789844b8-4fd3-42f7-941f-89be17c08138 {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:34:10.677171 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8ddd6245-fce5-47f9-a7a6-680ac133188d", "name": "network-vif-deleted", "tag": "6a3181af-0127-4cce-b71a-90b9c83c8f88", "status": "completed", "code": 200}]} {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:34:10.677458 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-789844b8-4fd3-42f7-941f-89be17c08138 {{(pid=92324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:34:10.677887 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8ddd6245-fce5-47f9-a7a6-680ac133188d', 'name': 'network-vif-deleted', 'tag': '6a3181af-0127-4cce-b71a-90b9c83c8f88', 'status': 'completed', 'code': 200}
Jun 03 08:34:10.698476 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-744a500e-c907-416e-98d6-92ed4e17da82 req-42e0780c-7efe-4dd7-a443-dc03105b28e1 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.55 "DELETE /v2.0/ports/6a3181af-0127-4cce-b71a-90b9c83c8f88 HTTP/1.1" status: 204  len: 173 time: 1.2312973
Jun 03 08:34:10.736709 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17588e70-a0fd-40ba-ab69-27761fe2349f req-6f111aa5-37c2-45bd-84ea-7a652e9fa031 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:10.740812 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-17588e70-a0fd-40ba-ab69-27761fe2349f req-6f111aa5-37c2-45bd-84ea-7a652e9fa031 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=020eaa43-2d59-46e1-8aec-0a688069f72b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3271961
Jun 03 08:34:11.204161 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-23dea6be-8eea-4bdb-9d49-0634e882a047 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:34:11.207589 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-17588e70-a0fd-40ba-ab69-27761fe2349f req-8cc3b87f-83f4-4441-a75a-83e3adfce30e service neutron] 10.222.0.55 "GET /v2.0/networks/020eaa43-2d59-46e1-8aec-0a688069f72b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4489048
Jun 03 08:34:11.215396 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9ca928-f5dd-440b-baba-555f0cf5df86 req-8c8d77d3-69fa-4186-b927-054f9be8fec7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:11.225485 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5b9ca928-f5dd-440b-baba-555f0cf5df86 req-8c8d77d3-69fa-4186-b927-054f9be8fec7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.5323141
Jun 03 08:34:11.263538 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-23dea6be-8eea-4bdb-9d49-0634e882a047 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:34:11.340955 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-adaad5db-1b3b-4ba2-a2c9-1318d137af36 req-2846eee4-0eaf-42d3-8f04-da05f5d66cdf tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:11.357622 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:34:11.381604 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea4ffffc-df7a-4350-b904-1c05d6ca4e07 req-2c942e81-8114-4266-8cb1-751874d296f7 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:11.389609 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ea4ffffc-df7a-4350-b904-1c05d6ca4e07 req-2c942e81-8114-4266-8cb1-751874d296f7 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1095691
Jun 03 08:34:11.424533 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5b9ca928-f5dd-440b-baba-555f0cf5df86 req-56b4e92d-c20e-4951-ba14-257e8af4db17 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1836302
Jun 03 08:34:11.425326 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2846eee4-0eaf-42d3-8f04-da05f5d66cdf tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Pushing event deleted for resources: {'Port': ['ID=f0f9ba57-524d-497e-8230-57c2fa447a6a,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:34:11.434560 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-2846eee4-0eaf-42d3-8f04-da05f5d66cdf tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:34:11.434958 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-23dea6be-8eea-4bdb-9d49-0634e882a047 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Made reservation on behalf of 96a989a900784d61a1475d86dd209c5f for: {'port': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:34:11.438521 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-23dea6be-8eea-4bdb-9d49-0634e882a047 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:11.442468 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ea4ffffc-df7a-4350-b904-1c05d6ca4e07 req-ba69590a-b9e8-4305-94e1-d7ec943e1a0f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0519168
Jun 03 08:34:11.585535 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-adaad5db-1b3b-4ba2-a2c9-1318d137af36 req-2846eee4-0eaf-42d3-8f04-da05f5d66cdf tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] No DVR routers for this DVR port f0f9ba57-524d-497e-8230-57c2fa447a6a on host hv-cinder-78726 {{(pid=92323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:34:11.589561 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-17588e70-a0fd-40ba-ab69-27761fe2349f req-165e437a-3042-4e95-821b-5d3f0f122a29 service neutron] 10.222.0.55 "GET /v2.0/networks/020eaa43-2d59-46e1-8aec-0a688069f72b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3704848
Jun 03 08:34:11.597679 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-adaad5db-1b3b-4ba2-a2c9-1318d137af36 req-2846eee4-0eaf-42d3-8f04-da05f5d66cdf tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:11.597925 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '94bade6e-3955-4228-b5ef-3ef8fb278f08', 'name': 'network-vif-deleted', 'tag': 'f0f9ba57-524d-497e-8230-57c2fa447a6a'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:34:11.600276 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-819963ec-4d29-4578-9f63-c3ca3ab0e693" -d '{"events": [{"server_uuid": "94bade6e-3955-4228-b5ef-3ef8fb278f08", "name": "network-vif-deleted", "tag": "f0f9ba57-524d-497e-8230-57c2fa447a6a"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:34:11.602841 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-58fc5e29-b2f6-4f34-8a20-29d227ac7f46 req-0c7735cb-a618-4c96-9211-aa909d877c3e tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 210 time: 0.0545788
Jun 03 08:34:11.697447 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:34:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-464d1edf-0a23-46b3-8148-3b4d474c78da x-openstack-request-id: req-464d1edf-0a23-46b3-8148-3b4d474c78da {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:34:11.697761 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "94bade6e-3955-4228-b5ef-3ef8fb278f08", "name": "network-vif-deleted", "tag": "f0f9ba57-524d-497e-8230-57c2fa447a6a", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:34:11.698037 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-464d1edf-0a23-46b3-8148-3b4d474c78da {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:34:11.698453 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '94bade6e-3955-4228-b5ef-3ef8fb278f08', 'name': 'network-vif-deleted', 'tag': 'f0f9ba57-524d-497e-8230-57c2fa447a6a', 'status': 'completed', 'code': 200}
Jun 03 08:34:11.749981 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-5d82cd4e-7685-4087-ac48-167b6828c993 req-852db5fc-bf23-4d9b-99bf-bade6165092c tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Synchronizing usage tracker for tenant:96ee04709f4540ee8818120a88291b46 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:34:11.775245 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-5d82cd4e-7685-4087-ac48-167b6828c993 req-852db5fc-bf23-4d9b-99bf-bade6165092c tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Unset dirty status for tenant:96ee04709f4540ee8818120a88291b46 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:34:11.776493 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5d82cd4e-7685-4087-ac48-167b6828c993 req-852db5fc-bf23-4d9b-99bf-bade6165092c tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 210 time: 0.0860176
Jun 03 08:34:11.780682 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-adaad5db-1b3b-4ba2-a2c9-1318d137af36 req-2846eee4-0eaf-42d3-8f04-da05f5d66cdf tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.55 "DELETE /v2.0/ports/f0f9ba57-524d-497e-8230-57c2fa447a6a HTTP/1.1" status: 204  len: 173 time: 2.3713605
Jun 03 08:34:11.781790 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-23dea6be-8eea-4bdb-9d49-0634e882a047 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Allocated IP 172.20.0.3 (113ded30-096c-4860-8773-fb717f3ea4c6/159409d9-9245-4f6d-adbe-4aa8aad78d07/37525065-c740-4aee-a826-af098f4b7727) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:34:11.860885 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-c893a97e-e6f1-427a-b1ba-76fdfaa757d5 req-43cf2531-1f7a-49a6-9542-f2c3b8c1890f tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Synchronizing usage tracker for tenant:7bac6d994f4d49b292bc39fac07c0311 on resource:port {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:34:12.005217 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-23dea6be-8eea-4bdb-9d49-0634e882a047 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:12.011801 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-c893a97e-e6f1-427a-b1ba-76fdfaa757d5 req-43cf2531-1f7a-49a6-9542-f2c3b8c1890f tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Unset dirty status for tenant:7bac6d994f4d49b292bc39fac07c0311 on resource:port {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:34:12.013422 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c893a97e-e6f1-427a-b1ba-76fdfaa757d5 req-43cf2531-1f7a-49a6-9542-f2c3b8c1890f tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=8ddd6245-fce5-47f9-a7a6-680ac133188d HTTP/1.1" status: 200  len: 210 time: 0.2099791
Jun 03 08:34:12.022808 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-23dea6be-8eea-4bdb-9d49-0634e882a047 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Transition to ACTIVE for port object 37525065-c740-4aee-a826-af098f4b7727 will not be triggered until provisioned by entity DHCP. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:34:12.150224 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-23dea6be-8eea-4bdb-9d49-0634e882a047 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:12.157690 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-3295608c-70bf-49fb-9415-ed36bd2c63d4 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:34:12.230054 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-23dea6be-8eea-4bdb-9d49-0634e882a047 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Network 113ded30-096c-4860-8773-fb717f3ea4c6 is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:34:12.233410 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-23dea6be-8eea-4bdb-9d49-0634e882a047 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:34:12.237380 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-23dea6be-8eea-4bdb-9d49-0634e882a047 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:34:12.243031 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-23dea6be-8eea-4bdb-9d49-0634e882a047 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:12.243699 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-23dea6be-8eea-4bdb-9d49-0634e882a047 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:12.260867 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23dea6be-8eea-4bdb-9d49-0634e882a047 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Pushing event updated for resources: {'Port': ['ID=37525065-c740-4aee-a826-af098f4b7727,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:34:12.262054 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-23dea6be-8eea-4bdb-9d49-0634e882a047 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:34:12.392674 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-23dea6be-8eea-4bdb-9d49-0634e882a047 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.55 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.7372739
Jun 03 08:34:12.406141 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Request body: {'port': {'device_id': '529b1368-4218-45b2-ac64-62f1d985b8b2', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:34:12.533148 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-f04a8902-9525-49d8-a187-dd7a59c1be0d None None] Provisioning for port 37525065-c740-4aee-a826-af098f4b7727 completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:34:12.550150 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-f04a8902-9525-49d8-a187-dd7a59c1be0d None None] Provisioning complete for port 37525065-c740-4aee-a826-af098f4b7727 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:34:12.551173 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-f04a8902-9525-49d8-a187-dd7a59c1be0d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:12.562081 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:12.697709 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device f0f9ba57-524d-497e-8230-57c2fa447a6a no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:34:12.761491 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-f04a8902-9525-49d8-a187-dd7a59c1be0d None None] Port 37525065-c740-4aee-a826-af098f4b7727 cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:34:12.763390 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] No Port match for: f0f9ba57-524d-497e-8230-57c2fa447a6a {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:34:12.763906 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device f0f9ba57-524d-497e-8230-57c2fa447a6a not bound to the agent host hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:34:12.809888 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f95e334-3bdc-4e50-8a3b-21007aab5c4d req-ab6a0598-5a2c-4ddc-b4b7-45e5ae655525 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:12.812556 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-1f95e334-3bdc-4e50-8a3b-21007aab5c4d req-ab6a0598-5a2c-4ddc-b4b7-45e5ae655525 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.1444240
Jun 03 08:34:12.874445 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-1f95e334-3bdc-4e50-8a3b-21007aab5c4d req-126f2c21-4cff-4dd6-92d4-c2f225d6fdcc tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0541108
Jun 03 08:34:12.913828 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7699ee6e-7ab7-415b-9377-afe9e862c155 req-331c6842-81f3-4531-a78d-1dd442eb224a tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:12.915188 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7699ee6e-7ab7-415b-9377-afe9e862c155 req-331c6842-81f3-4531-a78d-1dd442eb224a tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.2558231
Jun 03 08:34:13.074138 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7699ee6e-7ab7-415b-9377-afe9e862c155 req-70ae3f90-4973-4f2d-b22a-f39e9e545494 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1391530
Jun 03 08:34:13.172362 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-722604f5-7dcf-464f-ad41-7050a6a15ff6 req-117122f8-3dfb-4c92-b697-8f22cee35788 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:13.180871 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-722604f5-7dcf-464f-ad41-7050a6a15ff6 req-117122f8-3dfb-4c92-b697-8f22cee35788 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 931 time: 0.1930590
Jun 03 08:34:13.257899 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-722604f5-7dcf-464f-ad41-7050a6a15ff6 req-08f9c734-8d83-41d1-a46d-ea709b36c5d4 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Synchronizing usage tracker for tenant:96a989a900784d61a1475d86dd209c5f on resource:security_group {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:34:13.446111 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-722604f5-7dcf-464f-ad41-7050a6a15ff6 req-08f9c734-8d83-41d1-a46d-ea709b36c5d4 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Unset dirty status for tenant:96a989a900784d61a1475d86dd209c5f on resource:security_group {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:34:13.447422 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-722604f5-7dcf-464f-ad41-7050a6a15ff6 req-08f9c734-8d83-41d1-a46d-ea709b36c5d4 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2653666
Jun 03 08:34:13.514033 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ec46368a-c75b-456b-abf0-10fcf5bdd8e7 req-a57d0423-85e7-4199-9403-3624fa3e5858 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] 10.222.0.11 "GET /v2.0/ports?device_id=94bade6e-3955-4228-b5ef-3ef8fb278f08 HTTP/1.1" status: 200  len: 210 time: 0.1697145
Jun 03 08:34:13.531480 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 37525065-c740-4aee-a826-af098f4b7727 {{(pid=92323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:34:13.541063 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:13.568389 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Transition to ACTIVE for port object 37525065-c740-4aee-a826-af098f4b7727 will not be triggered until provisioned by entity L2. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:34:13.686999 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:13.692866 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-23dea6be-8eea-4bdb-9d49-0634e882a047 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:34:13.908824 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Pushing event updated for resources: {'Port': ['ID=37525065-c740-4aee-a826-af098f4b7727,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:34:13.934179 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:34:13.986540 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Attempting to bind port 37525065-c740-4aee-a826-af098f4b7727 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:34:13.987044 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Attempting to bind port 37525065-c740-4aee-a826-af098f4b7727 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '3151dd7e-a009-433b-ae5e-c81299e42bfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6'}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:34:13.987483 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Attempting to bind port 37525065-c740-4aee-a826-af098f4b7727 on network 113ded30-096c-4860-8773-fb717f3ea4c6 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:34:13.995320 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Port 37525065-c740-4aee-a826-af098f4b7727 on network 113ded30-096c-4860-8773-fb717f3ea4c6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 03 08:34:13.995650 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Attempting to bind port 37525065-c740-4aee-a826-af098f4b7727 on network 113ded30-096c-4860-8773-fb717f3ea4c6 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:34:14.001665 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Checking agent: {'id': '181c5753-100b-4f03-bda8-e34279b057f4', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'started_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 33, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:34:14.005310 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Checking segment: {'id': '3151dd7e-a009-433b-ae5e-c81299e42bfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:34:14.005310 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Bound using segment: {'id': '3151dd7e-a009-433b-ae5e-c81299e42bfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6'} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:34:14.005310 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Bound port: 37525065-c740-4aee-a826-af098f4b7727, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3151dd7e-a009-433b-ae5e-c81299e42bfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 525, 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6'}}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:34:14.005310 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:14.321335 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] For port 37525065-c740-4aee-a826-af098f4b7727, host hv-cinder-78726, cleared binding levels {{(pid=92323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:34:14.326249 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] For port 37525065-c740-4aee-a826-af098f4b7727, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=37525065-c740-4aee-a826-af098f4b7727,segment=NetworkSegment(3151dd7e-a009-433b-ae5e-c81299e42bfb),segment_id=3151dd7e-a009-433b-ae5e-c81299e42bfb)] {{(pid=92323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:34:14.350414 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcbf69fc-ce88-4a2f-a88a-b84304784c4c req-87de57d2-585e-496e-8224-5618860110fd tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:14.352387 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-bcbf69fc-ce88-4a2f-a88a-b84304784c4c req-87de57d2-585e-496e-8224-5618860110fd tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.1921470
Jun 03 08:34:14.414932 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-bcbf69fc-ce88-4a2f-a88a-b84304784c4c req-e6dfd28e-afec-49e1-b391-59a7d3eaac17 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0511830
Jun 03 08:34:14.434916 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:14.438855 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:34:14.493282 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:14.494343 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:14.495993 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] 10.222.0.55 "PUT /v2.0/ports/37525065-c740-4aee-a826-af098f4b7727 HTTP/1.1" status: 200  len: 1093 time: 2.0944786
Jun 03 08:34:14.503472 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '529b1368-4218-45b2-ac64-62f1d985b8b2', 'tag': '37525065-c740-4aee-a826-af098f4b7727'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:34:14.506045 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-82585232-ed9f-4ea8-a2af-3f6e9c19a7be" -d '{"events": [{"name": "network-changed", "server_uuid": "529b1368-4218-45b2-ac64-62f1d985b8b2", "tag": "37525065-c740-4aee-a826-af098f4b7727"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:34:14.551836 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Pushing event updated for resources: {'Port': ['ID=37525065-c740-4aee-a826-af098f4b7727,revision_number=3']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:34:14.569329 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:34:14.586009 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:34:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8fbf53f0-e21d-4ff6-abc6-438d46da811a x-openstack-request-id: req-8fbf53f0-e21d-4ff6-abc6-438d46da811a {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:34:14.586325 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "529b1368-4218-45b2-ac64-62f1d985b8b2", "tag": "37525065-c740-4aee-a826-af098f4b7727", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:34:14.586657 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-8fbf53f0-e21d-4ff6-abc6-438d46da811a {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:34:14.587079 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '529b1368-4218-45b2-ac64-62f1d985b8b2', 'tag': '37525065-c740-4aee-a826-af098f4b7727', 'status': 'completed', 'code': 200}
Jun 03 08:34:14.693644 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 6a3181af-0127-4cce-b71a-90b9c83c8f88 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:34:14.742976 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fdaa0d7-8d73-4768-9753-ab5ae1422546 req-8222a9a2-762d-46c8-a0c8-0ce81326c53e tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:14.750728 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3fdaa0d7-8d73-4768-9753-ab5ae1422546 req-8222a9a2-762d-46c8-a0c8-0ce81326c53e tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 943 time: 0.1770844
Jun 03 08:34:14.776628 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] No Port match for: 6a3181af-0127-4cce-b71a-90b9c83c8f88 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:34:14.777399 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 6a3181af-0127-4cce-b71a-90b9c83c8f88 not bound to the agent host hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:34:14.825388 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3fdaa0d7-8d73-4768-9753-ab5ae1422546 req-f0b4ea49-0074-4bba-9427-f4fc1a67a8a0 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0734169
Jun 03 08:34:15.665092 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9718b66-fce3-47bc-b5b4-e0956990e46e req-2671e36a-e252-4210-aa5e-65055f8e7773 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:15.666770 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c9718b66-fce3-47bc-b5b4-e0956990e46e req-2671e36a-e252-4210-aa5e-65055f8e7773 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.1005011
Jun 03 08:34:15.719471 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c9718b66-fce3-47bc-b5b4-e0956990e46e req-d2b23c10-22ba-4331-9c96-1dddadd4264b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0449276
Jun 03 08:34:15.966917 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8fec725-baff-43e8-8aab-3e8abddea373 req-4f6bda64-e9d0-4850-b1bc-8c911b37a89c tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:15.968801 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d8fec725-baff-43e8-8aab-3e8abddea373 req-4f6bda64-e9d0-4850-b1bc-8c911b37a89c tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1366935
Jun 03 08:34:16.023443 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d8fec725-baff-43e8-8aab-3e8abddea373 req-f341fdec-223b-4a0d-bf55-3ab482c51b22 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0463207
Jun 03 08:34:16.243365 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad5db505-127b-4fe9-b824-df3d49e2be88 req-5ca54a8b-24d3-4ccb-befd-df4ec2b2c65c tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:16.245364 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ad5db505-127b-4fe9-b824-df3d49e2be88 req-5ca54a8b-24d3-4ccb-befd-df4ec2b2c65c tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 943 time: 0.1046894
Jun 03 08:34:16.297538 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ad5db505-127b-4fe9-b824-df3d49e2be88 req-653902b7-9682-420b-b609-582fc9556dcd tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0452406
Jun 03 08:34:16.560400 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c95729f-5de4-4b69-915f-7db5e67edfa5 req-981c3f92-adab-45db-b080-0d50b27a8d9d tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:16.561935 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7c95729f-5de4-4b69-915f-7db5e67edfa5 req-981c3f92-adab-45db-b080-0d50b27a8d9d tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 945 time: 0.1292906
Jun 03 08:34:16.627087 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7c95729f-5de4-4b69-915f-7db5e67edfa5 req-92197934-842e-420a-9ce6-51992f97ed6a tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0579677
Jun 03 08:34:16.931993 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d7b0f21-934d-41da-94e2-0df11a8f1dcf req-e4b56505-8f4e-4ad6-a346-920d7cec4c48 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:16.934641 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0d7b0f21-934d-41da-94e2-0df11a8f1dcf req-e4b56505-8f4e-4ad6-a346-920d7cec4c48 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0960567
Jun 03 08:34:16.996454 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0d7b0f21-934d-41da-94e2-0df11a8f1dcf req-9bc46413-d9f0-4e98-9a7e-9825e0f37792 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0553916
Jun 03 08:34:17.519428 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-749776a1-8301-4ce2-bb15-ebb86dfbf1ca req-d2be888c-c20f-440f-b797-9b14ee5ed0c5 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:17.520746 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-749776a1-8301-4ce2-bb15-ebb86dfbf1ca req-d2be888c-c20f-440f-b797-9b14ee5ed0c5 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Synchronizing usage tracker for tenant:96a989a900784d61a1475d86dd209c5f on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:34:17.611980 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-749776a1-8301-4ce2-bb15-ebb86dfbf1ca req-d2be888c-c20f-440f-b797-9b14ee5ed0c5 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Unset dirty status for tenant:96a989a900784d61a1475d86dd209c5f on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:34:17.614647 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-749776a1-8301-4ce2-bb15-ebb86dfbf1ca req-d2be888c-c20f-440f-b797-9b14ee5ed0c5 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 943 time: 0.1821826
Jun 03 08:34:17.683779 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-749776a1-8301-4ce2-bb15-ebb86dfbf1ca req-8594c6ad-76a9-49a4-87af-fb9b4b411648 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0624177
Jun 03 08:34:17.871785 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3de0d412-42ea-4ed3-ad52-92abd6b7d371 req-2f9091e5-5405-4ebd-9b10-e256e790cd28 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:17.873665 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3de0d412-42ea-4ed3-ad52-92abd6b7d371 req-2f9091e5-5405-4ebd-9b10-e256e790cd28 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 945 time: 0.0921214
Jun 03 08:34:17.924506 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3de0d412-42ea-4ed3-ad52-92abd6b7d371 req-a390fdf9-aab7-43c1-a980-39bb76150457 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0448093
Jun 03 08:34:18.212079 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-578ca697-2979-4012-8d1e-d88a695423ba req-bf631f89-41c7-45eb-8f81-eb0067f1f6f6 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:18.213508 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-578ca697-2979-4012-8d1e-d88a695423ba req-bf631f89-41c7-45eb-8f81-eb0067f1f6f6 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0921624
Jun 03 08:34:18.264564 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-578ca697-2979-4012-8d1e-d88a695423ba req-f7e212e3-ff91-41b6-a14b-7304565c356a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0453444
Jun 03 08:34:18.892444 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1911647f-444b-4318-b566-b9efa877ef7b req-e96efaaf-8894-4205-b77d-e9c3c9e47176 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:18.894001 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1911647f-444b-4318-b566-b9efa877ef7b req-e96efaaf-8894-4205-b77d-e9c3c9e47176 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 943 time: 0.0843377
Jun 03 08:34:18.944197 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1911647f-444b-4318-b566-b9efa877ef7b req-fe05f142-2aca-4a84-8288-bb44112ebd74 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0428362
Jun 03 08:34:19.139378 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6afaf39-2073-46fa-9171-82699b6867d1 req-a3a2d96c-4758-4106-82c6-e8245e4ca3a1 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:19.140886 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f6afaf39-2073-46fa-9171-82699b6867d1 req-a3a2d96c-4758-4106-82c6-e8245e4ca3a1 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 945 time: 0.1032257
Jun 03 08:34:19.195067 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f6afaf39-2073-46fa-9171-82699b6867d1 req-5d13cedc-072a-479b-acda-765d92f5746c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0475960
Jun 03 08:34:19.475975 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4434726-b077-42ec-9faf-d96d1211f409 req-c850fcd6-81ab-4186-83ab-aee50243339b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:19.477489 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d4434726-b077-42ec-9faf-d96d1211f409 req-c850fcd6-81ab-4186-83ab-aee50243339b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0948300
Jun 03 08:34:19.525290 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d4434726-b077-42ec-9faf-d96d1211f409 req-6cc477c0-7fb1-4779-be03-5223a089d34d tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0414875
Jun 03 08:34:20.379387 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dcca138-9572-4423-916a-e7b89b7da4cd req-6e2b77b7-4b93-44c8-8308-592258ff7b94 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:20.381119 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1dcca138-9572-4423-916a-e7b89b7da4cd req-6e2b77b7-4b93-44c8-8308-592258ff7b94 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 943 time: 0.0944226
Jun 03 08:34:20.432270 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1dcca138-9572-4423-916a-e7b89b7da4cd req-a34dd3ad-4406-42d5-a8ac-3183da071f6a tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0438919
Jun 03 08:34:20.621587 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb0eca65-37a7-4915-844a-ed3615e9c197 req-f014aa41-3322-43f0-97a4-367a67889787 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:20.623865 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-cb0eca65-37a7-4915-844a-ed3615e9c197 req-f014aa41-3322-43f0-97a4-367a67889787 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 945 time: 0.0903015
Jun 03 08:34:20.671015 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-cb0eca65-37a7-4915-844a-ed3615e9c197 req-f99799ab-d260-4f6f-8011-97974de6c672 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0419445
Jun 03 08:34:20.898855 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e5257d2-c354-4cf9-a726-b863fae10f01 req-3a5df60c-2a32-4788-bc72-18fa12ae8138 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:20.900149 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4e5257d2-c354-4cf9-a726-b863fae10f01 req-3a5df60c-2a32-4788-bc72-18fa12ae8138 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.1102378
Jun 03 08:34:20.946836 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4e5257d2-c354-4cf9-a726-b863fae10f01 req-a7a9abbd-2edd-465a-be30-771a5d361232 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0408168
Jun 03 08:34:21.629288 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-534807cc-9816-43e1-bf05-121a853f1a0c req-b0d4e692-b47b-4b7a-9d7b-c1e879e80b39 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:21.630747 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-534807cc-9816-43e1-bf05-121a853f1a0c req-b0d4e692-b47b-4b7a-9d7b-c1e879e80b39 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 943 time: 0.0877123
Jun 03 08:34:21.678424 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-534807cc-9816-43e1-bf05-121a853f1a0c req-2e4636fa-de49-4e47-a2f5-94389d33b672 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421042
Jun 03 08:34:21.952595 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-526e1b58-810c-43c4-ba8f-2894be1cefaa req-a3657a12-444d-486a-84bb-82581d906124 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:21.955707 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-526e1b58-810c-43c4-ba8f-2894be1cefaa req-a3657a12-444d-486a-84bb-82581d906124 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 945 time: 0.1718013
Jun 03 08:34:22.020519 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-526e1b58-810c-43c4-ba8f-2894be1cefaa req-f092bcb0-b93c-4bbf-b09a-c8ed6650e25b tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0555217
Jun 03 08:34:22.265687 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2708eac-a8f8-4a82-9787-d0aab499cb9e req-e16023f9-880e-445c-bec0-c4485d86d638 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:22.267099 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d2708eac-a8f8-4a82-9787-d0aab499cb9e req-e16023f9-880e-445c-bec0-c4485d86d638 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0974414
Jun 03 08:34:22.315120 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d2708eac-a8f8-4a82-9787-d0aab499cb9e req-3ff8fa1e-fa43-4c1b-b2d7-9d93632635ed tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0421836
Jun 03 08:34:22.893630 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-297bf146-132c-451a-9688-2b18f61382e5 req-752540e8-447e-4268-9b84-2e7bc44b03e7 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:22.896177 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-297bf146-132c-451a-9688-2b18f61382e5 req-752540e8-447e-4268-9b84-2e7bc44b03e7 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 943 time: 0.0898201
Jun 03 08:34:22.956008 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-297bf146-132c-451a-9688-2b18f61382e5 req-95a79319-40b7-4b05-b677-c12dbc72718c tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0515687
Jun 03 08:34:23.257877 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1b7d21b-b0cd-45ac-8e81-1c44032c3cdc req-f59cb00f-aeb1-4eda-8a3e-831ae95d1bb8 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:23.259460 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e1b7d21b-b0cd-45ac-8e81-1c44032c3cdc req-f59cb00f-aeb1-4eda-8a3e-831ae95d1bb8 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 945 time: 0.1159208
Jun 03 08:34:23.318577 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e1b7d21b-b0cd-45ac-8e81-1c44032c3cdc req-ec8eacc1-b3ee-4580-a9d1-e3cd09aa23ba tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0493217
Jun 03 08:34:23.536101 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eeaad9a-40fd-40c2-92e0-8e441f22fe23 req-7fcc6520-b12c-4e95-8f07-fdcfbe80f93d tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:23.536101 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0eeaad9a-40fd-40c2-92e0-8e441f22fe23 req-7fcc6520-b12c-4e95-8f07-fdcfbe80f93d tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0935464
Jun 03 08:34:23.580803 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0eeaad9a-40fd-40c2-92e0-8e441f22fe23 req-4c308448-2948-4a55-8f3b-0e385f924334 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0403116
Jun 03 08:34:24.254967 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7363444e-2545-47bf-a713-14bfff2c65bc req-5860f418-d014-4202-b9b7-1bd50d238e35 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:24.256428 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7363444e-2545-47bf-a713-14bfff2c65bc req-5860f418-d014-4202-b9b7-1bd50d238e35 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 943 time: 0.0994544
Jun 03 08:34:24.320038 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7363444e-2545-47bf-a713-14bfff2c65bc req-2bf23503-8d90-450d-ba5d-45046b8b2f5a tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0572097
Jun 03 08:34:24.532904 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fdb933e-eb8f-449a-88b8-6879bd11b813 req-5d7dc86a-a3ac-4845-9191-6c65aee7bb8f tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:24.535162 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8fdb933e-eb8f-449a-88b8-6879bd11b813 req-5d7dc86a-a3ac-4845-9191-6c65aee7bb8f tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 945 time: 0.0851500
Jun 03 08:34:24.593931 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8fdb933e-eb8f-449a-88b8-6879bd11b813 req-fa5c3eb1-00de-44f4-8ff8-9a9c700565cf tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0528917
Jun 03 08:34:24.793048 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51bce662-2db1-40c3-b07d-888002ac6058 req-102aa948-5af6-4504-b743-5b9cf181a86a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:24.794787 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-51bce662-2db1-40c3-b07d-888002ac6058 req-102aa948-5af6-4504-b743-5b9cf181a86a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0951970
Jun 03 08:34:24.843102 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-51bce662-2db1-40c3-b07d-888002ac6058 req-26be33ca-ac36-45b2-8930-84df0c996d20 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0426080
Jun 03 08:34:25.511717 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da93a85a-7be1-45ba-b600-1c43c8ba17ab req-f31ea878-07ac-4c2c-8990-22ec2d7f3719 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:25.513275 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-da93a85a-7be1-45ba-b600-1c43c8ba17ab req-f31ea878-07ac-4c2c-8990-22ec2d7f3719 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 943 time: 0.0856731
Jun 03 08:34:25.558306 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-da93a85a-7be1-45ba-b600-1c43c8ba17ab req-dbf215d5-d1f3-4195-ab87-e40e14d0df01 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394561
Jun 03 08:34:25.789395 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61bdb8f8-23be-45c3-87ed-2c50d9b604c6 req-ad7278d1-e422-44a2-b53b-26ac8286554a tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:25.791013 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-61bdb8f8-23be-45c3-87ed-2c50d9b604c6 req-ad7278d1-e422-44a2-b53b-26ac8286554a tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 945 time: 0.0872567
Jun 03 08:34:25.840862 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-61bdb8f8-23be-45c3-87ed-2c50d9b604c6 req-29419b5e-6af5-4ac1-b9d1-d55968c4e832 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0441320
Jun 03 08:34:26.039118 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ca39dce-1812-49dc-bca9-2132d95a00b5 req-ec53a5f5-bc87-4cb9-bf29-a7f87120bc2e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:26.045370 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6ca39dce-1812-49dc-bca9-2132d95a00b5 req-ec53a5f5-bc87-4cb9-bf29-a7f87120bc2e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0866120
Jun 03 08:34:26.074337 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:26.086134 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6ca39dce-1812-49dc-bca9-2132d95a00b5 req-80a5fe73-4df6-4238-b242-492b973f2fc9 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0399227
Jun 03 08:34:26.747750 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f69ecbe6-f8be-4b8a-838a-5345d8f1c3c1 req-e4f0959a-98c8-4752-9b1b-10f216cea4be tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:26.749221 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f69ecbe6-f8be-4b8a-838a-5345d8f1c3c1 req-e4f0959a-98c8-4752-9b1b-10f216cea4be tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 943 time: 0.0833740
Jun 03 08:34:26.802077 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f69ecbe6-f8be-4b8a-838a-5345d8f1c3c1 req-06e63274-fd4f-418c-86c2-880f68079a3f tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0463696
Jun 03 08:34:27.039233 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63b81dfc-03ef-46b5-af12-4000ad0e2d81 req-a0472436-00bc-48dd-ac3e-6f38e05e0acd tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:27.040703 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-63b81dfc-03ef-46b5-af12-4000ad0e2d81 req-a0472436-00bc-48dd-ac3e-6f38e05e0acd tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 945 time: 0.0821147
Jun 03 08:34:27.086671 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-63b81dfc-03ef-46b5-af12-4000ad0e2d81 req-d1f6e0f0-b2e4-488c-9b99-7c5c201a6d1a tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0402462
Jun 03 08:34:27.277819 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05fe7dc3-39a1-484b-91c4-bf7e93ebd299 req-4ee5db6f-34ff-4482-bd83-6612b3421793 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:27.279322 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-05fe7dc3-39a1-484b-91c4-bf7e93ebd299 req-4ee5db6f-34ff-4482-bd83-6612b3421793 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0798450
Jun 03 08:34:27.327412 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-05fe7dc3-39a1-484b-91c4-bf7e93ebd299 req-a7921974-c096-43ab-95ff-a24a67effc92 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0425019
Jun 03 08:34:28.059612 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a601bc3-6df0-4e50-944e-ab6eef306f7f req-c6f9b485-95d0-45c5-a482-2338b36fc69c tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:28.068620 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6a601bc3-6df0-4e50-944e-ab6eef306f7f req-c6f9b485-95d0-45c5-a482-2338b36fc69c tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 943 time: 0.1582146
Jun 03 08:34:28.090623 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82585232-ed9f-4ea8-a2af-3f6e9c19a7be req-41c87f9e-3ff9-494d-98f9-24e11607b5ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:28.092055 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-82585232-ed9f-4ea8-a2af-3f6e9c19a7be req-41c87f9e-3ff9-494d-98f9-24e11607b5ed service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=96a989a900784d61a1475d86dd209c5f&device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 1096 time: 0.1350136
Jun 03 08:34:28.116468 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6a601bc3-6df0-4e50-944e-ab6eef306f7f req-af444a2a-4654-4309-9f90-fe1c79d10aed tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0469952
Jun 03 08:34:28.316992 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82585232-ed9f-4ea8-a2af-3f6e9c19a7be req-4636d36a-f455-4267-966f-174d9d6185e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:28.318457 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-82585232-ed9f-4ea8-a2af-3f6e9c19a7be req-4636d36a-f455-4267-966f-174d9d6185e6 service neutron] 10.222.0.55 "GET /v2.0/networks?tenant_id=96a989a900784d61a1475d86dd209c5f&shared=False HTTP/1.1" status: 200  len: 915 time: 0.1993134
Jun 03 08:34:28.363951 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c890d3f-43f2-4e56-b9c6-f9378efefbcb req-cc339ff3-dd78-4e70-82c7-7cc1e6e23bf4 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:28.365449 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1c890d3f-43f2-4e56-b9c6-f9378efefbcb req-cc339ff3-dd78-4e70-82c7-7cc1e6e23bf4 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 945 time: 0.1287336
Jun 03 08:34:28.564531 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1c890d3f-43f2-4e56-b9c6-f9378efefbcb req-996699e4-0313-48b3-83ee-3789e12f257b tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1928728
Jun 03 08:34:28.606061 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82585232-ed9f-4ea8-a2af-3f6e9c19a7be req-4ebcdc81-97c9-4586-9c9d-b4447e5a4165 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:28.607619 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-82585232-ed9f-4ea8-a2af-3f6e9c19a7be req-4ebcdc81-97c9-4586-9c9d-b4447e5a4165 service neutron] 10.222.0.55 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.2768290
Jun 03 08:34:28.763644 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-912b18fd-be21-4845-8899-6dff9b860880 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:28.766367 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-912b18fd-be21-4845-8899-6dff9b860880 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=96a989a900784d61a1475d86dd209c5f&device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 1096 time: 0.1143007
Jun 03 08:34:28.870963 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-5449293f-2226-41be-8512-a4cfbc294b20 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=37525065-c740-4aee-a826-af098f4b7727 HTTP/1.1" status: 200  len: 217 time: 0.0916224
Jun 03 08:34:29.024864 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-a98c5bf6-bd34-4bf6-b42e-80eed0737523 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:29.027873 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-a98c5bf6-bd34-4bf6-b42e-80eed0737523 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=159409d9-9245-4f6d-adbe-4aa8aad78d07 HTTP/1.1" status: 200  len: 853 time: 0.1056247
Jun 03 08:34:29.047405 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0ab5ac9-8d03-40b2-8454-792af25eb987 req-ea24f4bc-95ec-48f7-b086-2b4148fbffd2 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:29.048904 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f0ab5ac9-8d03-40b2-8454-792af25eb987 req-ea24f4bc-95ec-48f7-b086-2b4148fbffd2 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.1967082
Jun 03 08:34:29.176359 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f0ab5ac9-8d03-40b2-8454-792af25eb987 req-02c4a904-c2d2-4cf6-85a9-ef7052edee5b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0772095
Jun 03 08:34:29.230774 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-ee664502-e2fa-46c5-b661-4633908907ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:29.234355 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-ee664502-e2fa-46c5-b661-4633908907ac service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=113ded30-096c-4860-8773-fb717f3ea4c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1826301
Jun 03 08:34:29.421056 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-72cf98ea-cbf1-4752-a890-d674690af8e2 service neutron] 10.222.0.55 "GET /v2.0/networks/113ded30-096c-4860-8773-fb717f3ea4c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1752973
Jun 03 08:34:29.472826 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a5e8170-1ea0-4bf3-84f9-6e7b1c270639 req-9abe1eeb-a0dd-48c5-9479-21a7dfa385e9 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:29.474827 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3a5e8170-1ea0-4bf3-84f9-6e7b1c270639 req-9abe1eeb-a0dd-48c5-9479-21a7dfa385e9 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 943 time: 0.1246505
Jun 03 08:34:29.555031 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3a5e8170-1ea0-4bf3-84f9-6e7b1c270639 req-c90a5753-d3fc-4af1-a38a-f66ae4dff13c tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0704803
Jun 03 08:34:29.633865 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f01d96c1-4c16-4279-85dd-7717476ebc51 req-8d2a104b-bd15-472c-b643-79c3d56496a1 service neutron] 10.222.0.55 "GET /v2.0/networks/113ded30-096c-4860-8773-fb717f3ea4c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2032623
Jun 03 08:34:29.860478 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c041fb59-3a4d-405a-81f6-a5af48f5bc72 req-52080228-4e1c-49c0-b843-d65eb726942e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:29.861981 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c041fb59-3a4d-405a-81f6-a5af48f5bc72 req-52080228-4e1c-49c0-b843-d65eb726942e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 945 time: 0.1036410
Jun 03 08:34:29.937567 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c041fb59-3a4d-405a-81f6-a5af48f5bc72 req-9f37a99a-5678-4b9f-baad-c5cd3d6257b0 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0653946
Jun 03 08:34:30.325962 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:34:30.429240 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87ae6769-74b0-4b1b-a288-cb25c20f1212 req-8012ba17-7e98-4a13-92f1-844c13e42aad tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:30.431127 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-87ae6769-74b0-4b1b-a288-cb25c20f1212 req-8012ba17-7e98-4a13-92f1-844c13e42aad tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 943 time: 0.0983865
Jun 03 08:34:30.486824 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-87ae6769-74b0-4b1b-a288-cb25c20f1212 req-dd2e522d-2602-41e2-a685-57595185be52 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0495076
Jun 03 08:34:30.687524 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb9f6781-8ec2-42e1-b56a-1d2582554545 req-a89a7f21-54d7-4444-8976-64efdab8ffad tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:30.690880 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-eb9f6781-8ec2-42e1-b56a-1d2582554545 req-a89a7f21-54d7-4444-8976-64efdab8ffad tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.55 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 945 time: 0.2209883
Jun 03 08:34:30.803507 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:34:31.067809 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00e698ea-f99f-46cf-b9e3-37511c97465f req-d8281593-73d3-4cac-952b-5c9cb0fae611 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:31.069485 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-00e698ea-f99f-46cf-b9e3-37511c97465f req-d8281593-73d3-4cac-952b-5c9cb0fae611 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 943 time: 0.2763791
Jun 03 08:34:31.118983 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-eb9f6781-8ec2-42e1-b56a-1d2582554545 req-9f3f0d39-f4f2-44f4-a90d-bfeb5e84ed6a tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Deleting port 4da2f73c-9644-4280-92c1-e0be72f1fdad {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:34:31.119418 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-eb9f6781-8ec2-42e1-b56a-1d2582554545 req-9f3f0d39-f4f2-44f4-a90d-bfeb5e84ed6a tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:31.199070 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-00e698ea-f99f-46cf-b9e3-37511c97465f req-c329a3b6-ce3e-49a3-9e2c-f81c34c89ef4 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1197610
Jun 03 08:34:31.348792 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:34:31.374024 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'port_id': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97', 'mac_address': 'fa:16:3e:93:b9:aa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 526, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:34:31.463769 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:31.499878 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:34:31.515144 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-eb9f6781-8ec2-42e1-b56a-1d2582554545 req-9f3f0d39-f4f2-44f4-a90d-bfeb5e84ed6a tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] For port 4da2f73c-9644-4280-92c1-e0be72f1fdad, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=4da2f73c-9644-4280-92c1-e0be72f1fdad,segment=NetworkSegment(9923ac74-9556-45ec-9044-43728d2a8ec3),segment_id=9923ac74-9556-45ec-9044-43728d2a8ec3)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:34:31.515498 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-eb9f6781-8ec2-42e1-b56a-1d2582554545 req-9f3f0d39-f4f2-44f4-a90d-bfeb5e84ed6a tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:31.534182 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:34:31.646745 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:31.648641 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:34:31.659013 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc4c5994-64ab-4959-abcf-16d1acf65ca6 req-0bb9f924-75b9-4d8e-a1d0-b2b0359fd7bb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:31.673202 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-bc4c5994-64ab-4959-abcf-16d1acf65ca6 req-0bb9f924-75b9-4d8e-a1d0-b2b0359fd7bb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.1629725
Jun 03 08:34:31.795304 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-bc4c5994-64ab-4959-abcf-16d1acf65ca6 req-cc0a3b22-3094-4ef0-98ea-45b42ea9ebd3 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1201749
Jun 03 08:34:31.805544 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-eb9f6781-8ec2-42e1-b56a-1d2582554545 req-9f3f0d39-f4f2-44f4-a90d-bfeb5e84ed6a tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Calling delete_port for 4da2f73c-9644-4280-92c1-e0be72f1fdad owned by compute:nova {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:34:31.812691 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,revision_number=9']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:34:31.841091 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:31.841589 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:31.842026 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:31.842622 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:31.843052 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:31.843517 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:31.843968 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:31.844397 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:31.848753 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:31.849267 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:31.849712 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:31.850355 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:31.861863 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.213s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:34:31.893271 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9499daba-4fa2-45ad-bff2-4bd56cff7cd2 req-53af3f34-69c7-419b-910d-e591c4394a84 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:31.902393 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9499daba-4fa2-45ad-bff2-4bd56cff7cd2 req-53af3f34-69c7-419b-910d-e591c4394a84 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 945 time: 0.3897836
Jun 03 08:34:32.024017 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9499daba-4fa2-45ad-bff2-4bd56cff7cd2 req-1a966769-0977-49e6-91df-aaa341a8ef0e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1196654
Jun 03 08:34:32.096648 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:34:32.167465 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15111fa7-22cc-4913-b7e2-44b9b5038c7f req-4bd315cb-8f0d-4773-8e2a-f46d2f172bf8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:32.179316 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-15111fa7-22cc-4913-b7e2-44b9b5038c7f req-4bd315cb-8f0d-4773-8e2a-f46d2f172bf8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 944 time: 0.1563416
Jun 03 08:34:32.184297 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-eb9f6781-8ec2-42e1-b56a-1d2582554545 req-9f3f0d39-f4f2-44f4-a90d-bfeb5e84ed6a tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:32.193260 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-d5ed628c-8fc5-47ac-92c0-af414e3bf199 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:34:32.327458 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-15111fa7-22cc-4913-b7e2-44b9b5038c7f req-311eba72-7736-4038-92b0-ad98a88f5b25 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1451821
Jun 03 08:34:32.332388 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f3f0d39-f4f2-44f4-a90d-bfeb5e84ed6a tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Pushing event deleted for resources: {'Port': ['ID=4da2f73c-9644-4280-92c1-e0be72f1fdad,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:34:32.406397 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-9f3f0d39-f4f2-44f4-a90d-bfeb5e84ed6a tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.213s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:34:32.550127 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-eb9f6781-8ec2-42e1-b56a-1d2582554545 req-9f3f0d39-f4f2-44f4-a90d-bfeb5e84ed6a tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] No DVR routers for this DVR port 4da2f73c-9644-4280-92c1-e0be72f1fdad on host hv-cinder-78726 {{(pid=92323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:34:32.554249 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-eb9f6781-8ec2-42e1-b56a-1d2582554545 req-9f3f0d39-f4f2-44f4-a90d-bfeb5e84ed6a tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:32.556895 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5377bc09-faa4-4050-8213-109ccb227085', 'name': 'network-vif-deleted', 'tag': '4da2f73c-9644-4280-92c1-e0be72f1fdad'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:34:32.559603 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5fb783c3-1ea4-4c40-9307-b11b3735e40d" -d '{"events": [{"server_uuid": "5377bc09-faa4-4050-8213-109ccb227085", "name": "network-vif-deleted", "tag": "4da2f73c-9644-4280-92c1-e0be72f1fdad"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:34:32.589421 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-d90c3cda-4aec-41b9-8010-1c538b6144d7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:32.629036 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b899a2bd-0dc3-4e1b-a9ad-6d1a27f5ab2b req-3474812c-51b0-45df-9f8d-75b18afaf1cb tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:32.645182 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b899a2bd-0dc3-4e1b-a9ad-6d1a27f5ab2b req-3474812c-51b0-45df-9f8d-75b18afaf1cb tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 943 time: 0.1672714
Jun 03 08:34:32.645602 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:34:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f0a9368f-e0ec-4ba0-a771-9098e4a85465 x-openstack-request-id: req-f0a9368f-e0ec-4ba0-a771-9098e4a85465 {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:34:32.645871 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5377bc09-faa4-4050-8213-109ccb227085", "name": "network-vif-deleted", "tag": "4da2f73c-9644-4280-92c1-e0be72f1fdad", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:34:32.646150 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-f0a9368f-e0ec-4ba0-a771-9098e4a85465 {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:34:32.651115 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5377bc09-faa4-4050-8213-109ccb227085', 'name': 'network-vif-deleted', 'tag': '4da2f73c-9644-4280-92c1-e0be72f1fdad', 'status': 'completed', 'code': 200}
Jun 03 08:34:32.710180 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b899a2bd-0dc3-4e1b-a9ad-6d1a27f5ab2b req-28e2b848-f155-4a71-acf8-f333ee7f5ebf tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0569353
Jun 03 08:34:32.740606 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-eb9f6781-8ec2-42e1-b56a-1d2582554545 req-9f3f0d39-f4f2-44f4-a90d-bfeb5e84ed6a tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.55 "DELETE /v2.0/ports/4da2f73c-9644-4280-92c1-e0be72f1fdad HTTP/1.1" status: 204  len: 173 time: 2.0360215
Jun 03 08:34:32.827633 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 37525065-c740-4aee-a826-af098f4b7727 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:34:32.845725 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 4da2f73c-9644-4280-92c1-e0be72f1fdad no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:34:32.890904 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] No Port match for: 4da2f73c-9644-4280-92c1-e0be72f1fdad {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:34:32.891470 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 4da2f73c-9644-4280-92c1-e0be72f1fdad not bound to the agent host hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:34:33.049222 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-265388ab-2de0-4a4b-af08-0d3924a47176 req-8b1ed6fb-f602-4ce9-8a0c-8d6601599947 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:33.056329 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-265388ab-2de0-4a4b-af08-0d3924a47176 req-8b1ed6fb-f602-4ce9-8a0c-8d6601599947 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.1100914
Jun 03 08:34:33.149313 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 37525065-c740-4aee-a826-af098f4b7727, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=37525065-c740-4aee-a826-af098f4b7727,segment=NetworkSegment(3151dd7e-a009-433b-ae5e-c81299e42bfb),segment_id=3151dd7e-a009-433b-ae5e-c81299e42bfb)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:34:33.159323 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-265388ab-2de0-4a4b-af08-0d3924a47176 req-6f959045-45fd-4168-896f-253d76087d2e tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0991678
Jun 03 08:34:33.185230 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': '37525065-c740-4aee-a826-af098f4b7727', 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6', 'port_id': '37525065-c740-4aee-a826-af098f4b7727', 'mac_address': 'fa:16:3e:df:27:b7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 525, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '159409d9-9245-4f6d-adbe-4aa8aad78d07', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:34:33.264963 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['24826ba2-ee17-4774-b5ca-2cd1675f325a', 'a309b335-7644-4c59-8d6b-90e763827a25'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:34:33.301885 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-d3dd4461-f02f-4f4d-b9b1-84a03bc8f7e4 req-57896897-6683-4efb-a727-50e45d820fa9 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Synchronizing usage tracker for tenant:7bac6d994f4d49b292bc39fac07c0311 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:34:33.328566 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:33.370004 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 37525065-c740-4aee-a826-af098f4b7727 {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:34:33.396674 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-d3dd4461-f02f-4f4d-b9b1-84a03bc8f7e4 req-57896897-6683-4efb-a727-50e45d820fa9 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Unset dirty status for tenant:7bac6d994f4d49b292bc39fac07c0311 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:34:33.405872 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d3dd4461-f02f-4f4d-b9b1-84a03bc8f7e4 req-57896897-6683-4efb-a727-50e45d820fa9 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=5377bc09-faa4-4050-8213-109ccb227085 HTTP/1.1" status: 200  len: 210 time: 0.1706424
Jun 03 08:34:33.421571 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 37525065-c740-4aee-a826-af098f4b7727, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=37525065-c740-4aee-a826-af098f4b7727,segment=NetworkSegment(3151dd7e-a009-433b-ae5e-c81299e42bfb),segment_id=3151dd7e-a009-433b-ae5e-c81299e42bfb)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:34:33.670826 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:33.672679 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:34:33.835772 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=37525065-c740-4aee-a826-af098f4b7727,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:34:33.840885 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:34:33.913314 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47324d65-c82e-4d54-b6a3-8b4311cae92d req-555b2157-bac0-4df9-a573-3b1db1c98f04 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:33.918124 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-47324d65-c82e-4d54-b6a3-8b4311cae92d req-555b2157-bac0-4df9-a573-3b1db1c98f04 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 944 time: 0.2299354
Jun 03 08:34:33.984727 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-47324d65-c82e-4d54-b6a3-8b4311cae92d req-98455dd6-d546-4bf4-87a8-1cd60ad2660e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0619295
Jun 03 08:34:34.033393 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af6cd715-3c84-44bf-938d-588c943b1a3b req-776e1945-d9b0-4417-9cd3-9cf8f8e297d3 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:34.037707 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['37525065-c740-4aee-a826-af098f4b7727'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:34:34.047908 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-af6cd715-3c84-44bf-938d-588c943b1a3b req-776e1945-d9b0-4417-9cd3-9cf8f8e297d3 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 944 time: 0.1146591
Jun 03 08:34:34.117384 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-af6cd715-3c84-44bf-938d-588c943b1a3b req-d3ddc2be-26bb-407e-80cd-f254d96064aa tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0630772
Jun 03 08:34:34.389093 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-864e85dc-645e-49bf-9819-e7bffc26c570 req-62224562-7a09-455f-866f-f5cffdb5421e tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:34.390402 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-864e85dc-645e-49bf-9819-e7bffc26c570 req-62224562-7a09-455f-866f-f5cffdb5421e tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.0968318
Jun 03 08:34:34.445164 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-864e85dc-645e-49bf-9819-e7bffc26c570 req-cb425387-49bf-4070-a18d-d0535919ef8d tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0483954
Jun 03 08:34:34.837479 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:34:34.887154 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:34.917356 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:34:34.917737 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:35.052907 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:35.098695 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0c731ecb-c3fc-401e-af74-34336582cf7d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:34:35.101055 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4308d662-f5b8-4e56-8121-c1e4ed844ec3" -d '{"events": [{"server_uuid": "0c731ecb-c3fc-401e-af74-34336582cf7d", "name": "network-vif-plugged", "status": "completed", "tag": "7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:34:35.110413 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:34:35.212773 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:35.214613 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:34:35.226079 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcecdde9-25f3-4d4f-aadc-fffd85cd7738 req-8df52b91-6439-45d4-a668-4051e78a3cd2 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:35.228773 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-dcecdde9-25f3-4d4f-aadc-fffd85cd7738 req-8df52b91-6439-45d4-a668-4051e78a3cd2 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 944 time: 0.0920224
Jun 03 08:34:35.334664 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:34:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f484beff-954c-4cc1-9f43-4dbc4056dd42 x-openstack-request-id: req-f484beff-954c-4cc1-9f43-4dbc4056dd42 {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:34:35.335813 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0c731ecb-c3fc-401e-af74-34336582cf7d", "name": "network-vif-plugged", "status": "completed", "tag": "7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:34:35.336695 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-f484beff-954c-4cc1-9f43-4dbc4056dd42 {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:34:35.337644 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0c731ecb-c3fc-401e-af74-34336582cf7d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97', 'code': 200}
Jun 03 08:34:35.345544 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-353ce2d5-08c6-42f9-8d40-e28a90b179a0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:35.351475 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-dcecdde9-25f3-4d4f-aadc-fffd85cd7738 req-4fd533a9-af57-41eb-80e3-d25112a34abf tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1128736
Jun 03 08:34:35.368881 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,revision_number=10']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:34:35.376531 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:34:35.573009 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af9c13e8-5569-4155-9357-92d442e282a4 req-56c31c74-b7b9-4fc3-8999-774dfd6073b9 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:35.581840 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-af9c13e8-5569-4155-9357-92d442e282a4 req-56c31c74-b7b9-4fc3-8999-774dfd6073b9 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 944 time: 0.1595933
Jun 03 08:34:35.605584 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-412bf14b-facc-4eff-abe0-8c341a83da82 req-48c73e9f-6cc4-4444-bfcb-d9aa77c1a9b8 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:35.607160 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-412bf14b-facc-4eff-abe0-8c341a83da82 req-48c73e9f-6cc4-4444-bfcb-d9aa77c1a9b8 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=1b72c068-99c2-4781-ad52-9c9c159b37ec HTTP/1.1" status: 200  len: 945 time: 0.0942371
Jun 03 08:34:35.645661 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-af9c13e8-5569-4155-9357-92d442e282a4 req-6993307c-f5de-437e-860a-8d060df146f2 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0590484
Jun 03 08:34:35.691682 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-412bf14b-facc-4eff-abe0-8c341a83da82 req-d8c84753-79db-4fa7-97dd-eefe481befa1 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0731175
Jun 03 08:34:35.905586 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db221e01-bc29-4468-8feb-3b18a2c1bc0f req-be81af6b-f7f5-4ba7-b1f6-00b9bf86a543 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:35.920829 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-db221e01-bc29-4468-8feb-3b18a2c1bc0f req-be81af6b-f7f5-4ba7-b1f6-00b9bf86a543 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.1575339
Jun 03 08:34:35.983590 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-db221e01-bc29-4468-8feb-3b18a2c1bc0f req-1a824ae2-3dac-4438-9c84-625f7856193a tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0598211
Jun 03 08:34:36.163491 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f80edcbc-4754-445f-9c47-06c94b34bd02 req-7f3dccd8-0072-4edc-9323-fd190e7c2528 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:36.165288 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f80edcbc-4754-445f-9c47-06c94b34bd02 req-7f3dccd8-0072-4edc-9323-fd190e7c2528 service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 1099 time: 0.0937667
Jun 03 08:34:36.217657 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f80edcbc-4754-445f-9c47-06c94b34bd02 req-5aecb876-d713-4261-a316-da3108bfc2b0 service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0446386
Jun 03 08:34:36.223985 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:36.583577 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbae2541-f086-45ee-81f0-e82546271f39 req-2d870382-6645-4e25-8ed4-a731e87ae6b8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:36.585126 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-cbae2541-f086-45ee-81f0-e82546271f39 req-2d870382-6645-4e25-8ed4-a731e87ae6b8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 946 time: 0.1002653
Jun 03 08:34:36.651487 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-cbae2541-f086-45ee-81f0-e82546271f39 req-b1c31b96-4626-4260-ac31-c8934f275acf tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0583889
Jun 03 08:34:36.836508 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81b756bc-af0d-482b-8cff-922062fbfa15 req-8ebce083-f85b-4180-bbd6-19c689f60b49 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:36.842135 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-81b756bc-af0d-482b-8cff-922062fbfa15 req-8ebce083-f85b-4180-bbd6-19c689f60b49 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 944 time: 0.0920863
Jun 03 08:34:36.842688 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 37525065-c740-4aee-a826-af098f4b7727 up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:34:36.890328 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-81b756bc-af0d-482b-8cff-922062fbfa15 req-babf1ec4-2f5c-48b3-9ced-6a8852f8f81b tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0462327
Jun 03 08:34:37.099575 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning for port 37525065-c740-4aee-a826-af098f4b7727 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:34:37.112794 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port 37525065-c740-4aee-a826-af098f4b7727 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:34:37.116184 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:37.141121 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b5509d8-9f99-4281-99c8-a311efb6c5c1 req-570c5bd7-8722-4623-ae80-c1515b56dfb8 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:37.143021 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2b5509d8-9f99-4281-99c8-a311efb6c5c1 req-570c5bd7-8722-4623-ae80-c1515b56dfb8 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=1b72c068-99c2-4781-ad52-9c9c159b37ec HTTP/1.1" status: 200  len: 945 time: 0.1342058
Jun 03 08:34:37.213917 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2b5509d8-9f99-4281-99c8-a311efb6c5c1 req-d3338f53-10a9-4441-ad4d-c91933485271 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0559387
Jun 03 08:34:37.370985 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:37.418981 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '529b1368-4218-45b2-ac64-62f1d985b8b2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '37525065-c740-4aee-a826-af098f4b7727'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:34:37.422111 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-71aabd92-122a-48e6-afa4-008cf4a88720" -d '{"events": [{"server_uuid": "529b1368-4218-45b2-ac64-62f1d985b8b2", "name": "network-vif-plugged", "status": "completed", "tag": "37525065-c740-4aee-a826-af098f4b7727"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:34:37.438305 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 37525065-c740-4aee-a826-af098f4b7727, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=37525065-c740-4aee-a826-af098f4b7727,segment=NetworkSegment(3151dd7e-a009-433b-ae5e-c81299e42bfb),segment_id=3151dd7e-a009-433b-ae5e-c81299e42bfb)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:34:37.478202 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb8de4ba-8b15-4615-9127-b3be7489ca35 req-81a1851c-c36a-4750-845b-7469c6483323 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:37.484021 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-cb8de4ba-8b15-4615-9127-b3be7489ca35 req-81a1851c-c36a-4750-845b-7469c6483323 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.55 "GET /v2.0/ports?device_id=1b72c068-99c2-4781-ad52-9c9c159b37ec HTTP/1.1" status: 200  len: 945 time: 0.1242151
Jun 03 08:34:37.495446 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-297ce89c-7c52-42a5-a3a0-b9a2c9e53ddb tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-805455383&fields=id&tenant_id=0e5e096a327f421e9b0a02235740cc36 HTTP/1.1" status: 200  len: 267 time: 0.1276340
Jun 03 08:34:37.514377 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:37.516895 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:34:37.728479 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=37525065-c740-4aee-a826-af098f4b7727,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:34:37.755362 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.230s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:34:37.893074 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-2707ca03-ce61-41af-bc69-cc6e0a5bfc9a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:37.912704 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-2707ca03-ce61-41af-bc69-cc6e0a5bfc9a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/networks?id=4a053960-3cf4-4216-b7a5-291ef61e89b7 HTTP/1.1" status: 200  len: 809 time: 0.3881974
Jun 03 08:34:37.939241 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-24966fb1-44b3-45f0-a088-42f39df849a0 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/quotas/0e5e096a327f421e9b0a02235740cc36 HTTP/1.1" status: 200  len: 375 time: 0.0259900
Jun 03 08:34:37.970233 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dea1bab2-419b-4e25-855b-b3a7560de70f req-4a442da1-12a2-43be-9e92-631a3b6cc222 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:37.972394 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-dea1bab2-419b-4e25-855b-b3a7560de70f req-4a442da1-12a2-43be-9e92-631a3b6cc222 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.3467069
Jun 03 08:34:38.024444 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-cb8de4ba-8b15-4615-9127-b3be7489ca35 req-c83e0499-4682-4dc9-b360-f81f839d77dc tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Deleting port a309b335-7644-4c59-8d6b-90e763827a25 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:34:38.024444 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-cb8de4ba-8b15-4615-9127-b3be7489ca35 req-c83e0499-4682-4dc9-b360-f81f839d77dc tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:38.043570 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:38.056890 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-5ecdc6cd-46d7-4d78-8366-5cd0a5cde91a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=0e5e096a327f421e9b0a02235740cc36&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1157634
Jun 03 08:34:38.082815 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-dea1bab2-419b-4e25-855b-b3a7560de70f req-24a3e422-1537-4ae0-be37-2463f6b591aa tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1017139
Jun 03 08:34:38.158616 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:34:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a1083f46-720c-49f9-a7b2-ce792717f3ab x-openstack-request-id: req-a1083f46-720c-49f9-a7b2-ce792717f3ab {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:34:38.158616 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "529b1368-4218-45b2-ac64-62f1d985b8b2", "name": "network-vif-plugged", "status": "completed", "tag": "37525065-c740-4aee-a826-af098f4b7727", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:34:38.159347 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-a1083f46-720c-49f9-a7b2-ce792717f3ab {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:34:38.159613 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '529b1368-4218-45b2-ac64-62f1d985b8b2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '37525065-c740-4aee-a826-af098f4b7727', 'code': 200}
Jun 03 08:34:38.238024 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-cb8de4ba-8b15-4615-9127-b3be7489ca35 req-c83e0499-4682-4dc9-b360-f81f839d77dc tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] For port a309b335-7644-4c59-8d6b-90e763827a25, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=a309b335-7644-4c59-8d6b-90e763827a25,segment=NetworkSegment(9923ac74-9556-45ec-9044-43728d2a8ec3),segment_id=9923ac74-9556-45ec-9044-43728d2a8ec3)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:34:38.238841 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-cb8de4ba-8b15-4615-9127-b3be7489ca35 req-c83e0499-4682-4dc9-b360-f81f839d77dc tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:38.245167 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-7a378109-eba8-4a0a-8b1b-d47f97eab3e3 service neutron] 10.222.0.11 "GET /v2.0/networks/4a053960-3cf4-4216-b7a5-291ef61e89b7?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1712201
Jun 03 08:34:38.562915 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-b27da912-d5e8-4ad4-b1c8-e62be4734fc1 service neutron] 10.222.0.11 "GET /v2.0/networks/4a053960-3cf4-4216-b7a5-291ef61e89b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3153527
Jun 03 08:34:38.608283 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-cb8de4ba-8b15-4615-9127-b3be7489ca35 req-c83e0499-4682-4dc9-b360-f81f839d77dc tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Calling delete_port for a309b335-7644-4c59-8d6b-90e763827a25 owned by compute:nova {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:34:38.687722 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d63734e1-cf4a-496d-8d11-9fb36081a89e req-ca46c527-637e-4475-a231-17d9c653fe1d tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:38.689236 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d63734e1-cf4a-496d-8d11-9fb36081a89e req-ca46c527-637e-4475-a231-17d9c653fe1d tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 946 time: 0.3332715
Jun 03 08:34:38.958984 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d63734e1-cf4a-496d-8d11-9fb36081a89e req-5e9b6793-8989-4b9f-af1c-b72388247180 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2586019
Jun 03 08:34:39.004354 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5a67d86-5dd4-4700-b6db-4b209c6ea5b8 req-76bb59bb-7aeb-43ef-98a1-4044c33d2ddd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:39.010920 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f5a67d86-5dd4-4700-b6db-4b209c6ea5b8 req-76bb59bb-7aeb-43ef-98a1-4044c33d2ddd service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 1098 time: 0.3094440
Jun 03 08:34:39.139048 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-cb8de4ba-8b15-4615-9127-b3be7489ca35 req-c83e0499-4682-4dc9-b360-f81f839d77dc tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:39.150109 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['24826ba2-ee17-4774-b5ca-2cd1675f325a'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:34:39.225816 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-e2fb12e7-3cf9-43ae-8a33-427283df1769 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:34:39.303609 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c83e0499-4682-4dc9-b360-f81f839d77dc tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Pushing event deleted for resources: {'Port': ['ID=a309b335-7644-4c59-8d6b-90e763827a25,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:34:39.319695 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c83e0499-4682-4dc9-b360-f81f839d77dc tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:34:39.419702 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f5a67d86-5dd4-4700-b6db-4b209c6ea5b8 req-e65adf96-d320-4419-9f3f-16aeeccebfb9 service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3997445
Jun 03 08:34:39.458035 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-cb8de4ba-8b15-4615-9127-b3be7489ca35 req-c83e0499-4682-4dc9-b360-f81f839d77dc tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] No DVR routers for this DVR port a309b335-7644-4c59-8d6b-90e763827a25 on host hv-cinder-78726 {{(pid=92323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:34:39.461357 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-cb8de4ba-8b15-4615-9127-b3be7489ca35 req-c83e0499-4682-4dc9-b360-f81f839d77dc tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:39.464034 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1b72c068-99c2-4781-ad52-9c9c159b37ec', 'name': 'network-vif-deleted', 'tag': 'a309b335-7644-4c59-8d6b-90e763827a25'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:34:39.466283 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-61ed9a17-ccdc-49bd-a5cd-1fe2ab5765da" -d '{"events": [{"server_uuid": "1b72c068-99c2-4781-ad52-9c9c159b37ec", "name": "network-vif-deleted", "tag": "a309b335-7644-4c59-8d6b-90e763827a25"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:34:39.505228 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c80f28af-2149-4a73-8f92-920802cbecfb req-09680987-b101-47e3-9409-f17ab6f9d016 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:39.515020 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c80f28af-2149-4a73-8f92-920802cbecfb req-09680987-b101-47e3-9409-f17ab6f9d016 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 945 time: 0.3811214
Jun 03 08:34:39.572706 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-cb8de4ba-8b15-4615-9127-b3be7489ca35 req-c83e0499-4682-4dc9-b360-f81f839d77dc tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.55 "DELETE /v2.0/ports/a309b335-7644-4c59-8d6b-90e763827a25 HTTP/1.1" status: 204  len: 173 time: 2.0736208
Jun 03 08:34:39.614731 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c80f28af-2149-4a73-8f92-920802cbecfb req-f759d808-772f-48f3-9ce6-d7f716d1f128 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0985141
Jun 03 08:34:39.639924 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c0d81d50-527c-4235-8f58-3ada09350b02 req-00cbd5e9-5bd4-42e2-b52e-4607a707c88f tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=1b72c068-99c2-4781-ad52-9c9c159b37ec HTTP/1.1" status: 200  len: 210 time: 0.0928972
Jun 03 08:34:40.009355 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ebb9fef-99e9-492f-b5aa-e5feb7068608 req-1acd9b1b-6ed2-451b-835e-a8ffd394aac1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:40.011252 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8ebb9fef-99e9-492f-b5aa-e5feb7068608 req-1acd9b1b-6ed2-451b-835e-a8ffd394aac1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.1357837
Jun 03 08:34:40.064592 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8ebb9fef-99e9-492f-b5aa-e5feb7068608 req-f7f55104-913c-41c6-a36d-1a0dd02c74e8 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0444453
Jun 03 08:34:40.206775 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c9d6f560-16f2-45d9-9513-7c941ef0690e req-68651e06-0843-42ea-b761-aead760e4e32 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 210 time: 0.0872931
Jun 03 08:34:40.258933 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:34:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-83efd212-8ee8-4379-a295-a886d0bc750c x-openstack-request-id: req-83efd212-8ee8-4379-a295-a886d0bc750c {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:34:40.259527 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1b72c068-99c2-4781-ad52-9c9c159b37ec", "name": "network-vif-deleted", "tag": "a309b335-7644-4c59-8d6b-90e763827a25", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:34:40.259813 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-83efd212-8ee8-4379-a295-a886d0bc750c {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:34:40.260548 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1b72c068-99c2-4781-ad52-9c9c159b37ec', 'name': 'network-vif-deleted', 'tag': 'a309b335-7644-4c59-8d6b-90e763827a25', 'status': 'completed', 'code': 200}
Jun 03 08:34:40.484127 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-897f98aa-d4fb-46f0-9f83-dbc1d999b8d0 req-0ab8227c-4efa-48c2-86e7-0aebd2502765 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:40.486764 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-897f98aa-d4fb-46f0-9f83-dbc1d999b8d0 req-0ab8227c-4efa-48c2-86e7-0aebd2502765 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 946 time: 0.1251485
Jun 03 08:34:40.572317 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-897f98aa-d4fb-46f0-9f83-dbc1d999b8d0 req-0ab66510-3be2-438c-851e-37877384cea4 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0776424
Jun 03 08:34:40.865553 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device a309b335-7644-4c59-8d6b-90e763827a25 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:34:40.982679 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] No Port match for: a309b335-7644-4c59-8d6b-90e763827a25 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:34:40.985520 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device a309b335-7644-4c59-8d6b-90e763827a25 not bound to the agent host hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:34:41.005091 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbe64347-9626-4f9c-bb59-aaa7b275a985 req-324228ab-d8d0-4164-98bb-d4a9d53849cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:41.007355 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-bbe64347-9626-4f9c-bb59-aaa7b275a985 req-324228ab-d8d0-4164-98bb-d4a9d53849cb service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=b9cf7834ca79439981d1f8e77b89daed&device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 1099 time: 0.1815810
Jun 03 08:34:41.021994 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-610a4156-0757-4f45-813e-d407ca3814e6 req-d7bd22e9-6dc3-4478-bf2a-5c44b0ba5b83 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:41.023358 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd529fed-92c6-4730-88f2-f0217df8d7a3 req-85da93b1-cf3b-4dc1-957d-8ee3d015af40 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:41.030503 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-610a4156-0757-4f45-813e-d407ca3814e6 req-d7bd22e9-6dc3-4478-bf2a-5c44b0ba5b83 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.2818813
Jun 03 08:34:41.032444 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-fd529fed-92c6-4730-88f2-f0217df8d7a3 req-85da93b1-cf3b-4dc1-957d-8ee3d015af40 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 945 time: 0.1720974
Jun 03 08:34:41.147757 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-610a4156-0757-4f45-813e-d407ca3814e6 req-5de0db57-30b7-4ec0-8df6-46f66db6b6d6 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1159630
Jun 03 08:34:41.151167 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-fd529fed-92c6-4730-88f2-f0217df8d7a3 req-757c18da-f535-421d-80de-595e0e412db5 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1174333
Jun 03 08:34:41.342180 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbe64347-9626-4f9c-bb59-aaa7b275a985 req-c4ff9b66-6f08-488b-8d1d-7cc350c54d5d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:41.343702 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-bbe64347-9626-4f9c-bb59-aaa7b275a985 req-c4ff9b66-6f08-488b-8d1d-7cc350c54d5d service neutron] 10.222.0.55 "GET /v2.0/networks?id=6861b4db-6cd2-4a5b-bf02-87826345c933 HTTP/1.1" status: 200  len: 920 time: 0.3105733
Jun 03 08:34:41.438065 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f513dd16-8f94-4bf7-8aee-6713f97b78eb req-7cc2e6b2-d8ad-4300-9a2c-69b099e044b8 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:41.440342 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f513dd16-8f94-4bf7-8aee-6713f97b78eb req-7cc2e6b2-d8ad-4300-9a2c-69b099e044b8 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.1168146
Jun 03 08:34:41.501264 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f513dd16-8f94-4bf7-8aee-6713f97b78eb req-13d342b1-1f39-48d2-a51c-3af4e3a63b75 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0519409
Jun 03 08:34:41.505429 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-cc4b852c-4d08-42af-8029-5414f6c0c937 req-2e03162c-724c-48bb-9a6b-8f80f3c94e12 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Synchronizing usage tracker for tenant:7bac6d994f4d49b292bc39fac07c0311 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:34:41.525533 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-bbe64347-9626-4f9c-bb59-aaa7b275a985 req-cfe8ec27-63da-4fbf-82fd-6667b371af42 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=716f2131-2965-4ead-984f-8ccfcadea071 HTTP/1.1" status: 200  len: 217 time: 0.0896099
Jun 03 08:34:41.592874 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbe64347-9626-4f9c-bb59-aaa7b275a985 req-a4b88d1a-3114-45d1-8d34-69b78c308bbb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:41.594485 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-bbe64347-9626-4f9c-bb59-aaa7b275a985 req-a4b88d1a-3114-45d1-8d34-69b78c308bbb service neutron] 10.222.0.55 "GET /v2.0/subnets?id=0ea4966f-f9de-4d69-a774-7746b1ee12ee HTTP/1.1" status: 200  len: 859 time: 0.0745280
Jun 03 08:34:41.665604 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-65e25b2e-361f-445e-b704-2046ab535eb7 req-901dbedb-9357-4c6e-8666-b0c6fd1d2560 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 210 time: 0.0577054
Jun 03 08:34:41.665841 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-bbe64347-9626-4f9c-bb59-aaa7b275a985 req-458c408b-d453-4df4-bc57-e0491661980a service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=6861b4db-6cd2-4a5b-bf02-87826345c933&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0631430
Jun 03 08:34:41.714401 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-cc4b852c-4d08-42af-8029-5414f6c0c937 req-2e03162c-724c-48bb-9a6b-8f80f3c94e12 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Unset dirty status for tenant:7bac6d994f4d49b292bc39fac07c0311 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:34:41.715589 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-cc4b852c-4d08-42af-8029-5414f6c0c937 req-2e03162c-724c-48bb-9a6b-8f80f3c94e12 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=1b72c068-99c2-4781-ad52-9c9c159b37ec HTTP/1.1" status: 200  len: 210 time: 0.3756938
Jun 03 08:34:41.916872 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-bbe64347-9626-4f9c-bb59-aaa7b275a985 req-14e7d47f-efdb-4c9e-ae1e-0674a8267e53 service neutron] 10.222.0.55 "GET /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2258627
Jun 03 08:34:42.003068 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-788daf27-e4ad-4b4d-a25c-13d46b300844 req-bfe17c86-9494-4617-a0cf-d8dbaea9235c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:42.005101 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-788daf27-e4ad-4b4d-a25c-13d46b300844 req-bfe17c86-9494-4617-a0cf-d8dbaea9235c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 946 time: 0.2178175
Jun 03 08:34:42.077151 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-788daf27-e4ad-4b4d-a25c-13d46b300844 req-896aa653-d9ff-47d7-a159-7fc4f4412c2d tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0652454
Jun 03 08:34:42.145683 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-bbe64347-9626-4f9c-bb59-aaa7b275a985 req-8b754ff4-c001-4bf1-8ea1-414f19eed62c service neutron] 10.222.0.55 "GET /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2137866
Jun 03 08:34:42.430223 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70de8a9f-ac2c-4cc6-b789-183525a4107a req-4bdd8be7-23e2-4d03-98db-7a782eebfde1 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:42.431795 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-70de8a9f-ac2c-4cc6-b789-183525a4107a req-4bdd8be7-23e2-4d03-98db-7a782eebfde1 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 945 time: 0.1254859
Jun 03 08:34:42.449438 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d1b49a3-ca1a-43d0-b50e-b72bfdcdbbc1 req-2703cdb4-d560-4f40-a6f1-b3e191605e87 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:42.451470 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6d1b49a3-ca1a-43d0-b50e-b72bfdcdbbc1 req-2703cdb4-d560-4f40-a6f1-b3e191605e87 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1283679
Jun 03 08:34:42.484453 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-70de8a9f-ac2c-4cc6-b789-183525a4107a req-b75929bc-6d32-4096-a265-0a586a7b2787 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0464540
Jun 03 08:34:42.510974 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6d1b49a3-ca1a-43d0-b50e-b72bfdcdbbc1 req-c58d7df6-c271-4b99-8254-e37f6fec5e4c tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0420806
Jun 03 08:34:42.718047 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa1f5fd4-c872-4687-ade8-f0e4caad6dca req-244bb047-dcb6-499f-a1ae-7d1b6cbc6fbf tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:42.719662 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-aa1f5fd4-c872-4687-ade8-f0e4caad6dca req-244bb047-dcb6-499f-a1ae-7d1b6cbc6fbf tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 945 time: 0.1023021
Jun 03 08:34:42.724613 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88a9b10c-4605-4061-93d0-742f7f0334a3 req-344c8db2-8306-4b06-ada1-69c96d461da9 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:42.726142 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-88a9b10c-4605-4061-93d0-742f7f0334a3 req-344c8db2-8306-4b06-ada1-69c96d461da9 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.1071455
Jun 03 08:34:42.777202 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-aa1f5fd4-c872-4687-ade8-f0e4caad6dca req-06318255-b539-44a4-b78a-a30a4f78945a tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0467310
Jun 03 08:34:42.789402 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-88a9b10c-4605-4061-93d0-742f7f0334a3 req-688762dc-405b-46d4-9de5-f095fe9d5a4a tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0572758
Jun 03 08:34:42.963785 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8fad3dbb-5416-4b6d-a309-309bc1dc7da2 req-41cc0b4f-401e-4229-9f7f-0bd4df954675 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 210 time: 0.0528171
Jun 03 08:34:43.475066 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90555919-3775-4b37-8be7-daeeacd75518 req-6ae3b905-7d5f-40aa-815d-5f9786ac901d tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:43.476592 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-90555919-3775-4b37-8be7-daeeacd75518 req-6ae3b905-7d5f-40aa-815d-5f9786ac901d tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 945 time: 0.2107542
Jun 03 08:34:43.533987 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-be0b1733-9e67-4e82-b842-e69f3632bb68 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:43.535651 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-be0b1733-9e67-4e82-b842-e69f3632bb68 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Synchronizing usage tracker for tenant:0e5e096a327f421e9b0a02235740cc36 on resource:network {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:34:43.574130 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-90555919-3775-4b37-8be7-daeeacd75518 req-6ea90f52-ac75-4151-ac35-a9d9badd1a69 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0893567
Jun 03 08:34:43.660249 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-be0b1733-9e67-4e82-b842-e69f3632bb68 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Unset dirty status for tenant:0e5e096a327f421e9b0a02235740cc36 on resource:network {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:34:43.663409 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-be0b1733-9e67-4e82-b842-e69f3632bb68 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.55 "GET /v2.0/networks?id=4a053960-3cf4-4216-b7a5-291ef61e89b7 HTTP/1.1" status: 200  len: 809 time: 0.4996092
Jun 03 08:34:43.873410 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-d4bae484-f0cd-4aa8-96bc-3266db4fb581 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Synchronizing usage tracker for tenant:0e5e096a327f421e9b0a02235740cc36 on resource:security_group {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:34:43.911677 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45eabfb6-ef34-4d9b-a38e-d0a78d81053f req-bab71c72-8ba8-4d43-b037-a44a7be3c2ae tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:43.919132 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-45eabfb6-ef34-4d9b-a38e-d0a78d81053f req-bab71c72-8ba8-4d43-b037-a44a7be3c2ae tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1756668
Jun 03 08:34:44.047663 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-d4bae484-f0cd-4aa8-96bc-3266db4fb581 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Unset dirty status for tenant:0e5e096a327f421e9b0a02235740cc36 on resource:security_group {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:34:44.048722 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-d4bae484-f0cd-4aa8-96bc-3266db4fb581 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.55 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=0e5e096a327f421e9b0a02235740cc36 HTTP/1.1" status: 200  len: 379 time: 0.3749425
Jun 03 08:34:44.066362 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-45eabfb6-ef34-4d9b-a38e-d0a78d81053f req-498d6a7f-c993-46b0-a9c5-de3d198ab80f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1462388
Jun 03 08:34:44.086841 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-2ff9f0b8-3dd6-4eef-bfc4-bf09351c174b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Request body: {'port': {'device_id': '80cea05e-57d7-4393-818e-b7a621e986ec', 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7', 'admin_state_up': True, 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'security_groups': ['c0e8810d-eeaf-4d32-941d-aa11dff38d92']}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:34:44.131070 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-878ab111-ab9e-4ab1-979d-082bd611ee10 req-2d1ba3f9-0ed8-42c4-b410-a800d1b33d2a tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:44.132654 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-878ab111-ab9e-4ab1-979d-082bd611ee10 req-2d1ba3f9-0ed8-42c4-b410-a800d1b33d2a tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.1344464
Jun 03 08:34:44.210623 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-878ab111-ab9e-4ab1-979d-082bd611ee10 req-9f6f4022-ecfa-4657-a564-4f8262ccf0a9 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0713155
Jun 03 08:34:44.319893 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-4e4e3895-a46c-4d6c-8ba2-609e9770624b req-e978e11f-a323-4615-ab0c-0bba39b27e07 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Synchronizing usage tracker for tenant:0e5e096a327f421e9b0a02235740cc36 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:34:44.391554 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-2ff9f0b8-3dd6-4eef-bfc4-bf09351c174b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:34:44.453684 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-4e4e3895-a46c-4d6c-8ba2-609e9770624b req-e978e11f-a323-4615-ab0c-0bba39b27e07 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Unset dirty status for tenant:0e5e096a327f421e9b0a02235740cc36 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:34:44.463307 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4e4e3895-a46c-4d6c-8ba2-609e9770624b req-e978e11f-a323-4615-ab0c-0bba39b27e07 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 210 time: 0.2171967
Jun 03 08:34:44.463307 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-2ff9f0b8-3dd6-4eef-bfc4-bf09351c174b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Usage tracker for resource:port and tenant:0e5e096a327f421e9b0a02235740cc36 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:34:44.470454 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-2ff9f0b8-3dd6-4eef-bfc4-bf09351c174b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Quota usage for port was recalculated. Used quota:2. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:34:44.492578 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-2ff9f0b8-3dd6-4eef-bfc4-bf09351c174b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:34:44.662924 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-2ff9f0b8-3dd6-4eef-bfc4-bf09351c174b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Made reservation on behalf of 0e5e096a327f421e9b0a02235740cc36 for: {'port': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:34:44.667785 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-2ff9f0b8-3dd6-4eef-bfc4-bf09351c174b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:44.874478 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-2ff9f0b8-3dd6-4eef-bfc4-bf09351c174b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Allocated IP 172.20.0.13 (4a053960-3cf4-4216-b7a5-291ef61e89b7/fc181126-7c66-44d3-b731-a59036bd562f/4312e3c9-0931-4dd5-ba11-db0d982c2a11) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:34:45.149896 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-2ff9f0b8-3dd6-4eef-bfc4-bf09351c174b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:45.173686 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-2ff9f0b8-3dd6-4eef-bfc4-bf09351c174b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Transition to ACTIVE for port object 4312e3c9-0931-4dd5-ba11-db0d982c2a11 will not be triggered until provisioned by entity DHCP. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:34:45.298285 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-2ff9f0b8-3dd6-4eef-bfc4-bf09351c174b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:45.309873 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:34:45.374911 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34f2447-cf31-4370-bbd1-ef67f004d614 req-39ffaaad-96da-45f8-b7af-de90a62a381b tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:45.389234 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a34f2447-cf31-4370-bbd1-ef67f004d614 req-39ffaaad-96da-45f8-b7af-de90a62a381b tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1294231
Jun 03 08:34:45.392396 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-2ff9f0b8-3dd6-4eef-bfc4-bf09351c174b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Network 4a053960-3cf4-4216-b7a5-291ef61e89b7 is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:34:45.400512 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-2ff9f0b8-3dd6-4eef-bfc4-bf09351c174b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:34:45.405947 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-2ff9f0b8-3dd6-4eef-bfc4-bf09351c174b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:34:45.412423 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-2ff9f0b8-3dd6-4eef-bfc4-bf09351c174b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:45.413445 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-2ff9f0b8-3dd6-4eef-bfc4-bf09351c174b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:45.417803 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ff9f0b8-3dd6-4eef-bfc4-bf09351c174b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Pushing event updated for resources: {'Port': ['ID=4312e3c9-0931-4dd5-ba11-db0d982c2a11,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:34:45.428611 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-2ff9f0b8-3dd6-4eef-bfc4-bf09351c174b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:34:45.465613 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-083a690f-6b94-4090-b262-53d4baac16e3 req-cae9dfe6-79de-4013-8f84-ea7f7d671388 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:45.469307 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-083a690f-6b94-4090-b262-53d4baac16e3 req-cae9dfe6-79de-4013-8f84-ea7f7d671388 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 946 time: 0.2135520
Jun 03 08:34:45.479259 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a34f2447-cf31-4370-bbd1-ef67f004d614 req-971da592-9e1c-49ae-8fad-5fbeacc356a2 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0879030
Jun 03 08:34:45.544095 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-2ff9f0b8-3dd6-4eef-bfc4-bf09351c174b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.55 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.4715638
Jun 03 08:34:45.557137 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-083a690f-6b94-4090-b262-53d4baac16e3 req-37198b34-90bd-4a65-99b7-cd723f5628d3 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0748923
Jun 03 08:34:45.564094 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Request body: {'port': {'device_id': '80cea05e-57d7-4393-818e-b7a621e986ec', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:34:45.727867 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:45.864223 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9129fe8e-1d05-4c3a-893d-16a2b6bd622a req-f86bf326-8eb8-4f4b-9b75-2ea2951689a7 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:45.870983 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-9129fe8e-1d05-4c3a-893d-16a2b6bd622a req-f86bf326-8eb8-4f4b-9b75-2ea2951689a7 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.2292678
Jun 03 08:34:45.971372 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-7d71417e-e67e-4abd-8f99-4fa72bfacf77 None None] Provisioning for port 4312e3c9-0931-4dd5-ba11-db0d982c2a11 completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:34:45.979731 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-7d71417e-e67e-4abd-8f99-4fa72bfacf77 None None] Provisioning complete for port 4312e3c9-0931-4dd5-ba11-db0d982c2a11 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:34:45.980402 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-7d71417e-e67e-4abd-8f99-4fa72bfacf77 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:46.008092 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-9129fe8e-1d05-4c3a-893d-16a2b6bd622a req-57072e44-7ffa-493c-bc9c-a813838d1e8c tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1221995
Jun 03 08:34:46.074026 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-171afcbf-e156-4e43-b3e7-164524a62a5f req-7897adb9-101d-4933-bf2c-6c75f3aeeb02 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:46.074829 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-171afcbf-e156-4e43-b3e7-164524a62a5f req-7897adb9-101d-4933-bf2c-6c75f3aeeb02 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Synchronizing usage tracker for tenant:0e5e096a327f421e9b0a02235740cc36 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:34:46.149138 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-7d71417e-e67e-4abd-8f99-4fa72bfacf77 None None] Port 4312e3c9-0931-4dd5-ba11-db0d982c2a11 cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:34:46.204453 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-171afcbf-e156-4e43-b3e7-164524a62a5f req-7897adb9-101d-4933-bf2c-6c75f3aeeb02 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Unset dirty status for tenant:0e5e096a327f421e9b0a02235740cc36 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:34:46.211196 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-171afcbf-e156-4e43-b3e7-164524a62a5f req-7897adb9-101d-4933-bf2c-6c75f3aeeb02 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 932 time: 0.4378209
Jun 03 08:34:46.290625 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-171afcbf-e156-4e43-b3e7-164524a62a5f req-7d065dcd-88d0-49ec-bb20-f3c130c0d330 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0783772
Jun 03 08:34:46.434382 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4312e3c9-0931-4dd5-ba11-db0d982c2a11 {{(pid=92323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:34:46.445951 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:46.468973 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Transition to ACTIVE for port object 4312e3c9-0931-4dd5-ba11-db0d982c2a11 will not be triggered until provisioned by entity L2. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:34:46.589502 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:46.595896 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a157741f-ca5d-4f7f-822f-40edf4d8e26e tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:34:46.938759 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Pushing event updated for resources: {'Port': ['ID=4312e3c9-0931-4dd5-ba11-db0d982c2a11,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:34:46.942682 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Attempting to bind port 4312e3c9-0931-4dd5-ba11-db0d982c2a11 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:34:46.943023 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Attempting to bind port 4312e3c9-0931-4dd5-ba11-db0d982c2a11 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': 'aaa5b128-9aff-431e-b567-4ca42a016de6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7'}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:34:46.943349 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Attempting to bind port 4312e3c9-0931-4dd5-ba11-db0d982c2a11 on network 4a053960-3cf4-4216-b7a5-291ef61e89b7 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:34:46.954275 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.358s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:34:46.965837 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Port 4312e3c9-0931-4dd5-ba11-db0d982c2a11 on network 4a053960-3cf4-4216-b7a5-291ef61e89b7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 03 08:34:46.965837 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Attempting to bind port 4312e3c9-0931-4dd5-ba11-db0d982c2a11 on network 4a053960-3cf4-4216-b7a5-291ef61e89b7 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:34:46.976672 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Checking agent: {'id': '181c5753-100b-4f03-bda8-e34279b057f4', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'started_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 34, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:34:46.977096 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Checking segment: {'id': 'aaa5b128-9aff-431e-b567-4ca42a016de6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:34:46.977588 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Bound using segment: {'id': 'aaa5b128-9aff-431e-b567-4ca42a016de6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7'} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:34:46.978107 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Bound port: 4312e3c9-0931-4dd5-ba11-db0d982c2a11, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'aaa5b128-9aff-431e-b567-4ca42a016de6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 503, 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7'}}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:34:46.978543 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:47.000972 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-647fdfe3-7918-405d-ad51-fa083f5f931e req-85b872ec-49a1-42da-80ba-65fdaea4074e tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:47.002665 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-647fdfe3-7918-405d-ad51-fa083f5f931e req-85b872ec-49a1-42da-80ba-65fdaea4074e tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.3061426
Jun 03 08:34:47.229662 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] For port 4312e3c9-0931-4dd5-ba11-db0d982c2a11, host hv-cinder-78726, cleared binding levels {{(pid=92323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:34:47.244449 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-647fdfe3-7918-405d-ad51-fa083f5f931e req-c31ffd2e-6f6a-4f6f-a0dd-b545db3375a9 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1017642
Jun 03 08:34:47.246162 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] For port 4312e3c9-0931-4dd5-ba11-db0d982c2a11, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=4312e3c9-0931-4dd5-ba11-db0d982c2a11,segment=NetworkSegment(aaa5b128-9aff-431e-b567-4ca42a016de6),segment_id=aaa5b128-9aff-431e-b567-4ca42a016de6)] {{(pid=92323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:34:47.453216 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-230bcf07-25f7-42fd-8eb8-bed035572a5a req-d65310bb-98d3-483f-bec7-d445c444a0e7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:47.456968 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-230bcf07-25f7-42fd-8eb8-bed035572a5a req-d65310bb-98d3-483f-bec7-d445c444a0e7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 946 time: 0.1102405
Jun 03 08:34:47.506741 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-230bcf07-25f7-42fd-8eb8-bed035572a5a req-5eecd64d-1264-4fc8-bd05-ed9ddec6e47c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0439961
Jun 03 08:34:47.599529 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2870d0f3-4085-4813-a5b7-be5f81606ab8 req-4a7f1d47-6bcd-4ae7-aa7e-592c3886057b tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:47.600973 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2870d0f3-4085-4813-a5b7-be5f81606ab8 req-4a7f1d47-6bcd-4ae7-aa7e-592c3886057b tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.55 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 946 time: 0.0851572
Jun 03 08:34:47.675521 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:47.725073 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:34:47.824716 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:47.825396 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:47.826854 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] 10.222.0.55 "PUT /v2.0/ports/4312e3c9-0931-4dd5-ba11-db0d982c2a11 HTTP/1.1" status: 200  len: 1094 time: 2.2683754
Jun 03 08:34:47.909035 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '80cea05e-57d7-4393-818e-b7a621e986ec', 'tag': '4312e3c9-0931-4dd5-ba11-db0d982c2a11'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:34:47.911761 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8ead2bbc-bc55-4634-a464-8128f5ab4295" -d '{"events": [{"name": "network-changed", "server_uuid": "80cea05e-57d7-4393-818e-b7a621e986ec", "tag": "4312e3c9-0931-4dd5-ba11-db0d982c2a11"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:34:47.958999 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Pushing event updated for resources: {'Port': ['ID=4312e3c9-0931-4dd5-ba11-db0d982c2a11,revision_number=3']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:34:47.965988 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.241s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:34:48.022151 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82539bc5-9a48-4114-a14d-c9da891cd6b4 req-60d3afc9-054d-48f8-8aac-425b28dcbd7b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:48.030773 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-82539bc5-9a48-4114-a14d-c9da891cd6b4 req-60d3afc9-054d-48f8-8aac-425b28dcbd7b tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.3644760
Jun 03 08:34:48.106581 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-2870d0f3-4085-4813-a5b7-be5f81606ab8 req-0fe7ae5e-e199-4985-ac68-13977032a0c2 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Deleting port 24826ba2-ee17-4774-b5ca-2cd1675f325a {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:34:48.106893 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-2870d0f3-4085-4813-a5b7-be5f81606ab8 req-0fe7ae5e-e199-4985-ac68-13977032a0c2 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:48.327335 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-82539bc5-9a48-4114-a14d-c9da891cd6b4 req-822d7ad9-1eac-40ba-8ac5-809636bfed40 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2955394
Jun 03 08:34:48.379900 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-bf0a3a51-3307-494a-8922-ceb14c48e801 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:48.381768 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-bf0a3a51-3307-494a-8922-ceb14c48e801 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=0e5e096a327f421e9b0a02235740cc36&device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 1097 time: 0.3401434
Jun 03 08:34:48.506458 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-872d5cda-9a2a-4809-b38a-b8728db21867 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4312e3c9-0931-4dd5-ba11-db0d982c2a11 HTTP/1.1" status: 200  len: 217 time: 0.0942228
Jun 03 08:34:48.509712 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:34:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-92036ec8-55e2-4a7a-8c4b-3663c99abee1 x-openstack-request-id: req-92036ec8-55e2-4a7a-8c4b-3663c99abee1 {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:34:48.510028 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "80cea05e-57d7-4393-818e-b7a621e986ec", "tag": "4312e3c9-0931-4dd5-ba11-db0d982c2a11", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:34:48.510302 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-92036ec8-55e2-4a7a-8c4b-3663c99abee1 {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:34:48.510797 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '80cea05e-57d7-4393-818e-b7a621e986ec', 'tag': '4312e3c9-0931-4dd5-ba11-db0d982c2a11', 'status': 'completed', 'code': 200}
Jun 03 08:34:48.569786 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b0fe16a-d526-4ef4-9e97-f5623bef172d req-936d0a3e-c99a-4bd0-bb51-e78e4250f6f9 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:48.578575 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-5b0fe16a-d526-4ef4-9e97-f5623bef172d req-936d0a3e-c99a-4bd0-bb51-e78e4250f6f9 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 944 time: 0.1092572
Jun 03 08:34:48.614556 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-2870d0f3-4085-4813-a5b7-be5f81606ab8 req-0fe7ae5e-e199-4985-ac68-13977032a0c2 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] For port 24826ba2-ee17-4774-b5ca-2cd1675f325a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=24826ba2-ee17-4774-b5ca-2cd1675f325a,segment=NetworkSegment(9923ac74-9556-45ec-9044-43728d2a8ec3),segment_id=9923ac74-9556-45ec-9044-43728d2a8ec3)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:34:48.614952 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-2870d0f3-4085-4813-a5b7-be5f81606ab8 req-0fe7ae5e-e199-4985-ac68-13977032a0c2 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:48.649413 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-5b0fe16a-d526-4ef4-9e97-f5623bef172d req-bcd2abbf-2f6d-40bb-a004-58d019cfceb0 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0666394
Jun 03 08:34:48.818660 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-b6b040c6-05b4-4217-bf49-4aca4fadc8ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:48.820444 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-b6b040c6-05b4-4217-bf49-4aca4fadc8ff service neutron] 10.222.0.55 "GET /v2.0/subnets?id=fc181126-7c66-44d3-b731-a59036bd562f HTTP/1.1" status: 200  len: 848 time: 0.3055193
Jun 03 08:34:48.918639 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-2870d0f3-4085-4813-a5b7-be5f81606ab8 req-0fe7ae5e-e199-4985-ac68-13977032a0c2 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Calling delete_port for 24826ba2-ee17-4774-b5ca-2cd1675f325a owned by compute:nova {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:34:49.072422 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a0a8e4-72cb-4337-89b3-1f89a49eedf9 req-24e6490b-dd6d-4dbb-9e71-6f48c1038ae0 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:49.079644 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-53a0a8e4-72cb-4337-89b3-1f89a49eedf9 req-24e6490b-dd6d-4dbb-9e71-6f48c1038ae0 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.4793489
Jun 03 08:34:49.105544 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-b51847fa-c689-4ca0-bbac-8a8a3e0abf3d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:49.115608 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-b51847fa-c689-4ca0-bbac-8a8a3e0abf3d service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=4a053960-3cf4-4216-b7a5-291ef61e89b7&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2168202
Jun 03 08:34:49.259378 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd44ebb-fa71-4a78-b567-467b2a511734 req-117532f6-85f2-44c1-a7f8-f9d6025ef403 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:49.267066 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ecd44ebb-fa71-4a78-b567-467b2a511734 req-117532f6-85f2-44c1-a7f8-f9d6025ef403 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 946 time: 0.1093545
Jun 03 08:34:49.286515 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-576063e5-076a-40bb-86f3-17ccaf31272f service neutron] 10.222.0.55 "GET /v2.0/networks/4a053960-3cf4-4216-b7a5-291ef61e89b7?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1512511
Jun 03 08:34:49.325395 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ecd44ebb-fa71-4a78-b567-467b2a511734 req-b09dbd16-4209-40bf-b2ba-78bdbc94ddd7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/security-groups?id=1cbd5897-0041-4a4c-992f-10fc14864e4c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0572596
Jun 03 08:34:49.616475 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-53a0a8e4-72cb-4337-89b3-1f89a49eedf9 req-0de2a484-e5d4-41d5-a442-4c88f5c2800d tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.5359373
Jun 03 08:34:49.622402 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-993b47b6-6ce4-4f55-9ff4-fa7714f277b5 req-40071296-3315-4253-bd06-3dfd6ad41886 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:49.624064 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-993b47b6-6ce4-4f55-9ff4-fa7714f277b5 req-40071296-3315-4253-bd06-3dfd6ad41886 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.1344454
Jun 03 08:34:49.701740 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-c84e7364-ed17-4d7a-affb-8ff177f88af3 service neutron] 10.222.0.55 "GET /v2.0/networks/4a053960-3cf4-4216-b7a5-291ef61e89b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3148103
Jun 03 08:34:49.713136 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea692409-50c1-4332-9693-41732281d804 req-85320cb5-cb76-4aab-a19a-d27075200038 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:49.714674 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ea692409-50c1-4332-9693-41732281d804 req-85320cb5-cb76-4aab-a19a-d27075200038 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=755371c3d9de4747a47ba62e4d101829&device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 1098 time: 0.3752062
Jun 03 08:34:49.719350 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-993b47b6-6ce4-4f55-9ff4-fa7714f277b5 req-835edde4-0cdd-4739-9be6-7aab545ebaf7 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0870793
Jun 03 08:34:49.840021 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-2870d0f3-4085-4813-a5b7-be5f81606ab8 req-0fe7ae5e-e199-4985-ac68-13977032a0c2 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:49.848915 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:34:49.910973 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fe7ae5e-e199-4985-ac68-13977032a0c2 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Pushing event deleted for resources: {'Port': ['ID=24826ba2-ee17-4774-b5ca-2cd1675f325a,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:34:49.913814 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-0fe7ae5e-e199-4985-ac68-13977032a0c2 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:34:50.012881 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-2870d0f3-4085-4813-a5b7-be5f81606ab8 req-0fe7ae5e-e199-4985-ac68-13977032a0c2 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] No DVR routers for this DVR port 24826ba2-ee17-4774-b5ca-2cd1675f325a on host hv-cinder-78726 {{(pid=92323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:34:50.015815 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-2870d0f3-4085-4813-a5b7-be5f81606ab8 req-0fe7ae5e-e199-4985-ac68-13977032a0c2 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:50.041131 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5c98022-8072-4bfe-880a-3c64b8e2bf84 req-6ac228f5-8ee4-4c4a-83ec-29e29b28cb47 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:50.042710 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a5c98022-8072-4bfe-880a-3c64b8e2bf84 req-6ac228f5-8ee4-4c4a-83ec-29e29b28cb47 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 944 time: 0.2506313
Jun 03 08:34:50.098804 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2870d0f3-4085-4813-a5b7-be5f81606ab8 req-0fe7ae5e-e199-4985-ac68-13977032a0c2 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.55 "DELETE /v2.0/ports/24826ba2-ee17-4774-b5ca-2cd1675f325a HTTP/1.1" status: 204  len: 173 time: 2.4691105
Jun 03 08:34:50.103027 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a5c98022-8072-4bfe-880a-3c64b8e2bf84 req-b2e1ea12-731f-4df6-b3d7-11c842450a63 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0515289
Jun 03 08:34:50.488170 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-49ddabd1-d9e8-42d6-9f2c-f10951560702 req-41f1b4f0-a241-44fd-b6ae-fa5f4619277d tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 210 time: 0.0446582
Jun 03 08:34:50.512143 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0a3d1adc-5874-4a88-8aee-893097ee9077', 'name': 'network-vif-deleted', 'tag': '24826ba2-ee17-4774-b5ca-2cd1675f325a'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:34:50.514507 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3b87fc92-9249-4536-9431-fe866d54d8af" -d '{"events": [{"server_uuid": "0a3d1adc-5874-4a88-8aee-893097ee9077", "name": "network-vif-deleted", "tag": "24826ba2-ee17-4774-b5ca-2cd1675f325a"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:34:50.560618 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:34:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5a0cbf57-0a5d-4a5b-a675-51f1d18e98a4 x-openstack-request-id: req-5a0cbf57-0a5d-4a5b-a675-51f1d18e98a4 {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:34:50.561250 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0a3d1adc-5874-4a88-8aee-893097ee9077", "name": "network-vif-deleted", "tag": "24826ba2-ee17-4774-b5ca-2cd1675f325a", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:34:50.561731 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-5a0cbf57-0a5d-4a5b-a675-51f1d18e98a4 {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:34:50.562180 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0a3d1adc-5874-4a88-8aee-893097ee9077', 'name': 'network-vif-deleted', 'tag': '24826ba2-ee17-4774-b5ca-2cd1675f325a', 'status': 'completed', 'code': 200}
Jun 03 08:34:50.912632 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78d43f6b-2942-44c1-86ce-5cf665cc992a req-fc054031-7553-4f54-a38c-46c91f6f09bd tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:50.920870 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-78d43f6b-2942-44c1-86ce-5cf665cc992a req-fc054031-7553-4f54-a38c-46c91f6f09bd tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1494849
Jun 03 08:34:50.983448 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-78d43f6b-2942-44c1-86ce-5cf665cc992a req-ed6615fe-6a98-4e4e-8ce2-bedd769e29b7 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0614350
Jun 03 08:34:50.995824 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59381999-a887-407c-83b5-e80d40c364ab req-5ffa86b4-b3d5-4b39-b30b-f084aab917c2 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:51.017662 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-59381999-a887-407c-83b5-e80d40c364ab req-5ffa86b4-b3d5-4b39-b30b-f084aab917c2 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.1741803
Jun 03 08:34:51.073456 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-59381999-a887-407c-83b5-e80d40c364ab req-6f15cc7b-3b73-4b3c-a1ac-f68a8c65aeb0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0547254
Jun 03 08:34:51.302396 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69f8bc16-80fc-477a-972b-261c141e7ae8 req-5a28b1ee-40b5-4cb1-9058-b66981a07594 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:51.304006 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-69f8bc16-80fc-477a-972b-261c141e7ae8 req-5a28b1ee-40b5-4cb1-9058-b66981a07594 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 944 time: 0.0855343
Jun 03 08:34:51.352738 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-69f8bc16-80fc-477a-972b-261c141e7ae8 req-d058e98b-f2f4-4619-b97c-eec1deea816a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0426972
Jun 03 08:34:51.650948 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-a9e9652a-7f0a-4dc4-bb39-2240b46f118e req-906a3205-ac39-4d74-8d48-ccba7de11242 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Synchronizing usage tracker for tenant:7bac6d994f4d49b292bc39fac07c0311 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:34:51.759866 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-a9e9652a-7f0a-4dc4-bb39-2240b46f118e req-906a3205-ac39-4d74-8d48-ccba7de11242 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Unset dirty status for tenant:7bac6d994f4d49b292bc39fac07c0311 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:34:51.761058 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a9e9652a-7f0a-4dc4-bb39-2240b46f118e req-906a3205-ac39-4d74-8d48-ccba7de11242 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 210 time: 0.1517537
Jun 03 08:34:52.229869 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f796f525-ea66-4ab7-82aa-1fe39fe52b90 req-b71c51b8-54d9-4f7b-b222-9a23f3e82284 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:52.237153 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f796f525-ea66-4ab7-82aa-1fe39fe52b90 req-b71c51b8-54d9-4f7b-b222-9a23f3e82284 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1144032
Jun 03 08:34:52.304369 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f796f525-ea66-4ab7-82aa-1fe39fe52b90 req-8887b9a2-1e51-419b-a1e7-14badb95f905 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0662374
Jun 03 08:34:52.316714 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98115960-7d83-4969-afc5-f62c53e2c2ab req-6095c77c-6e05-4426-a8b1-ed151cab22d0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:52.319137 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-98115960-7d83-4969-afc5-f62c53e2c2ab req-6095c77c-6e05-4426-a8b1-ed151cab22d0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.1087205
Jun 03 08:34:52.366621 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-98115960-7d83-4969-afc5-f62c53e2c2ab req-c3507fbe-b4d5-4580-8efb-8c515fc580b0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0423000
Jun 03 08:34:52.552261 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2bff3ef-315f-4902-ae68-87941a44c203 req-457e8d50-eb85-411d-b49a-76a20c940ad3 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:52.553871 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f2bff3ef-315f-4902-ae68-87941a44c203 req-457e8d50-eb85-411d-b49a-76a20c940ad3 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 944 time: 0.0853214
Jun 03 08:34:52.599915 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f2bff3ef-315f-4902-ae68-87941a44c203 req-fa0da0a2-d29f-460e-81c2-61568db22d60 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0401983
Jun 03 08:34:52.724268 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 24826ba2-ee17-4774-b5ca-2cd1675f325a no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:34:52.762537 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] No Port match for: 24826ba2-ee17-4774-b5ca-2cd1675f325a {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:34:52.763383 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 24826ba2-ee17-4774-b5ca-2cd1675f325a not bound to the agent host hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:34:52.952277 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-60fcbf94-6638-4a30-aa58-61e13baebe71 req-3a94c065-fc22-4a29-890c-ae1f608be0c7 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] 10.222.0.11 "GET /v2.0/ports?device_id=0a3d1adc-5874-4a88-8aee-893097ee9077 HTTP/1.1" status: 200  len: 210 time: 0.0734689
Jun 03 08:34:52.991106 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea692409-50c1-4332-9693-41732281d804 req-1857087c-c0b6-4e9f-9d17-d6231336c26c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:52.992548 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ea692409-50c1-4332-9693-41732281d804 req-1857087c-c0b6-4e9f-9d17-d6231336c26c service neutron] 10.222.0.55 "GET /v2.0/networks?id=020eaa43-2d59-46e1-8aec-0a688069f72b HTTP/1.1" status: 200  len: 912 time: 0.2439487
Jun 03 08:34:52.997712 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ead2bbc-bc55-4634-a464-8128f5ab4295 req-eaa4fd64-f624-4e51-9e19-430d6aa44be6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:52.999072 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8ead2bbc-bc55-4634-a464-8128f5ab4295 req-eaa4fd64-f624-4e51-9e19-430d6aa44be6 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=0e5e096a327f421e9b0a02235740cc36&device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 1097 time: 0.2205296
Jun 03 08:34:53.192597 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ea692409-50c1-4332-9693-41732281d804 req-4aca4579-05e2-4227-b33e-14cb088dd456 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=19f733be-bd85-43df-86fd-5a9c617b3df4 HTTP/1.1" status: 200  len: 1001 time: 0.1923461
Jun 03 08:34:53.264734 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ead2bbc-bc55-4634-a464-8128f5ab4295 req-c83f7568-b478-45f7-9633-44f95ac257c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:53.266182 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8ead2bbc-bc55-4634-a464-8128f5ab4295 req-c83f7568-b478-45f7-9633-44f95ac257c7 service neutron] 10.222.0.55 "GET /v2.0/networks?id=4a053960-3cf4-4216-b7a5-291ef61e89b7 HTTP/1.1" status: 200  len: 910 time: 0.2122233
Jun 03 08:34:53.278349 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea692409-50c1-4332-9693-41732281d804 req-00776f1f-3f34-46b7-ac34-89c92db28757 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:53.279746 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ea692409-50c1-4332-9693-41732281d804 req-00776f1f-3f34-46b7-ac34-89c92db28757 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=5baf74c9-e686-40a5-b52f-f01da3bd1af9 HTTP/1.1" status: 200  len: 850 time: 0.0784009
Jun 03 08:34:53.380827 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8ead2bbc-bc55-4634-a464-8128f5ab4295 req-3c2b2566-403f-4c92-ae53-f7577ea91144 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4312e3c9-0931-4dd5-ba11-db0d982c2a11 HTTP/1.1" status: 200  len: 217 time: 0.1041954
Jun 03 08:34:53.472465 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea692409-50c1-4332-9693-41732281d804 req-c05692dd-eeba-4f02-9185-1dabcfbbc9df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:53.474602 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ea692409-50c1-4332-9693-41732281d804 req-c05692dd-eeba-4f02-9185-1dabcfbbc9df service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=020eaa43-2d59-46e1-8aec-0a688069f72b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1416390
Jun 03 08:34:53.480354 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ead2bbc-bc55-4634-a464-8128f5ab4295 req-b083d978-66cb-4ecf-b789-077e06cfb88e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:53.481766 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8ead2bbc-bc55-4634-a464-8128f5ab4295 req-b083d978-66cb-4ecf-b789-077e06cfb88e service neutron] 10.222.0.55 "GET /v2.0/subnets?id=fc181126-7c66-44d3-b731-a59036bd562f HTTP/1.1" status: 200  len: 848 time: 0.0760627
Jun 03 08:34:53.500197 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d528059f-7432-4e30-a8c1-df93f8b5aab2 req-2842dd46-48d9-4c6d-8654-ab289147614a tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:53.502079 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d528059f-7432-4e30-a8c1-df93f8b5aab2 req-2842dd46-48d9-4c6d-8654-ab289147614a tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.0907953
Jun 03 08:34:53.553713 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d528059f-7432-4e30-a8c1-df93f8b5aab2 req-55a26b51-a9d9-41d5-85cb-1e76a14bb116 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0449836
Jun 03 08:34:53.845841 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91acfb60-c3e4-4711-8747-169b4443899c req-16ccd403-f7bd-4981-a79a-109d8e346929 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:53.848310 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-91acfb60-c3e4-4711-8747-169b4443899c req-16ccd403-f7bd-4981-a79a-109d8e346929 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 944 time: 0.1190650
Jun 03 08:34:53.862026 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ea692409-50c1-4332-9693-41732281d804 req-918f8e40-67a8-4769-983b-c076428323cf service neutron] 10.222.0.55 "GET /v2.0/networks/020eaa43-2d59-46e1-8aec-0a688069f72b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3421240
Jun 03 08:34:53.870891 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68b33706-89fd-40bb-87fc-a326593d389c req-dd66dd52-592d-4c62-9a8c-24ff24754282 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:53.872468 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-68b33706-89fd-40bb-87fc-a326593d389c req-dd66dd52-592d-4c62-9a8c-24ff24754282 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.3859918
Jun 03 08:34:53.874859 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ead2bbc-bc55-4634-a464-8128f5ab4295 req-efa04c56-5e7f-4f42-9a82-9942727242d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:53.876436 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8ead2bbc-bc55-4634-a464-8128f5ab4295 req-efa04c56-5e7f-4f42-9a82-9942727242d1 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=4a053960-3cf4-4216-b7a5-291ef61e89b7&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3554785
Jun 03 08:34:53.906277 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-91acfb60-c3e4-4711-8747-169b4443899c req-bf4e63cd-4782-4e77-94c4-c2b9ab39ec56 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0521829
Jun 03 08:34:54.078581 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 51576) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:34:54.142624 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.db_base_plugin_v2 [None req-cf690fd1-046f-4f9e-8ab7-a03931f12a8f admin admin] Deleting subnet 5f3b55e2-964f-4ce8-9d71-3ac11dc6ebf1 {{(pid=92324) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 03 08:34:54.146900 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cf690fd1-046f-4f9e-8ab7-a03931f12a8f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:54.167234 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-68b33706-89fd-40bb-87fc-a326593d389c req-af8948c5-0989-48c1-b060-0b9539471619 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2696204
Jun 03 08:34:54.205811 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cf690fd1-046f-4f9e-8ab7-a03931f12a8f admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-15250429'] for subnet, precommit_delete_associations {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:54.213065 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ea692409-50c1-4332-9693-41732281d804 req-74e312f1-763e-47cc-8805-7aee64c1dd9f service neutron] 10.222.0.55 "GET /v2.0/networks/020eaa43-2d59-46e1-8aec-0a688069f72b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3356471
Jun 03 08:34:54.214917 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8ead2bbc-bc55-4634-a464-8128f5ab4295 req-45743c7d-45dd-4c43-9041-7ff1d99e5304 service neutron] 10.222.0.55 "GET /v2.0/networks/4a053960-3cf4-4216-b7a5-291ef61e89b7?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3140225
Jun 03 08:34:54.359088 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cf690fd1-046f-4f9e-8ab7-a03931f12a8f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-862421'] for subnet, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:54.426391 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8ead2bbc-bc55-4634-a464-8128f5ab4295 req-4077a88f-da35-4fb1-ae02-9dbdf5d3674f service neutron] 10.222.0.55 "GET /v2.0/networks/4a053960-3cf4-4216-b7a5-291ef61e89b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1946418
Jun 03 08:34:54.757081 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2559dd8b-ddc2-4ddc-9c13-1141b3bad219 req-27302380-f2b1-4afd-897a-539eebb9dc6e tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:54.758566 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2559dd8b-ddc2-4ddc-9c13-1141b3bad219 req-27302380-f2b1-4afd-897a-539eebb9dc6e tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.0860975
Jun 03 08:34:54.803213 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2559dd8b-ddc2-4ddc-9c13-1141b3bad219 req-5546a9b2-d6f2-493f-8a02-5f8e2ec147f1 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0390806
Jun 03 08:34:54.879818 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cf690fd1-046f-4f9e-8ab7-a03931f12a8f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-862434', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15641431', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14870376'] for subnet, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:54.884636 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-a946c209-642d-4f62-a667-1d940c9ce8d0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:34:54.921066 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf690fd1-046f-4f9e-8ab7-a03931f12a8f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5f3b55e2-964f-4ce8-9d71-3ac11dc6ebf1,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:34:54.927265 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cf690fd1-046f-4f9e-8ab7-a03931f12a8f admin admin] Notify callbacks [] for subnet, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:54.934837 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf690fd1-046f-4f9e-8ab7-a03931f12a8f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:54.935212 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf690fd1-046f-4f9e-8ab7-a03931f12a8f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:54.935576 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf690fd1-046f-4f9e-8ab7-a03931f12a8f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:54.935934 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf690fd1-046f-4f9e-8ab7-a03931f12a8f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:54.936287 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf690fd1-046f-4f9e-8ab7-a03931f12a8f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:54.936735 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf690fd1-046f-4f9e-8ab7-a03931f12a8f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:54.937001 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf690fd1-046f-4f9e-8ab7-a03931f12a8f admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:54.937339 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf690fd1-046f-4f9e-8ab7-a03931f12a8f admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:54.937683 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf690fd1-046f-4f9e-8ab7-a03931f12a8f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:54.938027 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf690fd1-046f-4f9e-8ab7-a03931f12a8f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:54.938369 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf690fd1-046f-4f9e-8ab7-a03931f12a8f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:54.938764 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf690fd1-046f-4f9e-8ab7-a03931f12a8f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:54.952981 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-cf690fd1-046f-4f9e-8ab7-a03931f12a8f admin admin] 10.222.0.11 "DELETE /v2.0/subnets/5f3b55e2-964f-4ce8-9d71-3ac11dc6ebf1 HTTP/1.1" status: 204  len: 168 time: 0.8788631
Jun 03 08:34:54.954639 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-cf690fd1-046f-4f9e-8ab7-a03931f12a8f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:34:54.955551 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 51612) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:34:55.076466 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-62fc1c80-fdff-4e60-a95c-4a841ce68639 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-529010'] for network, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:55.106417 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bebdc49-b231-428d-be21-29287c9ea717 req-3847e5ca-d94e-42b8-a06b-5804498d860b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:55.112967 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6bebdc49-b231-428d-be21-29287c9ea717 req-3847e5ca-d94e-42b8-a06b-5804498d860b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 944 time: 0.0848110
Jun 03 08:34:55.187318 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6bebdc49-b231-428d-be21-29287c9ea717 req-97e2c53a-e6fa-4cb3-91ab-f0d005dbc9b2 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0733423
Jun 03 08:34:55.252183 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-62fc1c80-fdff-4e60-a95c-4a841ce68639 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-862046', 'neutron.services.segments.db._delete_segments_for_network-8774224358894'] for network, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:55.272036 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-62fc1c80-fdff-4e60-a95c-4a841ce68639 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fae862007f0>,) {'filters': {'network_id': ['f9db9a2a-942b-4a98-97ed-1896cb9158b4']}} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:34:55.287392 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-62fc1c80-fdff-4e60-a95c-4a841ce68639 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fae862007f0>, '9923ac74-9556-45ec-9044-43728d2a8ec3') {'for_net_delete': True} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:34:55.287672 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-62fc1c80-fdff-4e60-a95c-4a841ce68639 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fae862007f0>, '9923ac74-9556-45ec-9044-43728d2a8ec3') {} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:34:55.331297 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-62fc1c80-fdff-4e60-a95c-4a841ce68639 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8774224362253', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-15250406'] for segment, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:55.363148 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-62fc1c80-fdff-4e60-a95c-4a841ce68639 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:55.372659 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-62fc1c80-fdff-4e60-a95c-4a841ce68639 admin admin] Releasing vlan 511 on physical network physnet1 to pool {{(pid=92324) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 03 08:34:55.373057 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-62fc1c80-fdff-4e60-a95c-4a841ce68639 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15641405'] for segment, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]: Traceback (most recent call last):
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:     timer()
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:     cb(*args, **kw)
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:     return func(*args, **kwargs)
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:     self._notify()
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:     self.callback(batched_events)
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:     event.method(event)
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:     return f(self, *a, **k)
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self._get(url).json()
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self.request(url, 'GET', **kwargs)
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 03 08:34:55.388722 dv-cinder-787262-5-iscsi neutron-server[92324]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 03 08:34:55.485915 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fb93d2e-71b5-4747-b93b-9645b26a7089 req-8966119c-b0f4-4879-9901-b05246597960 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:55.488000 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-9fb93d2e-71b5-4747-b93b-9645b26a7089 req-8966119c-b0f4-4879-9901-b05246597960 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.1933181
Jun 03 08:34:55.536627 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-9fb93d2e-71b5-4747-b93b-9645b26a7089 req-fdb1d5f5-51dd-4d10-910d-9896fcf2b250 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0422134
Jun 03 08:34:55.593779 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-62fc1c80-fdff-4e60-a95c-4a841ce68639 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-862039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16327709'] for network, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:55.600752 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-62fc1c80-fdff-4e60-a95c-4a841ce68639 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:55.605674 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:34:55.640330 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62fc1c80-fdff-4e60-a95c-4a841ce68639 admin admin] Pushing event deleted for resources: {'Network': ['ID=f9db9a2a-942b-4a98-97ed-1896cb9158b4,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:34:55.643779 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-62fc1c80-fdff-4e60-a95c-4a841ce68639 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:34:55.802309 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-62fc1c80-fdff-4e60-a95c-4a841ce68639 admin admin] 10.222.0.11 "DELETE /v2.0/networks/f9db9a2a-942b-4a98-97ed-1896cb9158b4 HTTP/1.1" status: 204  len: 168 time: 0.8439453
Jun 03 08:34:56.009628 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1adeaa48-4331-4196-bb18-f6e8f972014f req-43b7bb77-9c6b-4973-954f-a7259a129f4c tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:56.011117 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1adeaa48-4331-4196-bb18-f6e8f972014f req-43b7bb77-9c6b-4973-954f-a7259a129f4c tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.0909815
Jun 03 08:34:56.061139 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1adeaa48-4331-4196-bb18-f6e8f972014f req-85f2b3b8-9398-4e1f-b223-ea5d5890e093 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0441589
Jun 03 08:34:56.068295 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:56.210006 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 51646) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:34:56.277967 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-ec5fcdc5-ec54-4b44-a7e7-e221790aa4c4 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=7bac6d994f4d49b292bc39fac07c0311&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0644929
Jun 03 08:34:56.278336 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 51650) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:34:56.348671 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-e0098bed-3cc8-4367-a914-884d3f540cfc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:56.377305 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fa9d170-97e0-49cc-8c43-e8888f909050 req-3b44cafa-0efe-4299-b349-e1fa7e687f20 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:56.377795 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-e0098bed-3cc8-4367-a914-884d3f540cfc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:56.378882 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-7fa9d170-97e0-49cc-8c43-e8888f909050 req-3b44cafa-0efe-4299-b349-e1fa7e687f20 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 944 time: 0.0841091
Jun 03 08:34:56.433741 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-7fa9d170-97e0-49cc-8c43-e8888f909050 req-b2a1fe66-9ba3-4a4c-827e-c6c0af4cd796 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0446458
Jun 03 08:34:56.560079 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-e0098bed-3cc8-4367-a914-884d3f540cfc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:56.563920 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:34:56.577799 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0098bed-3cc8-4367-a914-884d3f540cfc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1cbd5897-0041-4a4c-992f-10fc14864e4c,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:34:56.587167 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0098bed-3cc8-4367-a914-884d3f540cfc admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:56.587532 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0098bed-3cc8-4367-a914-884d3f540cfc admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:56.588340 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0098bed-3cc8-4367-a914-884d3f540cfc admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:56.588340 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0098bed-3cc8-4367-a914-884d3f540cfc admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:56.588606 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0098bed-3cc8-4367-a914-884d3f540cfc admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:56.588879 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0098bed-3cc8-4367-a914-884d3f540cfc admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:56.589331 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0098bed-3cc8-4367-a914-884d3f540cfc admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:56.589539 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0098bed-3cc8-4367-a914-884d3f540cfc admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:56.589877 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0098bed-3cc8-4367-a914-884d3f540cfc admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:56.590210 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0098bed-3cc8-4367-a914-884d3f540cfc admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:56.590572 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0098bed-3cc8-4367-a914-884d3f540cfc admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:56.590906 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0098bed-3cc8-4367-a914-884d3f540cfc admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:34:56.594403 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-e0098bed-3cc8-4367-a914-884d3f540cfc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:34:56.662642 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-e0098bed-3cc8-4367-a914-884d3f540cfc admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:34:56.663769 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-e0098bed-3cc8-4367-a914-884d3f540cfc admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/1cbd5897-0041-4a4c-992f-10fc14864e4c HTTP/1.1" status: 204  len: 168 time: 0.3843727
Jun 03 08:34:57.262170 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75bca07c-9c4e-4dd4-ae9c-d332f2d69713 req-3e112e88-50f4-4daa-ae40-35eab505f480 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:57.263756 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-75bca07c-9c4e-4dd4-ae9c-d332f2d69713 req-3e112e88-50f4-4daa-ae40-35eab505f480 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.0844028
Jun 03 08:34:57.311189 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-75bca07c-9c4e-4dd4-ae9c-d332f2d69713 req-63e2abeb-7031-4eb9-9a63-14d707f7d691 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413327
Jun 03 08:34:57.652576 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f772075-abff-4a84-9eb9-41629408bef0 req-1b995922-3005-47c1-b221-92705c2d015c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:57.654706 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3f772075-abff-4a84-9eb9-41629408bef0 req-1b995922-3005-47c1-b221-92705c2d015c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 944 time: 0.0993304
Jun 03 08:34:57.727612 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3f772075-abff-4a84-9eb9-41629408bef0 req-14566326-5647-4aca-839c-4610b16400de tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0651577
Jun 03 08:34:58.554362 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b85174ca-b279-4f2a-b755-157825712d72 req-fd31a887-c0f6-40da-9c66-d45b4af07c30 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:58.555966 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b85174ca-b279-4f2a-b755-157825712d72 req-fd31a887-c0f6-40da-9c66-d45b4af07c30 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1118436
Jun 03 08:34:58.608118 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b85174ca-b279-4f2a-b755-157825712d72 req-85799ab4-a895-48b9-9ae0-a8cdade98359 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0461230
Jun 03 08:34:58.964603 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e0d38a5-7307-4e88-ab3d-625d83f85b82 req-7c7ea59f-875f-4f33-9833-793ebb12653c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:58.966130 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-4e0d38a5-7307-4e88-ab3d-625d83f85b82 req-7c7ea59f-875f-4f33-9833-793ebb12653c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 944 time: 0.1093163
Jun 03 08:34:59.021477 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-4e0d38a5-7307-4e88-ab3d-625d83f85b82 req-cab3a378-12d7-4cf1-9c37-b70d472d6fdc tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0478845
Jun 03 08:34:59.818040 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00fbcea2-8079-4381-9d20-15e1903eb889 req-d8d6ed4f-c47c-4f94-b0b0-a9653eb14007 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:34:59.819526 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-00fbcea2-8079-4381-9d20-15e1903eb889 req-d8d6ed4f-c47c-4f94-b0b0-a9653eb14007 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.0809257
Jun 03 08:34:59.863530 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-00fbcea2-8079-4381-9d20-15e1903eb889 req-37cb6586-18b5-4b4a-a395-3294c3cc82bd tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0383458
Jun 03 08:35:00.084478 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 51736) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:00.186004 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_v2 [None req-729b7dee-9b4c-41d9-95f1-0dfef28c66ee admin admin] Deleting subnet 4463a771-9390-43b9-805a-b4b8e5004e4c {{(pid=92323) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 03 08:35:00.189473 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-729b7dee-9b4c-41d9-95f1-0dfef28c66ee admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:00.262409 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d618c3fa-16d8-4861-91fe-789620432f6a req-1e3657db-7b08-46eb-ace7-33b4366f00b7 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:00.263950 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d618c3fa-16d8-4861-91fe-789620432f6a req-1e3657db-7b08-46eb-ace7-33b4366f00b7 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 944 time: 0.1146410
Jun 03 08:35:00.307881 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-729b7dee-9b4c-41d9-95f1-0dfef28c66ee admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:00.314274 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d618c3fa-16d8-4861-91fe-789620432f6a req-ae7de5e0-7a2b-401f-9b47-9ed95fd2bc53 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0441966
Jun 03 08:35:00.320989 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-729b7dee-9b4c-41d9-95f1-0dfef28c66ee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-862421'] for subnet, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:00.403898 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-db950f21-cb65-4bdd-84da-c3891c312f51 req-da3c62ea-6d05-49c6-b610-fdade54b8390 service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1730919
Jun 03 08:35:00.709086 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-729b7dee-9b4c-41d9-95f1-0dfef28c66ee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-862434', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829'] for subnet, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:00.713914 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-7b6566f0-56a8-4411-87a8-c856d1efe702 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:00.847628 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-729b7dee-9b4c-41d9-95f1-0dfef28c66ee admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4463a771-9390-43b9-805a-b4b8e5004e4c,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:00.850191 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-729b7dee-9b4c-41d9-95f1-0dfef28c66ee admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:00.852522 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-729b7dee-9b4c-41d9-95f1-0dfef28c66ee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:00.861143 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-729b7dee-9b4c-41d9-95f1-0dfef28c66ee admin admin] 10.222.0.11 "DELETE /v2.0/subnets/4463a771-9390-43b9-805a-b4b8e5004e4c HTTP/1.1" status: 204  len: 168 time: 0.7704835
Jun 03 08:35:00.861143 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 51742) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:00.966763 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-529010'] for network, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:01.145713 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-862046', 'neutron.services.segments.db._delete_segments_for_network-8774224358894'] for network, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:01.161208 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7fae85e1fbe0>> segment before_delete 55550000 {{(pid=92323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:35:01.161550 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7fae85e1fbe0>> subnet precommit_delete_associations 55550000 {{(pid=92323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:35:01.162270 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fae85b400d0>> segment_host_mapping after_create 55550000 {{(pid=92323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:35:01.162645 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fae85b400d0>> port after_create 55550000 {{(pid=92323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:35:01.162979 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fae85b400d0>> port after_delete 55550000 {{(pid=92323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:35:01.163308 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fae85b400d0>> port after_update 55550000 {{(pid=92323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:35:01.163622 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fae85b400d0>> segment after_delete 55550000 {{(pid=92323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:35:01.163953 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fae85b400d0>> subnet after_create 55550000 {{(pid=92323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:35:01.164262 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fae85b400d0>> subnet after_delete 55550000 {{(pid=92323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:35:01.164575 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fae85b400d0>> subnet after_update 55550000 {{(pid=92323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:35:01.342883 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fae86129d30>> subnet after_create 55550000 {{(pid=92323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:35:01.343261 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fae86129d30>> subnet after_delete 55550000 {{(pid=92323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:35:01.343595 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fae86129d30>> subnet before_create 55550000 {{(pid=92323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:35:01.343994 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fae86129d30>> subnet before_update 55550000 {{(pid=92323) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 03 08:35:01.344402 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fae85c52310>,) {'filters': {'network_id': ['9fa75ad7-a669-4187-8c25-4bc1ee5a9f55']}} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:35:01.360265 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fae85c52310>, '9559424d-973e-4a97-92a4-8a446b0a62b5') {'for_net_delete': True} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:35:01.360565 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fae85c52310>, '9559424d-973e-4a97-92a4-8a446b0a62b5') {} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:35:01.374282 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4cfac5b-aceb-4265-9f6b-e311c3a44c6d req-756d463a-c08e-40a8-bcf7-650ad12b43f8 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:01.375855 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a4cfac5b-aceb-4265-9f6b-e311c3a44c6d req-756d463a-c08e-40a8-bcf7-650ad12b43f8 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.4024186
Jun 03 08:35:01.411795 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8774224362253', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14518195'] for segment, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:01.448072 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a4cfac5b-aceb-4265-9f6b-e311c3a44c6d req-91ab533d-549d-4b42-a760-a61c354497c9 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0654080
Jun 03 08:35:01.449039 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:01.458254 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Releasing vlan 513 on physical network physnet1 to pool {{(pid=92323) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 03 08:35:01.458717 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14211322'] for segment, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:   from cryptography.utils import int_from_bytes
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:   from cryptography.utils import int_from_bytes
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]: Traceback (most recent call last):
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:     timer()
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:     cb(*args, **kw)
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:     return func(*args, **kwargs)
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:     self._notify()
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:     self.callback(batched_events)
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:     event.method(event)
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:     return f(self, *a, **k)
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self._get(url).json()
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self.request(url, 'GET', **kwargs)
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 03 08:35:01.475333 dv-cinder-787262-5-iscsi neutron-server[92323]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 03 08:35:01.547241 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 4312e3c9-0931-4dd5-ba11-db0d982c2a11 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:35:01.551193 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7127a467-15f0-4b3d-b1bf-0143282d4210 req-0eee01c9-43f2-455f-abc0-ebaab49a1249 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:01.553173 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-7127a467-15f0-4b3d-b1bf-0143282d4210 req-0eee01c9-43f2-455f-abc0-ebaab49a1249 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 944 time: 0.0931919
Jun 03 08:35:01.604934 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-7127a467-15f0-4b3d-b1bf-0143282d4210 req-6fc331b7-6954-4c18-81f0-c0dd57ea7ac3 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0442970
Jun 03 08:35:01.693439 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 4312e3c9-0931-4dd5-ba11-db0d982c2a11, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=4312e3c9-0931-4dd5-ba11-db0d982c2a11,segment=NetworkSegment(aaa5b128-9aff-431e-b567-4ca42a016de6),segment_id=aaa5b128-9aff-431e-b567-4ca42a016de6)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:35:01.697229 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-862039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16327709'] for network, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:01.701798 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:01.714113 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': '4312e3c9-0931-4dd5-ba11-db0d982c2a11', 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7', 'port_id': '4312e3c9-0931-4dd5-ba11-db0d982c2a11', 'mac_address': 'fa:16:3e:72:a1:e6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 503, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fc181126-7c66-44d3-b731-a59036bd562f', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:35:01.720793 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:01.732867 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Pushing event deleted for resources: {'Network': ['ID=9fa75ad7-a669-4187-8c25-4bc1ee5a9f55,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:01.738563 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:01.781373 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:01.792454 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4312e3c9-0931-4dd5-ba11-db0d982c2a11 {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:35:01.808803 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 4312e3c9-0931-4dd5-ba11-db0d982c2a11, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=4312e3c9-0931-4dd5-ba11-db0d982c2a11,segment=NetworkSegment(aaa5b128-9aff-431e-b567-4ca42a016de6),segment_id=aaa5b128-9aff-431e-b567-4ca42a016de6)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:35:01.845758 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-253e84a7-cf1e-4dc5-92b7-8e8231afd4b3 admin admin] 10.222.0.11 "DELETE /v2.0/networks/9fa75ad7-a669-4187-8c25-4bc1ee5a9f55 HTTP/1.1" status: 204  len: 168 time: 0.9855237
Jun 03 08:35:01.913813 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:01.915718 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:01.985108 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=4312e3c9-0931-4dd5-ba11-db0d982c2a11,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:01.989183 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:02.229914 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 51756) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:02.280311 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-4a2d1f34-0bb1-403e-82fa-44aa8a27105b admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=96ee04709f4540ee8818120a88291b46&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0491590
Jun 03 08:35:02.282674 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 51758) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:02.344271 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4fb02862-8faf-4cfd-b331-713924ba4111 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:02.370683 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4fb02862-8faf-4cfd-b331-713924ba4111 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:02.485176 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4fb02862-8faf-4cfd-b331-713924ba4111 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:02.489181 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:02.502945 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fb02862-8faf-4cfd-b331-713924ba4111 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2aaea84c-8cdf-46a1-baf5-bd6d6c53a935,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:02.505566 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-4fb02862-8faf-4cfd-b331-713924ba4111 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:02.519729 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-445d2b5d-a751-4fbb-aa58-c5e38ae02cd9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:02.623003 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4fb02862-8faf-4cfd-b331-713924ba4111 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:02.625399 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-4fb02862-8faf-4cfd-b331-713924ba4111 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/2aaea84c-8cdf-46a1-baf5-bd6d6c53a935 HTTP/1.1" status: 204  len: 168 time: 0.3405409
Jun 03 08:35:02.670557 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fe99681-68a8-4b02-89d2-7084fabafb9c req-b31b4dba-6171-4dff-baaf-5e97d09c2ec7 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:02.672020 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6fe99681-68a8-4b02-89d2-7084fabafb9c req-b31b4dba-6171-4dff-baaf-5e97d09c2ec7 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.0919406
Jun 03 08:35:02.719444 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6fe99681-68a8-4b02-89d2-7084fabafb9c req-716a6247-333c-4134-9906-db83e4d6d439 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417733
Jun 03 08:35:02.792597 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab6073e3-42bb-4732-8514-40130c97a235 req-9b3c4cf9-0708-4736-a418-0f3aa956a24d tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:02.794064 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ab6073e3-42bb-4732-8514-40130c97a235 req-9b3c4cf9-0708-4736-a418-0f3aa956a24d tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 945 time: 0.0799932
Jun 03 08:35:02.840911 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ab6073e3-42bb-4732-8514-40130c97a235 req-519365f2-dab8-4d00-bb1f-69faa33a2c49 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0403059
Jun 03 08:35:03.697612 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db950f21-cb65-4bdd-84da-c3891c312f51 req-bfc4fa56-60ee-41e1-a297-da740a06bd50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:03.699152 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-db950f21-cb65-4bdd-84da-c3891c312f51 req-bfc4fa56-60ee-41e1-a297-da740a06bd50 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=36c42f532cd14f19811ffbee3a39a208&device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 1099 time: 0.1353531
Jun 03 08:35:03.709329 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7e1027f-b88d-4231-a50c-869fd7906f00 req-219d7519-82ef-45b1-842e-1e30be3ac4cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:03.710884 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c7e1027f-b88d-4231-a50c-869fd7906f00 req-219d7519-82ef-45b1-842e-1e30be3ac4cc service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 1099 time: 0.1054969
Jun 03 08:35:03.863158 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c7e1027f-b88d-4231-a50c-869fd7906f00 req-b80e800b-75ad-4449-be2f-61e077a1ad33 service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1387622
Jun 03 08:35:03.960255 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db950f21-cb65-4bdd-84da-c3891c312f51 req-816c529e-a5e4-498d-8923-004ee3e40f21 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:03.961617 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-db950f21-cb65-4bdd-84da-c3891c312f51 req-816c529e-a5e4-498d-8923-004ee3e40f21 service neutron] 10.222.0.55 "GET /v2.0/networks?id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba HTTP/1.1" status: 200  len: 918 time: 0.2239943
Jun 03 08:35:03.991657 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['4312e3c9-0931-4dd5-ba11-db0d982c2a11'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:35:04.058266 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fda5ee3-302b-468a-bd74-6b803ed0875d req-75ce9391-baed-4d99-8642-c0b4d9eed2ae tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:04.059828 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3fda5ee3-302b-468a-bd74-6b803ed0875d req-75ce9391-baed-4d99-8642-c0b4d9eed2ae tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1851909
Jun 03 08:35:04.068767 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c84ab2d9-c632-473f-a30b-42abb047302b req-ea1bab7e-90ef-4a01-9fe7-f0cb6f3758a9 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:04.071176 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c84ab2d9-c632-473f-a30b-42abb047302b req-ea1bab7e-90ef-4a01-9fe7-f0cb6f3758a9 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 945 time: 0.1170547
Jun 03 08:35:04.115913 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-db950f21-cb65-4bdd-84da-c3891c312f51 req-0fd5b88d-cba9-4506-baec-a6440d75cd65 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 HTTP/1.1" status: 200  len: 1001 time: 0.1408243
Jun 03 08:35:04.182986 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3fda5ee3-302b-468a-bd74-6b803ed0875d req-9b562655-a961-40c1-a1d3-023e9ef6fbef tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1130092
Jun 03 08:35:04.216311 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db950f21-cb65-4bdd-84da-c3891c312f51 req-185981a7-71fb-457c-a7a4-1763602ed301 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:04.217742 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-db950f21-cb65-4bdd-84da-c3891c312f51 req-185981a7-71fb-457c-a7a4-1763602ed301 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=cff67a13-bc33-4d3e-a796-5829103ca25c HTTP/1.1" status: 200  len: 856 time: 0.0852339
Jun 03 08:35:04.243017 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c84ab2d9-c632-473f-a30b-42abb047302b req-7b9afa23-6b3a-45c1-a4a9-9bd665c6cb41 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1658053
Jun 03 08:35:04.322251 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db950f21-cb65-4bdd-84da-c3891c312f51 req-702caf15-b4ac-4dd7-824f-32418f069943 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:04.324713 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-db950f21-cb65-4bdd-84da-c3891c312f51 req-702caf15-b4ac-4dd7-824f-32418f069943 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0983856
Jun 03 08:35:04.479089 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-db950f21-cb65-4bdd-84da-c3891c312f51 req-666c70db-f375-4507-808e-495bd692da39 service neutron] 10.222.0.55 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1466465
Jun 03 08:35:04.727749 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-db950f21-cb65-4bdd-84da-c3891c312f51 req-adc4d443-bf7c-4a7d-8e96-760e5bc1b645 service neutron] 10.222.0.55 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2323372
Jun 03 08:35:04.811588 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:05.262014 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-7e876df0-c44f-4ae2-997a-ab0d25353c1f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:05.345133 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f113921-cf87-47dc-bfd0-9a0b30a9ebb3 req-48d411c0-1f18-4f19-bdac-9e655e1026bb tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:05.351185 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9f113921-cf87-47dc-bfd0-9a0b30a9ebb3 req-48d411c0-1f18-4f19-bdac-9e655e1026bb tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 945 time: 0.1176369
Jun 03 08:35:05.398629 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9f113921-cf87-47dc-bfd0-9a0b30a9ebb3 req-2069d0cd-d9f1-4479-8daa-f06d540662f8 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0443630
Jun 03 08:35:05.418871 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d1a88eb-4b1d-4868-bd5a-787cd2cc59fd req-d3df08d5-0926-4114-bae8-2f1c26cc5fd6 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:05.418871 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-7d1a88eb-4b1d-4868-bd5a-787cd2cc59fd req-d3df08d5-0926-4114-bae8-2f1c26cc5fd6 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.0859063
Jun 03 08:35:05.423372 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 51870) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:05.483397 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-7d1a88eb-4b1d-4868-bd5a-787cd2cc59fd req-f3e31a05-0d5a-43d7-8b78-ac320f445162 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0560408
Jun 03 08:35:05.582661 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 4312e3c9-0931-4dd5-ba11-db0d982c2a11 up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:35:05.629159 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12932ef8-8b62-43bb-8228-545ddbc47259 req-7404fa9f-0015-4a7a-90ac-dedc5a21a00c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:05.636796 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-12932ef8-8b62-43bb-8228-545ddbc47259 req-7404fa9f-0015-4a7a-90ac-dedc5a21a00c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 945 time: 0.1179092
Jun 03 08:35:05.688887 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-12932ef8-8b62-43bb-8228-545ddbc47259 req-e6f6c613-213b-4da2-8d04-e513be36c851 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0511160
Jun 03 08:35:05.724371 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f888688b-4ee4-4165-82f6-9310d3af9bae tempest-TestMinimumBasicScenario-560888062 tempest-TestMinimumBasicScenario-560888062-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:05.725104 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-f888688b-4ee4-4165-82f6-9310d3af9bae tempest-TestMinimumBasicScenario-560888062 tempest-TestMinimumBasicScenario-560888062-project-admin] Synchronizing usage tracker for tenant:7de719cd894b4eff8d1ebe284e30569b on resource:port {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:35:05.834613 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning for port 4312e3c9-0931-4dd5-ba11-db0d982c2a11 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:35:05.839971 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port 4312e3c9-0931-4dd5-ba11-db0d982c2a11 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:35:05.844222 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:05.868292 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-f888688b-4ee4-4165-82f6-9310d3af9bae tempest-TestMinimumBasicScenario-560888062 tempest-TestMinimumBasicScenario-560888062-project-admin] Unset dirty status for tenant:7de719cd894b4eff8d1ebe284e30569b on resource:port {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:35:05.872104 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-f888688b-4ee4-4165-82f6-9310d3af9bae tempest-TestMinimumBasicScenario-560888062 tempest-TestMinimumBasicScenario-560888062-project-admin] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 1093 time: 0.4471879
Jun 03 08:35:05.875715 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 51888) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:05.882238 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Request body: {'floatingip': {'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'port_id': '37525065-c740-4aee-a826-af098f4b7727', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'fixed_ip_address': '172.20.0.3'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:35:05.891241 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:35:05.897373 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Usage tracker for resource:floatingip and tenant:96a989a900784d61a1475d86dd209c5f is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:35:05.901643 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:35:05.911238 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:35:05.994409 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for floatingip, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:05.997385 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:06.043275 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '80cea05e-57d7-4393-818e-b7a621e986ec', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4312e3c9-0931-4dd5-ba11-db0d982c2a11'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:35:06.047545 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a095227e-a6c0-48b7-b105-31bb3cd6f924" -d '{"events": [{"server_uuid": "80cea05e-57d7-4393-818e-b7a621e986ec", "name": "network-vif-plugged", "status": "completed", "tag": "4312e3c9-0931-4dd5-ba11-db0d982c2a11"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:35:06.060883 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 4312e3c9-0931-4dd5-ba11-db0d982c2a11, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=4312e3c9-0931-4dd5-ba11-db0d982c2a11,segment=NetworkSegment(aaa5b128-9aff-431e-b567-4ca42a016de6),segment_id=aaa5b128-9aff-431e-b567-4ca42a016de6)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:35:06.112969 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:35:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c2f49c3e-0576-4adb-82e5-e4b0b836c5ca x-openstack-request-id: req-c2f49c3e-0576-4adb-82e5-e4b0b836c5ca {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:35:06.116562 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "80cea05e-57d7-4393-818e-b7a621e986ec", "name": "network-vif-plugged", "status": "completed", "tag": "4312e3c9-0931-4dd5-ba11-db0d982c2a11", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:35:06.117109 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-c2f49c3e-0576-4adb-82e5-e4b0b836c5ca {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:35:06.120988 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '80cea05e-57d7-4393-818e-b7a621e986ec', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4312e3c9-0931-4dd5-ba11-db0d982c2a11', 'code': 200}
Jun 03 08:35:06.177089 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:06.179383 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-6ac5cbae-0034-4682-ba8b-aea818db239d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:06.222891 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:06.285028 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:06.310459 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=4312e3c9-0931-4dd5-ba11-db0d982c2a11,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:06.314100 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:06.468839 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c3cc8c3-041a-46b9-a7cd-74514067ae72 req-47c33293-dc65-4a0f-9b96-f37dcf960460 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:06.470364 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6c3cc8c3-041a-46b9-a7cd-74514067ae72 req-47c33293-dc65-4a0f-9b96-f37dcf960460 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=b9cf7834ca79439981d1f8e77b89daed&device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 1099 time: 0.0776031
Jun 03 08:35:06.501908 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.db_base_plugin_common [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Allocated IP 172.27.0.6 (684ef871-89aa-450d-ae0d-e232bfaf51fb/e7b58fba-1ed5-483b-b341-7736b2ffb853/a2571afe-f3a7-4d03-9f54-1dfe658f3762) {{(pid=92324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:35:06.525538 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21fee62d-b1f3-434c-97d0-1b0f6f9543bb req-651e8088-9591-43bb-a460-c3181e4df78c tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:06.528711 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-21fee62d-b1f3-434c-97d0-1b0f6f9543bb req-651e8088-9591-43bb-a460-c3181e4df78c tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1680763
Jun 03 08:35:06.617889 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c3cc8c3-041a-46b9-a7cd-74514067ae72 req-69848d28-a134-47ca-93df-19e64c267d61 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:06.619382 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6c3cc8c3-041a-46b9-a7cd-74514067ae72 req-69848d28-a134-47ca-93df-19e64c267d61 service neutron] 10.222.0.55 "GET /v2.0/networks?id=6861b4db-6cd2-4a5b-bf02-87826345c933 HTTP/1.1" status: 200  len: 920 time: 0.1424613
Jun 03 08:35:06.669277 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-21fee62d-b1f3-434c-97d0-1b0f6f9543bb req-cefd402e-cae3-462d-a1ea-ea384a417797 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1200399
Jun 03 08:35:06.705390 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6c3cc8c3-041a-46b9-a7cd-74514067ae72 req-9e54998d-7fb2-4365-bcd2-1cd1c9dc1286 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=716f2131-2965-4ead-984f-8ccfcadea071 HTTP/1.1" status: 200  len: 217 time: 0.0702066
Jun 03 08:35:06.722921 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for port, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:06.820703 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:06.825207 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-dbdd853a-5489-40d7-ba8e-598f0b701c58 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:06.888155 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c3cc8c3-041a-46b9-a7cd-74514067ae72 req-5acb795a-ec60-42ea-8998-b2c3b43ebc0e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:06.889619 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6c3cc8c3-041a-46b9-a7cd-74514067ae72 req-5acb795a-ec60-42ea-8998-b2c3b43ebc0e service neutron] 10.222.0.55 "GET /v2.0/subnets?id=0ea4966f-f9de-4d69-a774-7746b1ee12ee HTTP/1.1" status: 200  len: 859 time: 0.1644657
Jun 03 08:35:06.906952 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:35:06.912544 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:35:06.916826 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Received port after_create {{(pid=92324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:35:06.956983 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6c3cc8c3-041a-46b9-a7cd-74514067ae72 req-697a9fa0-9633-498b-9afe-e86d325da11f service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=6861b4db-6cd2-4a5b-bf02-87826345c933&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0533314
Jun 03 08:35:06.959782 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Pushing event updated for resources: {'Port': ['ID=a2571afe-f3a7-4d03-9f54-1dfe658f3762,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:06.966186 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:07.014056 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeb5d7ab-c414-4520-af8b-474d49b81575 req-44699ad2-050e-4091-a4f9-f767fed45928 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:07.015605 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-eeb5d7ab-c414-4520-af8b-474d49b81575 req-44699ad2-050e-4091-a4f9-f767fed45928 service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 1099 time: 0.2513671
Jun 03 08:35:07.027772 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d50b73a6-6a1c-4556-9e64-8d6849d56a9a req-d7ca898d-b138-401b-ab5d-7669597e2ea3 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:07.034797 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d50b73a6-6a1c-4556-9e64-8d6849d56a9a req-d7ca898d-b138-401b-ab5d-7669597e2ea3 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 946 time: 0.2118866
Jun 03 08:35:07.169768 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d50b73a6-6a1c-4556-9e64-8d6849d56a9a req-172c9eed-a7c8-4988-8628-7803f01f2fe8 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1337759
Jun 03 08:35:07.178296 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-eeb5d7ab-c414-4520-af8b-474d49b81575 req-574eff73-9526-479e-a4b5-e28070fa8d51 service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0950508
Jun 03 08:35:07.195931 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6c3cc8c3-041a-46b9-a7cd-74514067ae72 req-0be04cde-892c-47d6-96bd-b2f8ecdc9822 service neutron] 10.222.0.55 "GET /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2344370
Jun 03 08:35:07.327878 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:35:07.381765 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6c3cc8c3-041a-46b9-a7cd-74514067ae72 req-39977e6b-e2fa-4b11-b788-674df64639f5 service neutron] 10.222.0.55 "GET /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1400983
Jun 03 08:35:07.396009 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:07.531889 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:07.755990 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for port, precommit_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:07.841323 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15641369'] for port, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:07.846628 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f6e6cee1-83ef-477b-b5ed-ebb0ce62493c tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:08.035617 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:08.070431 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Pushing event updated for resources: {'Port': ['ID=a2571afe-f3a7-4d03-9f54-1dfe658f3762,revision_number=2']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:08.076972 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.230s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:08.078802 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16327919'] for floatingip, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:08.159935 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3985d17d-43c7-4a49-a638-574fa3748712 req-a69af4f0-51c0-4fb7-bf99-3c4ccc6176e1 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:08.161462 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3985d17d-43c7-4a49-a638-574fa3748712 req-a69af4f0-51c0-4fb7-bf99-3c4ccc6176e1 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.3765078
Jun 03 08:35:08.297306 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3985d17d-43c7-4a49-a638-574fa3748712 req-42d6f516-7691-4a39-9f8b-d66620b7a102 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1243441
Jun 03 08:35:08.309187 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.l3_db [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Floating IP c207f89e-adc3-4f5d-93a8-fb726b6913e9 associated. External IP: 172.27.0.6, port: 37525065-c740-4aee-a826-af098f4b7727.
Jun 03 08:35:08.374024 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b73d9c98-74de-4160-9056-4b3900cb158c req-fd22ca9e-20b7-48bd-83d6-967e54e74d56 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:08.375549 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b73d9c98-74de-4160-9056-4b3900cb158c req-fd22ca9e-20b7-48bd-83d6-967e54e74d56 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 946 time: 0.0898509
Jun 03 08:35:08.422354 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b73d9c98-74de-4160-9056-4b3900cb158c req-0f86c765-11ac-43f5-b4ca-e32ea89f9dd7 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0396724
Jun 03 08:35:08.703982 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Router b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:35:08.911263 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:35:08.913375 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cdb90272-6e3f-42d6-a3ed-9f4ad33d409f None None] Sync routers for ids ['b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'] in dv-cinder-787262-5-iscsi {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:35:08.922456 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cdb90272-6e3f-42d6-a3ed-9f4ad33d409f None None] Routers {'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:35:08.923106 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-cdb90272-6e3f-42d6-a3ed-9f4ad33d409f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae87085dc0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:35:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:35:09.176302 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-cdb90272-6e3f-42d6-a3ed-9f4ad33d409f None None] Set router b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:35:09.274275 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for floatingip, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:09.360964 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 994 time: 3.4836855
Jun 03 08:35:09.364067 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 51958) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:09.364622 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '529b1368-4218-45b2-ac64-62f1d985b8b2', 'tag': '37525065-c740-4aee-a826-af098f4b7727'}] {{(pid=92324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:35:09.371614 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}25ad023063ed160b339e2d2d51ef3e5c51250aece1f4db0a35843dff1b64291a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9e476b58-b9ff-40fb-a7c0-7af12af0212d" -d '{"events": [{"name": "network-changed", "server_uuid": "529b1368-4218-45b2-ac64-62f1d985b8b2", "tag": "37525065-c740-4aee-a826-af098f4b7727"}]}' {{(pid=92324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:35:09.375291 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-b7d71af1-c0ac-4799-84c1-4a84af7d75fe tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-447492865', 'description': 'tempest-secgroup-smoke-447492865 description', 'project_id': '96a989a900784d61a1475d86dd209c5f'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:35:09.391622 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-b7d71af1-c0ac-4799-84c1-4a84af7d75fe tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:35:09.415184 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-b7d71af1-c0ac-4799-84c1-4a84af7d75fe tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:35:09.475507 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:35:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bd1d3806-26b8-4933-91a2-244c06483b8b x-openstack-request-id: req-bd1d3806-26b8-4933-91a2-244c06483b8b {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:35:09.475834 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "529b1368-4218-45b2-ac64-62f1d985b8b2", "tag": "37525065-c740-4aee-a826-af098f4b7727", "status": "completed", "code": 200}]} {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:35:09.476120 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-bd1d3806-26b8-4933-91a2-244c06483b8b {{(pid=92324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:35:09.476551 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '529b1368-4218-45b2-ac64-62f1d985b8b2', 'tag': '37525065-c740-4aee-a826-af098f4b7727', 'status': 'completed', 'code': 200}
Jun 03 08:35:09.618036 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b7d71af1-c0ac-4799-84c1-4a84af7d75fe tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:09.621566 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-cdb90272-6e3f-42d6-a3ed-9f4ad33d409f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae87085dc0>, [{'id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'name': 'tempest-TestMinimumBasicScenario-825399230-router', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:52Z', 'updated_at': '2021-06-03T08:33:03Z', 'revision_number': 4, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'gw_port': {'id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:59:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 358, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:54Z', 'updated_at': '2021-06-03T08:33:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': 'c207f89e-adc3-4f5d-93a8-fb726b6913e9', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'floating_ip_address': '172.27.0.6', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'port_id': '37525065-c740-4aee-a826-af098f4b7727', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 429, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6', 'mac_address': 'fa:16:3e:df:27:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '529b1368-4218-45b2-ac64-62f1d985b8b2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:35:07Z', 'updated_at': '2021-06-03T08:35:07Z', 'revision_number': 0, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '67b7325f-861c-41e6-b770-4814b84aebba', 'name': '', 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'mac_address': 'fa:16:3e:22:e2:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 376, 'fixed_ips': [{'subnet_id': '159409d9-9245-4f6d-adbe-4aa8aad78d07', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:01Z', 'updated_at': '2021-06-03T08:33:15Z', 'revision_number': 5, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'subnets': [{'id': '159409d9-9245-4f6d-adbe-4aa8aad78d07', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:35:09.628410 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cdb90272-6e3f-42d6-a3ed-9f4ad33d409f None None] Checking router: b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 for host: dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:35:09.656841 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cdb90272-6e3f-42d6-a3ed-9f4ad33d409f None None] Routers {'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:35:09.661735 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-cdb90272-6e3f-42d6-a3ed-9f4ad33d409f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae87085dc0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:35:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:35:09.671274 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-b7d71af1-c0ac-4799-84c1-4a84af7d75fe tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:35:09.688943 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-b7d71af1-c0ac-4799-84c1-4a84af7d75fe tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Usage tracker for resource:security_group_rule and tenant:96a989a900784d61a1475d86dd209c5f is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:35:09.698295 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-b7d71af1-c0ac-4799-84c1-4a84af7d75fe tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:35:09.699593 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f428ae2d-f9a0-45d0-907d-fcda14686725 req-c3e67a91-fd07-432f-b169-6100fb6811a1 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:09.702049 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f428ae2d-f9a0-45d0-907d-fcda14686725 req-c3e67a91-fd07-432f-b169-6100fb6811a1 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 946 time: 0.1097710
Jun 03 08:35:09.707459 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-b7d71af1-c0ac-4799-84c1-4a84af7d75fe tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:35:09.719113 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e476b58-b9ff-40fb-a7c0-7af12af0212d req-c27df8f5-cd59-4dd1-9b1c-5f3f5ad07a22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:09.720849 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9e476b58-b9ff-40fb-a7c0-7af12af0212d req-c27df8f5-cd59-4dd1-9b1c-5f3f5ad07a22 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=96a989a900784d61a1475d86dd209c5f&device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 1098 time: 0.2089944
Jun 03 08:35:09.795869 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f428ae2d-f9a0-45d0-907d-fcda14686725 req-f792328c-814b-4227-84b5-b3c32313416a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0833063
Jun 03 08:35:09.804626 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28138064-2403-42e8-9c11-d23db5f2efc6 req-7340cbab-2fd6-42a3-a20a-4efb716e6f02 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:09.806972 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-28138064-2403-42e8-9c11-d23db5f2efc6 req-7340cbab-2fd6-42a3-a20a-4efb716e6f02 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.2219577
Jun 03 08:35:09.951475 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-cdb90272-6e3f-42d6-a3ed-9f4ad33d409f None None] Set router b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:35:10.015932 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe1888f8-5096-46a2-83fc-074bc6a3bdef req-cde83b8d-1374-4bcb-bc2b-c0cc5313de04 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:10.018343 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-fe1888f8-5096-46a2-83fc-074bc6a3bdef req-cde83b8d-1374-4bcb-bc2b-c0cc5313de04 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 946 time: 0.0912902
Jun 03 08:35:10.074777 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-28138064-2403-42e8-9c11-d23db5f2efc6 req-89c8c224-b925-4a0d-9232-ef313a786341 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1073864
Jun 03 08:35:10.096584 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-fe1888f8-5096-46a2-83fc-074bc6a3bdef req-37eca5a8-3552-4de2-9a44-f3f8056e8052 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0652466
Jun 03 08:35:10.106699 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e476b58-b9ff-40fb-a7c0-7af12af0212d req-3dde9947-a436-4d69-af6f-63f85c7e4b61 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:10.106699 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9e476b58-b9ff-40fb-a7c0-7af12af0212d req-3dde9947-a436-4d69-af6f-63f85c7e4b61 service neutron] 10.222.0.55 "GET /v2.0/networks?id=113ded30-096c-4860-8773-fb717f3ea4c6 HTTP/1.1" status: 200  len: 915 time: 0.3666282
Jun 03 08:35:10.111158 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 51976) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:10.197718 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b7d71af1-c0ac-4799-84c1-4a84af7d75fe tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:10.250758 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9e476b58-b9ff-40fb-a7c0-7af12af0212d req-0b65e90e-9152-403a-a938-143da6a98f33 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=37525065-c740-4aee-a826-af098f4b7727 HTTP/1.1" status: 200  len: 997 time: 0.1164598
Jun 03 08:35:10.309543 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b7d71af1-c0ac-4799-84c1-4a84af7d75fe tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:10.317954 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-8925de43-f7f7-40fc-8811-231b065a524f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:10.381038 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7d71af1-c0ac-4799-84c1-4a84af7d75fe tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Pushing event updated for resources: {'SecurityGroup': ['ID=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:10.383889 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-cdb90272-6e3f-42d6-a3ed-9f4ad33d409f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae87085dc0>, [{'id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'name': 'tempest-TestMinimumBasicScenario-825399230-router', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:52Z', 'updated_at': '2021-06-03T08:33:03Z', 'revision_number': 4, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'gw_port': {'id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:59:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 358, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:54Z', 'updated_at': '2021-06-03T08:33:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': 'c207f89e-adc3-4f5d-93a8-fb726b6913e9', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'floating_ip_address': '172.27.0.6', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'port_id': '37525065-c740-4aee-a826-af098f4b7727', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 429, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6', 'mac_address': 'fa:16:3e:df:27:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '529b1368-4218-45b2-ac64-62f1d985b8b2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:35:07Z', 'updated_at': '2021-06-03T08:35:07Z', 'revision_number': 0, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '67b7325f-861c-41e6-b770-4814b84aebba', 'name': '', 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'mac_address': 'fa:16:3e:22:e2:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 376, 'fixed_ips': [{'subnet_id': '159409d9-9245-4f6d-adbe-4aa8aad78d07', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:01Z', 'updated_at': '2021-06-03T08:33:15Z', 'revision_number': 5, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'subnets': [{'id': '159409d9-9245-4f6d-adbe-4aa8aad78d07', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:35:10.388641 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cdb90272-6e3f-42d6-a3ed-9f4ad33d409f None None] The sync data for ids ['b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'] in dv-cinder-787262-5-iscsi is: [{'id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'name': 'tempest-TestMinimumBasicScenario-825399230-router', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:52Z', 'updated_at': '2021-06-03T08:33:03Z', 'revision_number': 4, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'gw_port': {'id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:59:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 358, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:54Z', 'updated_at': '2021-06-03T08:33:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': 'c207f89e-adc3-4f5d-93a8-fb726b6913e9', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'floating_ip_address': '172.27.0.6', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'port_id': '37525065-c740-4aee-a826-af098f4b7727', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 429, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6', 'mac_address': 'fa:16:3e:df:27:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '529b1368-4218-45b2-ac64-62f1d985b8b2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:35:07Z', 'updated_at': '2021-06-03T08:35:07Z', 'revision_number': 0, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '67b7325f-861c-41e6-b770-4814b84aebba', 'name': '', 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'mac_address': 'fa:16:3e:22:e2:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 376, 'fixed_ips': [{'subnet_id': '159409d9-9245-4f6d-adbe-4aa8aad78d07', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:01Z', 'updated_at': '2021-06-03T08:33:15Z', 'revision_number': 5, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'subnets': [{'id': '159409d9-9245-4f6d-adbe-4aa8aad78d07', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:35:10.401901 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b7d71af1-c0ac-4799-84c1-4a84af7d75fe tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:10.405910 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e476b58-b9ff-40fb-a7c0-7af12af0212d req-2201efbc-4440-4537-9fdf-bbe9eac3fbeb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:10.407656 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9e476b58-b9ff-40fb-a7c0-7af12af0212d req-2201efbc-4440-4537-9fdf-bbe9eac3fbeb service neutron] 10.222.0.55 "GET /v2.0/subnets?id=159409d9-9245-4f6d-adbe-4aa8aad78d07 HTTP/1.1" status: 200  len: 853 time: 0.1461830
Jun 03 08:35:10.412238 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b91cd939-62bd-4b9a-b2f8-ae46f7b4459b tempest-TestShelveInstance-1740549098 tempest-TestShelveInstance-1740549098-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:10.413199 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-b91cd939-62bd-4b9a-b2f8-ae46f7b4459b tempest-TestShelveInstance-1740549098 tempest-TestShelveInstance-1740549098-project-admin] Synchronizing usage tracker for tenant:66cedbb00e294ca49bf37a7789202b7f on resource:port {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:35:10.432686 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 51982) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:10.497086 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b7d71af1-c0ac-4799-84c1-4a84af7d75fe tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:10.498539 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-b7d71af1-c0ac-4799-84c1-4a84af7d75fe tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1792 time: 1.1304448
Jun 03 08:35:10.501552 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 51988) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:10.508386 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-5ae9c399-b242-4b62-b699-f942c94a5dae tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Request body: {'security_group_rule': {'security_group_id': '47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b', 'project_id': '96a989a900784d61a1475d86dd209c5f', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:35:10.528798 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-5ae9c399-b242-4b62-b699-f942c94a5dae tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:35:10.544938 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-5ae9c399-b242-4b62-b699-f942c94a5dae tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Usage tracker for resource:security_group_rule and tenant:96a989a900784d61a1475d86dd209c5f is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:35:10.558190 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e476b58-b9ff-40fb-a7c0-7af12af0212d req-c611007c-e5d1-426b-85b8-fb868adf569a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:10.558839 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-5ae9c399-b242-4b62-b699-f942c94a5dae tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:35:10.560221 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9e476b58-b9ff-40fb-a7c0-7af12af0212d req-c611007c-e5d1-426b-85b8-fb868adf569a service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=113ded30-096c-4860-8773-fb717f3ea4c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1222312
Jun 03 08:35:10.566914 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-5ae9c399-b242-4b62-b699-f942c94a5dae tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:35:10.572209 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-b91cd939-62bd-4b9a-b2f8-ae46f7b4459b tempest-TestShelveInstance-1740549098 tempest-TestShelveInstance-1740549098-project-admin] Unset dirty status for tenant:66cedbb00e294ca49bf37a7789202b7f on resource:port {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:35:10.576455 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-b91cd939-62bd-4b9a-b2f8-ae46f7b4459b tempest-TestShelveInstance-1740549098 tempest-TestShelveInstance-1740549098-project-admin] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 1094 time: 0.4610677
Jun 03 08:35:10.577148 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 51990) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:10.599676 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Request body: {'floatingip': {'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'port_id': '4312e3c9-0931-4dd5-ba11-db0d982c2a11', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'fixed_ip_address': '172.20.0.13'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:35:10.609098 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:35:10.611052 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7fce6939-302b-4876-a660-a7aaf88543d9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:10.615617 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Usage tracker for resource:floatingip and tenant:0e5e096a327f421e9b0a02235740cc36 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:35:10.621405 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:35:10.625989 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:35:10.650368 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-7fce6939-302b-4876-a660-a7aaf88543d9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:35:10.709819 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-7fce6939-302b-4876-a660-a7aaf88543d9 admin admin] Usage tracker for resource:security_group_rule and tenant:3fe5d5511e7d4d14b9009ac5784f1d62 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:35:10.717794 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-7fce6939-302b-4876-a660-a7aaf88543d9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:35:10.722812 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5ae9c399-b242-4b62-b699-f942c94a5dae tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:10.732074 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-7fce6939-302b-4876-a660-a7aaf88543d9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:35:10.743269 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e82714dd-a68f-4eab-bdcf-d564e3e3739c None None] New status for floating IP c207f89e-adc3-4f5d-93a8-fb726b6913e9: ACTIVE {{(pid=92325) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 03 08:35:10.790576 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for floatingip, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:10.795857 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9e476b58-b9ff-40fb-a7c0-7af12af0212d req-4f098819-0e84-495c-8d93-40625295f05b service neutron] 10.222.0.55 "GET /v2.0/networks/113ded30-096c-4860-8773-fb717f3ea4c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2104301
Jun 03 08:35:10.834866 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5ae9c399-b242-4b62-b699-f942c94a5dae tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:10.971412 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:10.984916 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9e476b58-b9ff-40fb-a7c0-7af12af0212d req-e8168178-ac23-4ce9-8fc3-966a7863de19 service neutron] 10.222.0.55 "GET /v2.0/networks/113ded30-096c-4860-8773-fb717f3ea4c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1789482
Jun 03 08:35:10.989351 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7fce6939-302b-4876-a660-a7aaf88543d9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:11.104501 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5ae9c399-b242-4b62-b699-f942c94a5dae tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:11.108618 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7fce6939-302b-4876-a660-a7aaf88543d9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:11.112854 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-04edfe5a-6f41-4f64-b18b-88dcf8a8d86b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:11.118212 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-bc0680c6-8074-48c3-bd89-72d6ca5bb6d6 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:11.158258 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fce6939-302b-4876-a660-a7aaf88543d9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=08a45697-1b76-43d0-957f-aca5603cb085,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:11.160133 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ae9c399-b242-4b62-b699-f942c94a5dae tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8056e6e2-8e47-4b79-8a0c-fd49bccaab9d,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:11.165276 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-5ae9c399-b242-4b62-b699-f942c94a5dae tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:11.175884 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-7fce6939-302b-4876-a660-a7aaf88543d9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:11.203866 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-7fce6939-302b-4876-a660-a7aaf88543d9 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=3fe5d5511e7d4d14b9009ac5784f1d62&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7748656
Jun 03 08:35:11.209426 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 51996) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:11.269523 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.db_base_plugin_common [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Allocated IP 172.27.0.53 (684ef871-89aa-450d-ae0d-e232bfaf51fb/e7b58fba-1ed5-483b-b341-7736b2ffb853/e5dbbb85-852d-4ccb-acb6-96d42033c441) {{(pid=92324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:35:11.285956 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c41d84ba-99d5-4183-bf74-fed25113e1c4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:11.312360 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5ae9c399-b242-4b62-b699-f942c94a5dae tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:11.313533 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-5ae9c399-b242-4b62-b699-f942c94a5dae tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.8104644
Jun 03 08:35:11.313848 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c41d84ba-99d5-4183-bf74-fed25113e1c4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:11.321320 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 51998) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:11.328226 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-f154a533-c18a-4171-9eb7-1f20327300cc tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Request body: {'security_group_rule': {'security_group_id': '47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b', 'project_id': '96a989a900784d61a1475d86dd209c5f', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:35:11.342288 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-f154a533-c18a-4171-9eb7-1f20327300cc tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:35:11.350556 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-f154a533-c18a-4171-9eb7-1f20327300cc tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Usage tracker for resource:security_group_rule and tenant:96a989a900784d61a1475d86dd209c5f is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:35:11.361067 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-f154a533-c18a-4171-9eb7-1f20327300cc tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:35:11.371035 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-f154a533-c18a-4171-9eb7-1f20327300cc tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:35:11.458819 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19aaae43-528c-4425-bc47-865770834b00 req-9b378659-8a11-4074-b35c-b2d4b6fea6f2 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:11.460312 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-19aaae43-528c-4425-bc47-865770834b00 req-9b378659-8a11-4074-b35c-b2d4b6fea6f2 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1995630
Jun 03 08:35:11.520314 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for port, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:11.528146 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f154a533-c18a-4171-9eb7-1f20327300cc tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:11.539472 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-19aaae43-528c-4425-bc47-865770834b00 req-4d3b6f94-a106-410a-9e39-752cd5784657 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0663109
Jun 03 08:35:11.602768 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c41d84ba-99d5-4183-bf74-fed25113e1c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:11.610773 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-7fce6939-302b-4876-a660-a7aaf88543d9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:11.623751 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f154a533-c18a-4171-9eb7-1f20327300cc tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:11.627872 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c41d84ba-99d5-4183-bf74-fed25113e1c4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=08a45697-1b76-43d0-957f-aca5603cb085,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:11.634620 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c41d84ba-99d5-4183-bf74-fed25113e1c4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:11.644211 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c41d84ba-99d5-4183-bf74-fed25113e1c4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:11.659402 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:11.662558 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-c41d84ba-99d5-4183-bf74-fed25113e1c4 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/08a45697-1b76-43d0-957f-aca5603cb085 HTTP/1.1" status: 204  len: 168 time: 0.4566183
Jun 03 08:35:11.668117 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9e62837d-700c-41d5-8747-d50dabc78549 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:11.723987 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f154a533-c18a-4171-9eb7-1f20327300cc tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:11.727565 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:11.745107 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:35:11.747521 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:35:11.756806 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Received port after_create {{(pid=92324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:35:11.781088 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f154a533-c18a-4171-9eb7-1f20327300cc tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d33cb036-3a4f-443a-b2b4-40c266e5e39d,revision_number=0']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:11.801810 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Pushing event updated for resources: {'Port': ['ID=e5dbbb85-852d-4ccb-acb6-96d42033c441,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:11.801810 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:11.805579 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f154a533-c18a-4171-9eb7-1f20327300cc tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:11.925772 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f154a533-c18a-4171-9eb7-1f20327300cc tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:11.929900 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-f154a533-c18a-4171-9eb7-1f20327300cc tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.6047206
Jun 03 08:35:11.936080 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 52014) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:11.936080 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-4bd08d68-c826-4c73-82c7-1b32021545df tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Request body: {'security_group_rule': {'security_group_id': '47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b', 'project_id': '96a989a900784d61a1475d86dd209c5f', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:35:11.942325 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-4bd08d68-c826-4c73-82c7-1b32021545df tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:35:11.947322 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-4bd08d68-c826-4c73-82c7-1b32021545df tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Usage tracker for resource:security_group_rule and tenant:96a989a900784d61a1475d86dd209c5f is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:35:11.956981 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-4bd08d68-c826-4c73-82c7-1b32021545df tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:35:11.969012 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-4bd08d68-c826-4c73-82c7-1b32021545df tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:35:12.122197 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4bd08d68-c826-4c73-82c7-1b32021545df tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:12.204603 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4bd08d68-c826-4c73-82c7-1b32021545df tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:12.276169 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:12.279402 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4bd08d68-c826-4c73-82c7-1b32021545df tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:12.289120 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:12.311298 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bd08d68-c826-4c73-82c7-1b32021545df tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a196c95c-2649-4688-baea-02cb3b85e63b,revision_number=0']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:12.314083 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-4bd08d68-c826-4c73-82c7-1b32021545df tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:12.457921 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4bd08d68-c826-4c73-82c7-1b32021545df tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:12.461499 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-4bd08d68-c826-4c73-82c7-1b32021545df tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.5299399
Jun 03 08:35:12.462541 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 52022) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:12.469803 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-c57d2827-81bb-47b3-a17f-5920c227d571 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Request body: {'security_group_rule': {'security_group_id': '47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b', 'project_id': '96a989a900784d61a1475d86dd209c5f', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:35:12.474288 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-c57d2827-81bb-47b3-a17f-5920c227d571 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:35:12.478677 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-c57d2827-81bb-47b3-a17f-5920c227d571 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Usage tracker for resource:security_group_rule and tenant:96a989a900784d61a1475d86dd209c5f is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:35:12.481738 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-c57d2827-81bb-47b3-a17f-5920c227d571 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:35:12.488016 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-c57d2827-81bb-47b3-a17f-5920c227d571 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:35:12.512734 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:12.630014 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c57d2827-81bb-47b3-a17f-5920c227d571 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:12.712486 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0bca199-bb53-43c5-bec9-1866ac399cef req-82ebc8cc-da35-441c-8047-fdd578b3e023 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:12.714030 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d0bca199-bb53-43c5-bec9-1866ac399cef req-82ebc8cc-da35-441c-8047-fdd578b3e023 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 945 time: 0.1448884
Jun 03 08:35:12.745991 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c57d2827-81bb-47b3-a17f-5920c227d571 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:12.758187 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for port, precommit_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:12.781181 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d0bca199-bb53-43c5-bec9-1866ac399cef req-4963afcb-3747-4549-bead-8007a88942c4 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0524080
Jun 03 08:35:12.781181 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 52028) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:12.799385 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4864964e-94fb-423f-912a-ebcf3beab917 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:12.814594 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-4864964e-94fb-423f-912a-ebcf3beab917 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:35:12.819531 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-4864964e-94fb-423f-912a-ebcf3beab917 admin admin] Usage tracker for resource:security_group_rule and tenant:7facc0ea027c4f2695fcf0795ea1f8e5 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:35:12.835906 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-4864964e-94fb-423f-912a-ebcf3beab917 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:35:12.835906 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-4864964e-94fb-423f-912a-ebcf3beab917 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:35:12.902530 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c57d2827-81bb-47b3-a17f-5920c227d571 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:12.910134 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-4bd08d68-c826-4c73-82c7-1b32021545df tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:12.920573 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4864964e-94fb-423f-912a-ebcf3beab917 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:12.935353 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c57d2827-81bb-47b3-a17f-5920c227d571 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=36b958a3-5a81-4ce8-a007-40d464d0bc99,revision_number=0']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:12.937663 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c57d2827-81bb-47b3-a17f-5920c227d571 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:13.016859 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15641369'] for port, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:13.021568 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:13.134325 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Pushing event updated for resources: {'Port': ['ID=e5dbbb85-852d-4ccb-acb6-96d42033c441,revision_number=2']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:13.138440 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:13.148845 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16327919'] for floatingip, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:13.170998 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4864964e-94fb-423f-912a-ebcf3beab917 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:13.178327 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-7add626c-f2c0-459d-a543-85853f1a52ef admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:13.219856 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c57d2827-81bb-47b3-a17f-5920c227d571 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:13.219856 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-c57d2827-81bb-47b3-a17f-5920c227d571 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.7544012
Jun 03 08:35:13.222746 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 52030) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:13.227073 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-4864964e-94fb-423f-912a-ebcf3beab917 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=7facc0ea027c4f2695fcf0795ea1f8e5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4450347
Jun 03 08:35:13.227959 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4864964e-94fb-423f-912a-ebcf3beab917 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=14e9a194-4bf1-4e19-b54d-7a35be993c7a,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:13.229392 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-d9b22a8f-c595-4645-b425-37710d168de5 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Request body: {'security_group_rule': {'security_group_id': '47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b', 'project_id': '96a989a900784d61a1475d86dd209c5f', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:35:13.230221 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 52032) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:13.240523 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-d9b22a8f-c595-4645-b425-37710d168de5 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:35:13.241675 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-4864964e-94fb-423f-912a-ebcf3beab917 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:13.249101 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-d9b22a8f-c595-4645-b425-37710d168de5 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Usage tracker for resource:security_group_rule and tenant:96a989a900784d61a1475d86dd209c5f is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:35:13.291298 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9f3459e6-e0f4-4e3b-b411-a472a35c2d79 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:13.305564 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-d9b22a8f-c595-4645-b425-37710d168de5 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:35:13.324790 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9f3459e6-e0f4-4e3b-b411-a472a35c2d79 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:13.326683 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-d9b22a8f-c595-4645-b425-37710d168de5 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:35:13.360048 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.l3_db [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Floating IP aa804224-baf6-4b3f-a57f-017c677d978b associated. External IP: 172.27.0.53, port: 4312e3c9-0931-4dd5-ba11-db0d982c2a11.
Jun 03 08:35:13.514090 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9f3459e6-e0f4-4e3b-b411-a472a35c2d79 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:13.516889 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.securitygroups_db [None req-d9b22a8f-c595-4645-b425-37710d168de5 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Project 96a989a900784d61a1475d86dd209c5f added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 03 08:35:13.519580 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-be835e75-9bb6-4707-ac30-40bfc889185a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:13.531783 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d9b22a8f-c595-4645-b425-37710d168de5 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:13.532125 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f3459e6-e0f4-4e3b-b411-a472a35c2d79 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=14e9a194-4bf1-4e19-b54d-7a35be993c7a,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:13.535895 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-9f3459e6-e0f4-4e3b-b411-a472a35c2d79 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:13.543535 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9f3459e6-e0f4-4e3b-b411-a472a35c2d79 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:13.547832 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-9f3459e6-e0f4-4e3b-b411-a472a35c2d79 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/14e9a194-4bf1-4e19-b54d-7a35be993c7a HTTP/1.1" status: 204  len: 168 time: 0.3139164
Jun 03 08:35:13.691128 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d9b22a8f-c595-4645-b425-37710d168de5 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:13.855578 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d9b22a8f-c595-4645-b425-37710d168de5 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:13.875201 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-860da70f-5db2-4cc8-b035-a268de7209ee tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:13.907678 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9b22a8f-c595-4645-b425-37710d168de5 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=37943062-b0fc-42a4-b91d-abaaac9a7377,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:13.916139 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-d9b22a8f-c595-4645-b425-37710d168de5 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:13.981254 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Router 02c1b0e4-a9b8-4fc7-af87-8069fb4caced has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:35:14.077739 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d9b22a8f-c595-4645-b425-37710d168de5 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:14.077739 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-d9b22a8f-c595-4645-b425-37710d168de5 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.8500223
Jun 03 08:35:14.079223 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 52044) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:14.084644 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-6c0ae267-6ef9-49e1-815c-c31212947051 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Request body: {'security_group_rule': {'security_group_id': '47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b', 'project_id': '96a989a900784d61a1475d86dd209c5f', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:35:14.090786 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-6c0ae267-6ef9-49e1-815c-c31212947051 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:35:14.095389 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-6c0ae267-6ef9-49e1-815c-c31212947051 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Usage tracker for resource:security_group_rule and tenant:96a989a900784d61a1475d86dd209c5f is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:35:14.098559 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-6c0ae267-6ef9-49e1-815c-c31212947051 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:35:14.104647 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-6c0ae267-6ef9-49e1-815c-c31212947051 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:35:14.105215 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdea67ab-dd9d-4785-8aef-5e79f7215d4b req-49c8544f-e8e5-443e-8191-a1c85717864f tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:14.106854 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-bdea67ab-dd9d-4785-8aef-5e79f7215d4b req-49c8544f-e8e5-443e-8191-a1c85717864f tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 945 time: 0.1964374
Jun 03 08:35:14.211021 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.db.securitygroups_db [None req-6c0ae267-6ef9-49e1-815c-c31212947051 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Project 96a989a900784d61a1475d86dd209c5f added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 03 08:35:14.217269 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-6c0ae267-6ef9-49e1-815c-c31212947051 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:14.244492 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:35:14.256053 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3fe12eb8-b505-4a80-abdf-86b5606d8d6e None None] Sync routers for ids ['02c1b0e4-a9b8-4fc7-af87-8069fb4caced'] in dv-cinder-787262-5-iscsi {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:35:14.266964 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-bdea67ab-dd9d-4785-8aef-5e79f7215d4b req-b3cca86f-8bbb-40bb-b301-1d068bcdab11 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0922110
Jun 03 08:35:14.302413 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3fe12eb8-b505-4a80-abdf-86b5606d8d6e None None] Routers {'02c1b0e4-a9b8-4fc7-af87-8069fb4caced'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:35:14.303430 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-6c0ae267-6ef9-49e1-815c-c31212947051 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:14.304391 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-3fe12eb8-b505-4a80-abdf-86b5606d8d6e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae870858e0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:35:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['02c1b0e4-a9b8-4fc7-af87-8069fb4caced'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:35:14.382513 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for floatingip, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:14.444597 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-f80c6012-5b95-495c-b111-9784c1852e9b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 3.8665931
Jun 03 08:35:14.445409 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '80cea05e-57d7-4393-818e-b7a621e986ec', 'tag': '4312e3c9-0931-4dd5-ba11-db0d982c2a11'}] {{(pid=92324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:35:14.447850 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}25ad023063ed160b339e2d2d51ef3e5c51250aece1f4db0a35843dff1b64291a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9fa9701a-78ea-45cf-8909-663b46929671" -d '{"events": [{"name": "network-changed", "server_uuid": "80cea05e-57d7-4393-818e-b7a621e986ec", "tag": "4312e3c9-0931-4dd5-ba11-db0d982c2a11"}]}' {{(pid=92324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:35:14.459931 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-6c0ae267-6ef9-49e1-815c-c31212947051 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:14.462114 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b90eb328-02ed-4e45-94b5-e7aa06f1ec64 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:14.489706 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c0ae267-6ef9-49e1-815c-c31212947051 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=834151b9-9699-4554-9fb0-4eb1b623cbf0,revision_number=0']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:14.492666 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-6c0ae267-6ef9-49e1-815c-c31212947051 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:14.506154 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-3fe12eb8-b505-4a80-abdf-86b5606d8d6e None None] Set router 02c1b0e4-a9b8-4fc7-af87-8069fb4caced gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:35:14.511465 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:35:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8179847a-8adc-4c1b-9711-0f570e0b97bc x-openstack-request-id: req-8179847a-8adc-4c1b-9711-0f570e0b97bc {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:35:14.512100 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "80cea05e-57d7-4393-818e-b7a621e986ec", "tag": "4312e3c9-0931-4dd5-ba11-db0d982c2a11", "status": "completed", "code": 200}]} {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:35:14.512575 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-8179847a-8adc-4c1b-9711-0f570e0b97bc {{(pid=92324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:35:14.513187 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '80cea05e-57d7-4393-818e-b7a621e986ec', 'tag': '4312e3c9-0931-4dd5-ba11-db0d982c2a11', 'status': 'completed', 'code': 200}
Jun 03 08:35:14.584956 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-6c0ae267-6ef9-49e1-815c-c31212947051 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:14.586249 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-6c0ae267-6ef9-49e1-815c-c31212947051 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.5059545
Jun 03 08:35:14.640566 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fa9701a-78ea-45cf-8909-663b46929671 req-b6f4758a-9506-4c9b-9acf-9d6da3463a91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:14.645065 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9fa9701a-78ea-45cf-8909-663b46929671 req-b6f4758a-9506-4c9b-9acf-9d6da3463a91 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=0e5e096a327f421e9b0a02235740cc36&device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 1099 time: 0.1011429
Jun 03 08:35:14.746806 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-46ecc2af-5abf-4d8d-a026-e99169c10a49 req-62077090-d1dc-44b1-9317-b1606bc82ee7 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-447492865&fields=id&tenant_id=96a989a900784d61a1475d86dd209c5f HTTP/1.1" status: 200  len: 267 time: 0.0552163
Jun 03 08:35:14.863449 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46ecc2af-5abf-4d8d-a026-e99169c10a49 req-c0b3e01e-2fce-4808-bd4f-dcd5df04dceb tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:14.864923 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fa9701a-78ea-45cf-8909-663b46929671 req-86eeaf68-9b2c-4112-ab15-5fd916c3f6a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:14.865084 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-46ecc2af-5abf-4d8d-a026-e99169c10a49 req-c0b3e01e-2fce-4808-bd4f-dcd5df04dceb tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 945 time: 0.1173458
Jun 03 08:35:14.866809 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9fa9701a-78ea-45cf-8909-663b46929671 req-86eeaf68-9b2c-4112-ab15-5fd916c3f6a3 service neutron] 10.222.0.55 "GET /v2.0/networks?id=4a053960-3cf4-4216-b7a5-291ef61e89b7 HTTP/1.1" status: 200  len: 910 time: 0.2069564
Jun 03 08:35:14.878441 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [req-46ecc2af-5abf-4d8d-a026-e99169c10a49 req-eeadb5f3-03c6-444b-9d29-d8199a44610a tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Request body: {'port': {'security_groups': ['f03c63c9-82ad-4a26-aba6-7f507d2ecc01', '47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b']}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:35:15.004262 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-3fe12eb8-b505-4a80-abdf-86b5606d8d6e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae870858e0>, [{'id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'name': 'tempest-TestShelveInstance-1807805368-router', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155'}], 'enable_snat': True}, 'gw_port_id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:06Z', 'updated_at': '2021-06-03T08:33:23Z', 'revision_number': 4, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'gw_port': {'id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:4e:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:10Z', 'updated_at': '2021-06-03T08:33:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': 'aa804224-baf6-4b3f-a57f-017c677d978b', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'floating_ip_address': '172.27.0.53', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'port_id': '4312e3c9-0931-4dd5-ba11-db0d982c2a11', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 442, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7', 'mac_address': 'fa:16:3e:72:a1:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80cea05e-57d7-4393-818e-b7a621e986ec', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:35:12Z', 'updated_at': '2021-06-03T08:35:12Z', 'revision_number': 0, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ce979b40-484e-45cd-a6cb-a3940bb7a659', 'name': '', 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'mac_address': 'fa:16:3e:b9:79:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'fc181126-7c66-44d3-b731-a59036bd562f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:21Z', 'updated_at': '2021-06-03T08:33:36Z', 'revision_number': 5, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'subnets': [{'id': 'fc181126-7c66-44d3-b731-a59036bd562f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:35:15.007305 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3fe12eb8-b505-4a80-abdf-86b5606d8d6e None None] Checking router: 02c1b0e4-a9b8-4fc7-af87-8069fb4caced for host: dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:35:15.042950 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3fe12eb8-b505-4a80-abdf-86b5606d8d6e None None] Routers {'02c1b0e4-a9b8-4fc7-af87-8069fb4caced'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:35:15.044437 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-3fe12eb8-b505-4a80-abdf-86b5606d8d6e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae870858e0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:35:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['02c1b0e4-a9b8-4fc7-af87-8069fb4caced'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:35:15.065453 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-46ecc2af-5abf-4d8d-a026-e99169c10a49 req-eeadb5f3-03c6-444b-9d29-d8199a44610a tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:15.162039 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9fa9701a-78ea-45cf-8909-663b46929671 req-962aecbe-3132-45aa-8a54-de7f8993cfdd service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4312e3c9-0931-4dd5-ba11-db0d982c2a11 HTTP/1.1" status: 200  len: 999 time: 0.2818801
Jun 03 08:35:15.260617 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-3fe12eb8-b505-4a80-abdf-86b5606d8d6e None None] Set router 02c1b0e4-a9b8-4fc7-af87-8069fb4caced gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:35:15.280007 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fa9701a-78ea-45cf-8909-663b46929671 req-b669541a-f14f-4b8a-99ee-83c6a3d3832e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:15.281474 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9fa9701a-78ea-45cf-8909-663b46929671 req-b669541a-f14f-4b8a-99ee-83c6a3d3832e service neutron] 10.222.0.55 "GET /v2.0/subnets?id=fc181126-7c66-44d3-b731-a59036bd562f HTTP/1.1" status: 200  len: 848 time: 0.0961530
Jun 03 08:35:15.296459 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f49595d5-8350-4289-a8e9-d4851cf52bf7 req-43296150-0d84-46a7-a62f-3d0f01dd626a tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:15.313830 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f49595d5-8350-4289-a8e9-d4851cf52bf7 req-43296150-0d84-46a7-a62f-3d0f01dd626a tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.55 "GET /v2.0/ports?device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 945 time: 0.2026629
Jun 03 08:35:15.532634 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.db [req-46ecc2af-5abf-4d8d-a026-e99169c10a49 req-eeadb5f3-03c6-444b-9d29-d8199a44610a tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] For port 37525065-c740-4aee-a826-af098f4b7727, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=37525065-c740-4aee-a826-af098f4b7727,segment=NetworkSegment(3151dd7e-a009-433b-ae5e-c81299e42bfb),segment_id=3151dd7e-a009-433b-ae5e-c81299e42bfb)] {{(pid=92324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:35:15.541532 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fa9701a-78ea-45cf-8909-663b46929671 req-9c1cfdea-1bdb-40b9-8df0-28bcf53a930b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:15.543108 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9fa9701a-78ea-45cf-8909-663b46929671 req-9c1cfdea-1bdb-40b9-8df0-28bcf53a930b service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=4a053960-3cf4-4216-b7a5-291ef61e89b7&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2438440
Jun 03 08:35:15.559686 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-46ecc2af-5abf-4d8d-a026-e99169c10a49 req-eeadb5f3-03c6-444b-9d29-d8199a44610a tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for port, precommit_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:15.685757 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-f49595d5-8350-4289-a8e9-d4851cf52bf7 req-156e4f36-13ba-459d-bf1c-0c0d79816bcb tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Deleting port ab26d5bb-6495-4c9b-b134-6612a997f201 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:35:15.686103 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-f49595d5-8350-4289-a8e9-d4851cf52bf7 req-156e4f36-13ba-459d-bf1c-0c0d79816bcb tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:15.691862 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-3fe12eb8-b505-4a80-abdf-86b5606d8d6e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae870858e0>, [{'id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'name': 'tempest-TestShelveInstance-1807805368-router', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155'}], 'enable_snat': True}, 'gw_port_id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:06Z', 'updated_at': '2021-06-03T08:33:23Z', 'revision_number': 4, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'gw_port': {'id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:4e:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:10Z', 'updated_at': '2021-06-03T08:33:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': 'aa804224-baf6-4b3f-a57f-017c677d978b', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'floating_ip_address': '172.27.0.53', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'port_id': '4312e3c9-0931-4dd5-ba11-db0d982c2a11', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 442, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7', 'mac_address': 'fa:16:3e:72:a1:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80cea05e-57d7-4393-818e-b7a621e986ec', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:35:12Z', 'updated_at': '2021-06-03T08:35:12Z', 'revision_number': 0, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ce979b40-484e-45cd-a6cb-a3940bb7a659', 'name': '', 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'mac_address': 'fa:16:3e:b9:79:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'fc181126-7c66-44d3-b731-a59036bd562f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:21Z', 'updated_at': '2021-06-03T08:33:36Z', 'revision_number': 5, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'subnets': [{'id': 'fc181126-7c66-44d3-b731-a59036bd562f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:35:15.692388 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-46ecc2af-5abf-4d8d-a026-e99169c10a49 req-eeadb5f3-03c6-444b-9d29-d8199a44610a tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15641369'] for port, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:15.701068 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3fe12eb8-b505-4a80-abdf-86b5606d8d6e None None] The sync data for ids ['02c1b0e4-a9b8-4fc7-af87-8069fb4caced'] in dv-cinder-787262-5-iscsi is: [{'id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'name': 'tempest-TestShelveInstance-1807805368-router', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155'}], 'enable_snat': True}, 'gw_port_id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:06Z', 'updated_at': '2021-06-03T08:33:23Z', 'revision_number': 4, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'gw_port': {'id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:4e:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:10Z', 'updated_at': '2021-06-03T08:33:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': 'aa804224-baf6-4b3f-a57f-017c677d978b', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'floating_ip_address': '172.27.0.53', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'port_id': '4312e3c9-0931-4dd5-ba11-db0d982c2a11', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 442, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7', 'mac_address': 'fa:16:3e:72:a1:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80cea05e-57d7-4393-818e-b7a621e986ec', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:35:12Z', 'updated_at': '2021-06-03T08:35:12Z', 'revision_number': 0, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ce979b40-484e-45cd-a6cb-a3940bb7a659', 'name': '', 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'mac_address': 'fa:16:3e:b9:79:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'fc181126-7c66-44d3-b731-a59036bd562f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:21Z', 'updated_at': '2021-06-03T08:33:36Z', 'revision_number': 5, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'subnets': [{'id': 'fc181126-7c66-44d3-b731-a59036bd562f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:35:15.708884 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['37525065-c740-4aee-a826-af098f4b7727'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:35:15.709645 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-06fc04cb-13f3-43d6-9aa4-02268f61a5ad admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:15.810284 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46ecc2af-5abf-4d8d-a026-e99169c10a49 req-eeadb5f3-03c6-444b-9d29-d8199a44610a tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:15.816369 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-46ecc2af-5abf-4d8d-a026-e99169c10a49 req-eeadb5f3-03c6-444b-9d29-d8199a44610a tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:15.817871 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-46ecc2af-5abf-4d8d-a026-e99169c10a49 req-eeadb5f3-03c6-444b-9d29-d8199a44610a tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "PUT /v2.0/ports/37525065-c740-4aee-a826-af098f4b7727 HTTP/1.1" status: 200  len: 981 time: 0.9453745
Jun 03 08:35:15.841402 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeadb5f3-03c6-444b-9d29-d8199a44610a tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Pushing event updated for resources: {'Port': ['ID=37525065-c740-4aee-a826-af098f4b7727,revision_number=6']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:15.846328 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-eeadb5f3-03c6-444b-9d29-d8199a44610a tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:15.866025 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f9a9aca-23de-4d43-a2d2-2596c8ba5140 req-c0f5a504-6b6f-49ce-b7bc-a1bec484e49c tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:15.867866 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5f9a9aca-23de-4d43-a2d2-2596c8ba5140 req-c0f5a504-6b6f-49ce-b7bc-a1bec484e49c tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 945 time: 0.3906488
Jun 03 08:35:15.884157 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9fa9701a-78ea-45cf-8909-663b46929671 req-0e4d14e1-bf9d-45dd-9e3a-6c5bf0ace839 service neutron] 10.222.0.55 "GET /v2.0/networks/4a053960-3cf4-4216-b7a5-291ef61e89b7?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3279133
Jun 03 08:35:15.926559 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['37525065-c740-4aee-a826-af098f4b7727'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:35:16.060724 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5f9a9aca-23de-4d43-a2d2-2596c8ba5140 req-55a397f8-d87b-4a90-8ce6-6c4494da3aff tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1794834
Jun 03 08:35:16.145588 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-f49595d5-8350-4289-a8e9-d4851cf52bf7 req-156e4f36-13ba-459d-bf1c-0c0d79816bcb tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] For port ab26d5bb-6495-4c9b-b134-6612a997f201, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=ab26d5bb-6495-4c9b-b134-6612a997f201,segment=NetworkSegment(6978222c-6678-416a-a506-1fa962d91d64),segment_id=6978222c-6678-416a-a506-1fa962d91d64)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:35:16.145973 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-f49595d5-8350-4289-a8e9-d4851cf52bf7 req-156e4f36-13ba-459d-bf1c-0c0d79816bcb tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:16.212225 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e385ebe6-93f9-43ac-b60d-551abca8f7d3 None None] New status for floating IP aa804224-baf6-4b3f-a57f-017c677d978b: ACTIVE {{(pid=92325) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 03 08:35:16.225461 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66881403-2dfb-4fa0-845d-04c5f3fac425 req-596bc0d1-d3e4-4e7e-b7f2-7c1684fdc666 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:16.228562 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-66881403-2dfb-4fa0-845d-04c5f3fac425 req-596bc0d1-d3e4-4e7e-b7f2-7c1684fdc666 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.2124503
Jun 03 08:35:16.295338 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-66881403-2dfb-4fa0-845d-04c5f3fac425 req-f7a67a1c-ffff-47bc-9625-7925dcb4cd57 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0611463
Jun 03 08:35:16.329583 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-55ab2181-d5fe-438b-b4ec-d2a757dbef7a None None] Provisioning complete for port 37525065-c740-4aee-a826-af098f4b7727 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:35:16.330083 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-55ab2181-d5fe-438b-b4ec-d2a757dbef7a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:16.377003 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-f49595d5-8350-4289-a8e9-d4851cf52bf7 req-156e4f36-13ba-459d-bf1c-0c0d79816bcb tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Calling delete_port for ab26d5bb-6495-4c9b-b134-6612a997f201 owned by compute:nova {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:35:16.507150 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9fa9701a-78ea-45cf-8909-663b46929671 req-f7fbc8a2-08e5-4313-babf-54aed0e5aa12 service neutron] 10.222.0.55 "GET /v2.0/networks/4a053960-3cf4-4216-b7a5-291ef61e89b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5724237
Jun 03 08:35:16.514616 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '529b1368-4218-45b2-ac64-62f1d985b8b2', 'tag': '37525065-c740-4aee-a826-af098f4b7727'}] {{(pid=92324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:35:16.517023 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}25ad023063ed160b339e2d2d51ef3e5c51250aece1f4db0a35843dff1b64291a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2f994ebc-664d-441f-9f49-fe78f3a5874d" -d '{"events": [{"name": "network-changed", "server_uuid": "529b1368-4218-45b2-ac64-62f1d985b8b2", "tag": "37525065-c740-4aee-a826-af098f4b7727"}]}' {{(pid=92324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:35:16.563898 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:35:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-434e09ec-3886-4227-9cd0-e2b8da622c54 x-openstack-request-id: req-434e09ec-3886-4227-9cd0-e2b8da622c54 {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:35:16.563898 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "529b1368-4218-45b2-ac64-62f1d985b8b2", "tag": "37525065-c740-4aee-a826-af098f4b7727", "status": "completed", "code": 200}]} {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:35:16.563898 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-434e09ec-3886-4227-9cd0-e2b8da622c54 {{(pid=92324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:35:16.564776 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '529b1368-4218-45b2-ac64-62f1d985b8b2', 'tag': '37525065-c740-4aee-a826-af098f4b7727', 'status': 'completed', 'code': 200}
Jun 03 08:35:16.646081 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-f49595d5-8350-4289-a8e9-d4851cf52bf7 req-156e4f36-13ba-459d-bf1c-0c0d79816bcb tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:16.666475 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-2ff9f0b8-3dd6-4eef-bfc4-bf09351c174b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:16.725480 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-156e4f36-13ba-459d-bf1c-0c0d79816bcb tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Pushing event deleted for resources: {'Port': ['ID=ab26d5bb-6495-4c9b-b134-6612a997f201,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:16.759146 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-156e4f36-13ba-459d-bf1c-0c0d79816bcb tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:16.822415 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-f49595d5-8350-4289-a8e9-d4851cf52bf7 req-156e4f36-13ba-459d-bf1c-0c0d79816bcb tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] No DVR routers for this DVR port ab26d5bb-6495-4c9b-b134-6612a997f201 on host hv-cinder-78726 {{(pid=92323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:35:16.826989 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-f49595d5-8350-4289-a8e9-d4851cf52bf7 req-156e4f36-13ba-459d-bf1c-0c0d79816bcb tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:16.829672 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7525b38b-62a4-4060-b8e8-f15c49408a7b', 'name': 'network-vif-deleted', 'tag': 'ab26d5bb-6495-4c9b-b134-6612a997f201'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:35:16.834818 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6e3169af-d274-4d7b-a59e-cdd9a8bfe074" -d '{"events": [{"server_uuid": "7525b38b-62a4-4060-b8e8-f15c49408a7b", "name": "network-vif-deleted", "tag": "ab26d5bb-6495-4c9b-b134-6612a997f201"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:35:16.842020 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f994ebc-664d-441f-9f49-fe78f3a5874d req-75c8915b-709c-463e-b0d7-d2a33ee4a8d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:16.843719 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2f994ebc-664d-441f-9f49-fe78f3a5874d req-75c8915b-709c-463e-b0d7-d2a33ee4a8d0 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=96a989a900784d61a1475d86dd209c5f&device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 1137 time: 0.2481105
Jun 03 08:35:16.903978 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:35:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6ad2c7f3-b441-4f76-89b5-c4b418de6147 x-openstack-request-id: req-6ad2c7f3-b441-4f76-89b5-c4b418de6147 {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:35:16.904486 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7525b38b-62a4-4060-b8e8-f15c49408a7b", "name": "network-vif-deleted", "tag": "ab26d5bb-6495-4c9b-b134-6612a997f201", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:35:16.904859 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-6ad2c7f3-b441-4f76-89b5-c4b418de6147 {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:35:16.905377 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7525b38b-62a4-4060-b8e8-f15c49408a7b', 'name': 'network-vif-deleted', 'tag': 'ab26d5bb-6495-4c9b-b134-6612a997f201', 'status': 'completed', 'code': 200}
Jun 03 08:35:16.969677 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f49595d5-8350-4289-a8e9-d4851cf52bf7 req-156e4f36-13ba-459d-bf1c-0c0d79816bcb tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.55 "DELETE /v2.0/ports/ab26d5bb-6495-4c9b-b134-6612a997f201 HTTP/1.1" status: 204  len: 173 time: 1.6367025
Jun 03 08:35:17.018531 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f994ebc-664d-441f-9f49-fe78f3a5874d req-d892ba43-f0df-4edb-bb7f-c0d3c0b34f59 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:17.020020 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2f994ebc-664d-441f-9f49-fe78f3a5874d req-d892ba43-f0df-4edb-bb7f-c0d3c0b34f59 service neutron] 10.222.0.55 "GET /v2.0/networks?id=113ded30-096c-4860-8773-fb717f3ea4c6 HTTP/1.1" status: 200  len: 915 time: 0.1597836
Jun 03 08:35:17.242428 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2f994ebc-664d-441f-9f49-fe78f3a5874d req-78f0edde-a458-4782-9e15-c6a689c2e0af service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=37525065-c740-4aee-a826-af098f4b7727 HTTP/1.1" status: 200  len: 999 time: 0.2103395
Jun 03 08:35:17.350178 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-86a1bfc5-ee69-4be9-9a05-1456da5f40d2 req-214ddb0b-00c7-4672-9c0c-b1aebbba78ac tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Synchronizing usage tracker for tenant:9a96090cd93b48608ead040676d45129 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:35:17.370687 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f994ebc-664d-441f-9f49-fe78f3a5874d req-69e86c5e-d22b-41be-85ca-e117fde85b4d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:17.371274 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2f994ebc-664d-441f-9f49-fe78f3a5874d req-69e86c5e-d22b-41be-85ca-e117fde85b4d service neutron] 10.222.0.55 "GET /v2.0/subnets?id=159409d9-9245-4f6d-adbe-4aa8aad78d07 HTTP/1.1" status: 200  len: 853 time: 0.1194828
Jun 03 08:35:17.445643 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-86a1bfc5-ee69-4be9-9a05-1456da5f40d2 req-214ddb0b-00c7-4672-9c0c-b1aebbba78ac tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Unset dirty status for tenant:9a96090cd93b48608ead040676d45129 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:35:17.446837 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-86a1bfc5-ee69-4be9-9a05-1456da5f40d2 req-214ddb0b-00c7-4672-9c0c-b1aebbba78ac tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=7525b38b-62a4-4060-b8e8-f15c49408a7b HTTP/1.1" status: 200  len: 210 time: 0.1571231
Jun 03 08:35:17.472928 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f994ebc-664d-441f-9f49-fe78f3a5874d req-2615a320-5abb-4af0-a791-c01a2b50b871 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:17.474484 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2f994ebc-664d-441f-9f49-fe78f3a5874d req-2615a320-5abb-4af0-a791-c01a2b50b871 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=113ded30-096c-4860-8773-fb717f3ea4c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0826974
Jun 03 08:35:17.479293 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 52134) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:17.612706 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-68604577-209c-460f-8e49-a6a94cd700d6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:17.643121 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-68604577-209c-460f-8e49-a6a94cd700d6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:35:17.649455 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-68604577-209c-460f-8e49-a6a94cd700d6 admin admin] Usage tracker for resource:security_group_rule and tenant:067b467fff8342a786cc21d32e4c117e is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:35:17.653314 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2f994ebc-664d-441f-9f49-fe78f3a5874d req-e0e3fe3c-f259-4a60-932c-5a79f89eafb0 service neutron] 10.222.0.55 "GET /v2.0/networks/113ded30-096c-4860-8773-fb717f3ea4c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1669798
Jun 03 08:35:17.656869 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-68604577-209c-460f-8e49-a6a94cd700d6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:35:17.660727 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-68604577-209c-460f-8e49-a6a94cd700d6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:35:17.702515 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['ab26d5bb-6495-4c9b-b134-6612a997f201'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:35:17.838290 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2f994ebc-664d-441f-9f49-fe78f3a5874d req-ab576b54-a57e-4c80-a9b4-a02ea57cfd2f service neutron] 10.222.0.55 "GET /v2.0/networks/113ded30-096c-4860-8773-fb717f3ea4c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1726205
Jun 03 08:35:17.877587 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-68604577-209c-460f-8e49-a6a94cd700d6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:17.949686 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-68604577-209c-460f-8e49-a6a94cd700d6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:17.959624 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-d6394f82-4163-4f2d-aa30-92cb2f974095 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:18.000199 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-68604577-209c-460f-8e49-a6a94cd700d6 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=067b467fff8342a786cc21d32e4c117e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5198722
Jun 03 08:35:18.002374 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68604577-209c-460f-8e49-a6a94cd700d6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dd5ff7e6-64ad-4458-9fe1-e4e3afc660bf,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:18.003866 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 52142) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:18.010422 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-68604577-209c-460f-8e49-a6a94cd700d6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:18.065231 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7b9f1c58-f92e-4128-adbf-3c7f993348a0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:18.095037 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7b9f1c58-f92e-4128-adbf-3c7f993348a0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:18.279411 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7b9f1c58-f92e-4128-adbf-3c7f993348a0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:18.283447 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f67e73ac-b7fe-46d4-92e7-cebf7b5107db admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:18.294749 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b9f1c58-f92e-4128-adbf-3c7f993348a0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dd5ff7e6-64ad-4458-9fe1-e4e3afc660bf,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:18.297109 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-7b9f1c58-f92e-4128-adbf-3c7f993348a0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:18.311931 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7b9f1c58-f92e-4128-adbf-3c7f993348a0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:18.316546 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-7b9f1c58-f92e-4128-adbf-3c7f993348a0 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/dd5ff7e6-64ad-4458-9fe1-e4e3afc660bf HTTP/1.1" status: 204  len: 168 time: 0.3114126
Jun 03 08:35:18.377851 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2da08a66-15e3-4442-84e2-8789ef5a1dad req-abe863e2-879b-4ff6-baa5-555ee7c338e3 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:18.381951 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2da08a66-15e3-4442-84e2-8789ef5a1dad req-abe863e2-879b-4ff6-baa5-555ee7c338e3 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.1038926
Jun 03 08:35:18.427751 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2da08a66-15e3-4442-84e2-8789ef5a1dad req-077854cc-1edd-4df7-b256-ec60ce7cd7ec tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417399
Jun 03 08:35:19.007617 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 52156) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:19.025486 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-94de04a1-566a-41c3-8191-c329408a3ea3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:19.042712 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-94de04a1-566a-41c3-8191-c329408a3ea3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:35:19.046755 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-94de04a1-566a-41c3-8191-c329408a3ea3 admin admin] Usage tracker for resource:security_group_rule and tenant:9c58a238078248b8bfb04fde03f4957e is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:35:19.049698 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-94de04a1-566a-41c3-8191-c329408a3ea3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:35:19.055370 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-94de04a1-566a-41c3-8191-c329408a3ea3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:35:19.144494 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-94de04a1-566a-41c3-8191-c329408a3ea3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:19.233494 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-94de04a1-566a-41c3-8191-c329408a3ea3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:19.242405 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:19.284119 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-94de04a1-566a-41c3-8191-c329408a3ea3 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=9c58a238078248b8bfb04fde03f4957e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2753999
Jun 03 08:35:19.285022 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94de04a1-566a-41c3-8191-c329408a3ea3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4ccbee8c-5bac-4444-841f-5fd709f6a949,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:19.286818 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 52160) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:19.287982 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-94de04a1-566a-41c3-8191-c329408a3ea3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:19.432900 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-794f35fd-c563-444c-a56b-dbee369dffff admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:19.461900 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-794f35fd-c563-444c-a56b-dbee369dffff admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:19.588097 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-794f35fd-c563-444c-a56b-dbee369dffff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:19.593012 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-4454e041-df2b-444e-a4ab-bfe9ef6e4a7a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:19.610234 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-794f35fd-c563-444c-a56b-dbee369dffff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ccbee8c-5bac-4444-841f-5fd709f6a949,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:19.613932 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-794f35fd-c563-444c-a56b-dbee369dffff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:19.614803 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-794f35fd-c563-444c-a56b-dbee369dffff admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:19.616025 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-794f35fd-c563-444c-a56b-dbee369dffff admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/4ccbee8c-5bac-4444-841f-5fd709f6a949 HTTP/1.1" status: 204  len: 168 time: 0.3282242
Jun 03 08:35:19.625858 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cacd835e-e8fe-48e6-b8a4-e055d123e06a req-5ed96ef2-5244-434d-885e-b940cb9cc171 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:19.628389 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-cacd835e-e8fe-48e6-b8a4-e055d123e06a req-5ed96ef2-5244-434d-885e-b940cb9cc171 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.0858171
Jun 03 08:35:19.677929 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-cacd835e-e8fe-48e6-b8a4-e055d123e06a req-d8b6fc02-9773-43e4-97ee-9ab6939eda10 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0434229
Jun 03 08:35:20.759386 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device ab26d5bb-6495-4c9b-b134-6612a997f201 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:35:20.798991 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] No Port match for: ab26d5bb-6495-4c9b-b134-6612a997f201 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:35:20.799347 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device ab26d5bb-6495-4c9b-b134-6612a997f201 not bound to the agent host hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:35:20.871144 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcb4700a-d0d0-4009-81d3-baadf152720f req-61ce902e-047f-4a68-8b49-20fab05a47e0 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:20.872608 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-dcb4700a-d0d0-4009-81d3-baadf152720f req-61ce902e-047f-4a68-8b49-20fab05a47e0 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.0833488
Jun 03 08:35:20.923935 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-dcb4700a-d0d0-4009-81d3-baadf152720f req-3fad4903-a4ef-4c2e-a827-838508444bf1 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0445273
Jun 03 08:35:21.862810 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 52218) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:21.989222 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-58990faf-79cd-4281-8340-493200500455 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:22.008196 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-58990faf-79cd-4281-8340-493200500455 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:35:22.012878 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-58990faf-79cd-4281-8340-493200500455 admin admin] Usage tracker for resource:security_group_rule and tenant:fb6aa13f1c2c484989c90bf83447b7cf is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:35:22.015776 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-58990faf-79cd-4281-8340-493200500455 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:35:22.022661 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-58990faf-79cd-4281-8340-493200500455 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:35:22.108532 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-58990faf-79cd-4281-8340-493200500455 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:22.122016 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-294e15bf-90f1-4db4-b8a7-eaa1d8d668fa req-31c93a48-ea5e-434a-a18b-bd75177d9667 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:22.123619 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-294e15bf-90f1-4db4-b8a7-eaa1d8d668fa req-31c93a48-ea5e-434a-a18b-bd75177d9667 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.0871799
Jun 03 08:35:22.171414 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-294e15bf-90f1-4db4-b8a7-eaa1d8d668fa req-19f6766f-d7a9-4288-bddb-5f9ee1b6e3bf tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0416355
Jun 03 08:35:22.188080 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-58990faf-79cd-4281-8340-493200500455 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:22.200182 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-7b9f1c58-f92e-4128-adbf-3c7f993348a0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:22.241386 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58990faf-79cd-4281-8340-493200500455 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ffed3d33-82f2-4d44-80cc-315090e1674d,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:22.245634 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-58990faf-79cd-4281-8340-493200500455 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=fb6aa13f1c2c484989c90bf83447b7cf&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3817422
Jun 03 08:35:22.246511 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-58990faf-79cd-4281-8340-493200500455 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:22.248251 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 52228) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:22.306785 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-82c877b8-af81-438b-ac2e-3aa5da9958e9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:22.337825 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-82c877b8-af81-438b-ac2e-3aa5da9958e9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:22.485252 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-82c877b8-af81-438b-ac2e-3aa5da9958e9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:22.489384 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-dc750f27-d0c7-4ab0-bd7a-1fc07c3d7565 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:22.501473 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82c877b8-af81-438b-ac2e-3aa5da9958e9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ffed3d33-82f2-4d44-80cc-315090e1674d,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:22.505642 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-82c877b8-af81-438b-ac2e-3aa5da9958e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:22.508978 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-82c877b8-af81-438b-ac2e-3aa5da9958e9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:22.512098 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-82c877b8-af81-438b-ac2e-3aa5da9958e9 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/ffed3d33-82f2-4d44-80cc-315090e1674d HTTP/1.1" status: 204  len: 168 time: 0.2609727
Jun 03 08:35:23.385347 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4d7d93e-bf94-463e-b76f-87881d1fed80 req-18da267b-a635-44f8-a2c6-139061a04a9d tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:23.386847 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e4d7d93e-bf94-463e-b76f-87881d1fed80 req-18da267b-a635-44f8-a2c6-139061a04a9d tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.0906708
Jun 03 08:35:23.418461 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afe93960-8d54-497f-bc7a-f183db050f89 req-ad99b65c-a178-420e-99c9-064e93babf58 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:23.419928 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-afe93960-8d54-497f-bc7a-f183db050f89 req-ad99b65c-a178-420e-99c9-064e93babf58 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.55 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 946 time: 0.0853884
Jun 03 08:35:23.434121 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e4d7d93e-bf94-463e-b76f-87881d1fed80 req-24982c8f-cac8-4b52-a078-e287bcbafb4e tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0414903
Jun 03 08:35:23.562833 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-afe93960-8d54-497f-bc7a-f183db050f89 req-f5171c2b-4c54-490a-8db5-65fc8f3b1b1f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Deleting port 63dd5c57-8935-4b18-94f8-737a7f6e3e1b {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:35:23.563245 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-afe93960-8d54-497f-bc7a-f183db050f89 req-f5171c2b-4c54-490a-8db5-65fc8f3b1b1f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:23.703352 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-afe93960-8d54-497f-bc7a-f183db050f89 req-f5171c2b-4c54-490a-8db5-65fc8f3b1b1f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] For port 63dd5c57-8935-4b18-94f8-737a7f6e3e1b, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=63dd5c57-8935-4b18-94f8-737a7f6e3e1b,segment=NetworkSegment(1b8fb38d-ade8-4355-bd2b-f2b171f31184),segment_id=1b8fb38d-ade8-4355-bd2b-f2b171f31184)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:35:23.703701 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-afe93960-8d54-497f-bc7a-f183db050f89 req-f5171c2b-4c54-490a-8db5-65fc8f3b1b1f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:23.838616 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-afe93960-8d54-497f-bc7a-f183db050f89 req-f5171c2b-4c54-490a-8db5-65fc8f3b1b1f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Calling delete_port for 63dd5c57-8935-4b18-94f8-737a7f6e3e1b owned by compute:nova {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:35:24.091004 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-afe93960-8d54-497f-bc7a-f183db050f89 req-f5171c2b-4c54-490a-8db5-65fc8f3b1b1f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:24.097767 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-73efb7c4-0383-48be-a3a5-a8a3e86f4c9a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:24.105411 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['63dd5c57-8935-4b18-94f8-737a7f6e3e1b', '716f2131-2965-4ead-984f-8ccfcadea071'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:35:24.144406 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5171c2b-4c54-490a-8db5-65fc8f3b1b1f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Pushing event deleted for resources: {'Port': ['ID=63dd5c57-8935-4b18-94f8-737a7f6e3e1b,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:24.296407 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f5171c2b-4c54-490a-8db5-65fc8f3b1b1f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.199s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:24.302751 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-afe93960-8d54-497f-bc7a-f183db050f89 req-f5171c2b-4c54-490a-8db5-65fc8f3b1b1f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] No DVR routers for this DVR port 63dd5c57-8935-4b18-94f8-737a7f6e3e1b on host hv-cinder-78726 {{(pid=92323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:35:24.305524 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-afe93960-8d54-497f-bc7a-f183db050f89 req-f5171c2b-4c54-490a-8db5-65fc8f3b1b1f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:24.308816 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7', 'name': 'network-vif-deleted', 'tag': '63dd5c57-8935-4b18-94f8-737a7f6e3e1b'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:35:24.311008 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8562db82-8bb9-4466-9c7b-c41bfcdb9822" -d '{"events": [{"server_uuid": "a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7", "name": "network-vif-deleted", "tag": "63dd5c57-8935-4b18-94f8-737a7f6e3e1b"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:35:24.369107 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:35:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6fa8abdc-258d-4835-8572-56e96fd16c62 x-openstack-request-id: req-6fa8abdc-258d-4835-8572-56e96fd16c62 {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:35:24.369530 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7", "name": "network-vif-deleted", "tag": "63dd5c57-8935-4b18-94f8-737a7f6e3e1b", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:35:24.370062 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-6fa8abdc-258d-4835-8572-56e96fd16c62 {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:35:24.370874 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7', 'name': 'network-vif-deleted', 'tag': '63dd5c57-8935-4b18-94f8-737a7f6e3e1b', 'status': 'completed', 'code': 200}
Jun 03 08:35:24.498710 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-afe93960-8d54-497f-bc7a-f183db050f89 req-f5171c2b-4c54-490a-8db5-65fc8f3b1b1f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.55 "DELETE /v2.0/ports/63dd5c57-8935-4b18-94f8-737a7f6e3e1b HTTP/1.1" status: 204  len: 173 time: 1.0710549
Jun 03 08:35:24.598453 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e78394c5-9bfc-42cf-b1c0-745b3ecf406c req-62e1ca69-764a-405c-8772-438223ed778f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 210 time: 0.0486093
Jun 03 08:35:25.777102 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-0efba89f-a3b5-4ec5-b594-a4789a79e048 req-35f1f0f7-3063-4d45-adb6-af7b0b398193 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Synchronizing usage tracker for tenant:b9cf7834ca79439981d1f8e77b89daed on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:35:25.873673 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-0efba89f-a3b5-4ec5-b594-a4789a79e048 req-35f1f0f7-3063-4d45-adb6-af7b0b398193 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Unset dirty status for tenant:b9cf7834ca79439981d1f8e77b89daed on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:35:25.875139 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0efba89f-a3b5-4ec5-b594-a4789a79e048 req-35f1f0f7-3063-4d45-adb6-af7b0b398193 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=a43ad2ef-e638-4edc-8fdb-92ff6e50e6d7 HTTP/1.1" status: 200  len: 210 time: 0.1435156
Jun 03 08:35:26.080636 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:27.586295 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c53fe0d5-024a-464b-8c4c-62dd59820283 req-3ff31ceb-7d2b-42f7-aeaa-3ad2a795847d tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:27.588008 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c53fe0d5-024a-464b-8c4c-62dd59820283 req-3ff31ceb-7d2b-42f7-aeaa-3ad2a795847d tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.0852139
Jun 03 08:35:27.632986 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c53fe0d5-024a-464b-8c4c-62dd59820283 req-f32a98a2-5e55-4e44-a7de-283ea5fe416e tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394394
Jun 03 08:35:28.841379 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 63dd5c57-8935-4b18-94f8-737a7f6e3e1b no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:35:28.849199 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3990aa2b-109d-4c3f-b2e2-0bf73072dc3d req-52d2b096-b80b-44a0-b21a-5bf6e0f409b1 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:28.851696 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3990aa2b-109d-4c3f-b2e2-0bf73072dc3d req-52d2b096-b80b-44a0-b21a-5bf6e0f409b1 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1037245
Jun 03 08:35:28.881234 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] No Port match for: 63dd5c57-8935-4b18-94f8-737a7f6e3e1b {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:35:28.881568 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 63dd5c57-8935-4b18-94f8-737a7f6e3e1b not bound to the agent host hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:35:28.905584 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3990aa2b-109d-4c3f-b2e2-0bf73072dc3d req-525e488d-f723-4623-b051-bd87147a1a3b tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0448482
Jun 03 08:35:30.112058 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54994250-93cc-4afb-96ca-7e3c753bcd73 req-e7292e76-8e49-4ab5-814c-fab6dfacaf9c tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:30.114754 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-54994250-93cc-4afb-96ca-7e3c753bcd73 req-e7292e76-8e49-4ab5-814c-fab6dfacaf9c tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.0899594
Jun 03 08:35:30.165073 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-54994250-93cc-4afb-96ca-7e3c753bcd73 req-00e03bb6-4de9-458a-b5ea-0099cd66a87d tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0445428
Jun 03 08:35:31.011217 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0e7fc1c7-8f51-4aff-8dea-664743e355ba tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:31.012577 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0e7fc1c7-8f51-4aff-8dea-664743e355ba tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/networks?id=d6b7a34f-3fa8-4a38-ab72-8c6458a51990 HTTP/1.1" status: 200  len: 814 time: 0.1564312
Jun 03 08:35:31.027885 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-9e7a189c-06e6-4719-ab80-0f447b451cad tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/quotas/9a96090cd93b48608ead040676d45129 HTTP/1.1" status: 200  len: 375 time: 0.0092256
Jun 03 08:35:31.075930 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-d57ccbe7-ba49-46ce-80e9-60f16f62ac10 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=9a96090cd93b48608ead040676d45129&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0428360
Jun 03 08:35:31.218052 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-868c407a-d54a-4962-911d-21a487944264 service neutron] 10.222.0.11 "GET /v2.0/networks/d6b7a34f-3fa8-4a38-ab72-8c6458a51990?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1346734
Jun 03 08:35:31.367032 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b532d8c7-7560-4f5b-b4e5-fd3db1942052 req-6dbbb461-868e-4ee2-a273-27e5ffa82d09 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:31.368576 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b532d8c7-7560-4f5b-b4e5-fd3db1942052 req-6dbbb461-868e-4ee2-a273-27e5ffa82d09 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.0850272
Jun 03 08:35:31.377550 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-e06baa67-626e-444c-b0ec-6e99b8a3fb62 service neutron] 10.222.0.11 "GET /v2.0/networks/d6b7a34f-3fa8-4a38-ab72-8c6458a51990?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1525505
Jun 03 08:35:31.415290 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b532d8c7-7560-4f5b-b4e5-fd3db1942052 req-8bacd52f-57e4-4f87-a727-231662b7e073 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409944
Jun 03 08:35:31.755523 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f9b4e8bf-2169-40e4-98e5-07c09c2e9fce req-a04bfa78-7160-4500-8994-378e61da1ced tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 210 time: 0.0524247
Jun 03 08:35:32.525324 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-b771e136-7110-4e09-bffb-da36008e0349 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:32.611250 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cbf71a-8e5d-40f2-9fc2-1108aba8fe2a req-fc2af9db-b60f-4d5e-b785-903fae1b0be3 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:32.612685 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-14cbf71a-8e5d-40f2-9fc2-1108aba8fe2a req-fc2af9db-b60f-4d5e-b785-903fae1b0be3 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.0888243
Jun 03 08:35:32.658857 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-14cbf71a-8e5d-40f2-9fc2-1108aba8fe2a req-73f6cd06-3276-4d33-a0cc-a1f37e9f4b30 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396256
Jun 03 08:35:32.906371 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-7704acb5-3988-4d08-a115-5c3fa45f1727 req-f4e4fd55-104e-415f-a7d1-c5b5430d05d3 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 210 time: 0.0412540
Jun 03 08:35:33.853886 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d45eb953-ca84-4fa4-8402-d2f80f750587 req-1bdf2079-bbb3-46ce-9009-2de0c7967f5f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:33.855439 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d45eb953-ca84-4fa4-8402-d2f80f750587 req-1bdf2079-bbb3-46ce-9009-2de0c7967f5f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.0834939
Jun 03 08:35:33.907524 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d45eb953-ca84-4fa4-8402-d2f80f750587 req-89829917-b9ae-4b13-9a00-20682c02b7dd tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0457914
Jun 03 08:35:34.058246 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-cec9d450-668b-478a-99d3-b6dba0508dbb req-1c33e840-baa3-44b5-aa00-d59d8bd6e06b tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 210 time: 0.0429769
Jun 03 08:35:34.890779 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:35.226666 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f20fdc8a-f01b-4ff4-abae-c91a972d8377 req-050dc9cd-3d5a-4d44-95b8-10c3c935a319 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 210 time: 0.0505774
Jun 03 08:35:35.256568 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-f32dfcc8-5be3-49d2-bc31-6f787aaa32ba None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:35.294158 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c950d2b-8f66-4fbd-a550-a9157a999d0f req-1f9a81f4-5a97-49f8-bb64-fb4070378adc tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:35.295647 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8c950d2b-8f66-4fbd-a550-a9157a999d0f req-1f9a81f4-5a97-49f8-bb64-fb4070378adc tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.2620981
Jun 03 08:35:35.343453 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8c950d2b-8f66-4fbd-a550-a9157a999d0f req-6b2a15fb-0815-4563-b411-37cd973bc829 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413036
Jun 03 08:35:36.216294 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:36.381378 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-166bf6dc-db56-421a-9131-21e3d2e015e6 req-472d356c-c8b4-4c08-9eae-e58ee99e20dd tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 210 time: 0.0459192
Jun 03 08:35:36.546220 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-875159f6-210e-4ced-b4f7-af2120ab360c req-c7b11e05-26ec-494f-9ba7-8e4d9bccdd34 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:36.547695 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-875159f6-210e-4ced-b4f7-af2120ab360c req-c7b11e05-26ec-494f-9ba7-8e4d9bccdd34 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.0835712
Jun 03 08:35:36.591765 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-875159f6-210e-4ced-b4f7-af2120ab360c req-0c9a8bf0-0c07-4813-9f64-6bcc1dd2b40a tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0378435
Jun 03 08:35:37.372519 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-4137bc78-175c-4fcb-80e0-d333008c20eb tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:37.373966 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-4137bc78-175c-4fcb-80e0-d333008c20eb tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.55 "GET /v2.0/networks?id=d6b7a34f-3fa8-4a38-ab72-8c6458a51990 HTTP/1.1" status: 200  len: 814 time: 0.1470211
Jun 03 08:35:37.391084 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-a5b2faf9-531a-4410-bb18-c115c5ec0a93 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Request body: {'port': {'device_id': 'fd73c345-63e5-4a4b-b638-d7fb6250aa36', 'network_id': 'd6b7a34f-3fa8-4a38-ab72-8c6458a51990', 'admin_state_up': True, 'tenant_id': '9a96090cd93b48608ead040676d45129'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:35:37.570933 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-a5b2faf9-531a-4410-bb18-c115c5ec0a93 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:35:37.582698 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-a5b2faf9-531a-4410-bb18-c115c5ec0a93 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:35:37.609239 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-5a7655a2-4eae-4d1c-8755-452fa2bf5152 req-e3b01f81-9097-4ee2-9163-4d5a10d77101 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 210 time: 0.1123376
Jun 03 08:35:37.757603 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-a5b2faf9-531a-4410-bb18-c115c5ec0a93 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Made reservation on behalf of 9a96090cd93b48608ead040676d45129 for: {'port': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:35:37.769872 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-a5b2faf9-531a-4410-bb18-c115c5ec0a93 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:37.846139 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32f44ea8-67d8-4106-afd7-6049855f5ed9 req-5d90ac95-9f34-4e4b-aaac-d2c42c482578 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:37.847666 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-32f44ea8-67d8-4106-afd7-6049855f5ed9 req-5d90ac95-9f34-4e4b-aaac-d2c42c482578 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1438923
Jun 03 08:35:37.897404 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-32f44ea8-67d8-4106-afd7-6049855f5ed9 req-9615dc77-0e3d-432a-9d68-ffe2225b3377 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0438590
Jun 03 08:35:38.047818 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-a5b2faf9-531a-4410-bb18-c115c5ec0a93 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Allocated IP 172.20.0.2 (d6b7a34f-3fa8-4a38-ab72-8c6458a51990/511f126c-ca8b-42fb-80d6-5f4b9a80cf7e/dd4a50f7-3420-4d92-accb-bce642d3216f) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:35:38.073530 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:38.349468 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-a5b2faf9-531a-4410-bb18-c115c5ec0a93 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:38.445320 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-a5b2faf9-531a-4410-bb18-c115c5ec0a93 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:38.451134 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-0fe7ae5e-e199-4985-ac68-13977032a0c2 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:38.515571 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-a5b2faf9-531a-4410-bb18-c115c5ec0a93 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Network d6b7a34f-3fa8-4a38-ab72-8c6458a51990 is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:35:38.519470 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-a5b2faf9-531a-4410-bb18-c115c5ec0a93 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:35:38.523483 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-a5b2faf9-531a-4410-bb18-c115c5ec0a93 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:35:38.564381 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5b2faf9-531a-4410-bb18-c115c5ec0a93 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Pushing event updated for resources: {'Port': ['ID=dd4a50f7-3420-4d92-accb-bce642d3216f,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:38.568937 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a5b2faf9-531a-4410-bb18-c115c5ec0a93 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:38.597821 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-a5b2faf9-531a-4410-bb18-c115c5ec0a93 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:38.598601 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-a5b2faf9-531a-4410-bb18-c115c5ec0a93 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:38.714028 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-a5b2faf9-531a-4410-bb18-c115c5ec0a93 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.55 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.3267653
Jun 03 08:35:38.726773 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Request body: {'port': {'device_id': 'fd73c345-63e5-4a4b-b638-d7fb6250aa36', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:35:38.838699 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1ce568b-cac7-4d1e-91ea-e4584e443f1a req-34747a58-fe6a-4f74-be6e-4212a1734793 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:38.840203 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a1ce568b-cac7-4d1e-91ea-e4584e443f1a req-34747a58-fe6a-4f74-be6e-4212a1734793 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 931 time: 0.0989633
Jun 03 08:35:38.848868 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:38.888469 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a1ce568b-cac7-4d1e-91ea-e4584e443f1a req-9e37f22b-dd5c-4677-9454-183a7763cfd2 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0410922
Jun 03 08:35:39.208505 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75c27769-6384-42be-9b3d-984d8cb465b2 req-c77dc20e-3f0b-49f9-9153-89f217ad0b64 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:39.209984 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-75c27769-6384-42be-9b3d-984d8cb465b2 req-c77dc20e-3f0b-49f9-9153-89f217ad0b64 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.1792755
Jun 03 08:35:39.300299 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id dd4a50f7-3420-4d92-accb-bce642d3216f {{(pid=92323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:35:39.311794 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:39.319902 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-75c27769-6384-42be-9b3d-984d8cb465b2 req-4694f50c-80cf-4ed1-a23b-0dc06cfb203b tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0733650
Jun 03 08:35:39.332785 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Transition to ACTIVE for port object dd4a50f7-3420-4d92-accb-bce642d3216f will not be triggered until provisioned by entity L2. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:35:39.479305 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14211294'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:39.483112 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a5b2faf9-531a-4410-bb18-c115c5ec0a93 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:39.652660 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Pushing event updated for resources: {'Port': ['ID=dd4a50f7-3420-4d92-accb-bce642d3216f,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:39.660040 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:39.740408 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Attempting to bind port dd4a50f7-3420-4d92-accb-bce642d3216f on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:35:39.740408 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Attempting to bind port dd4a50f7-3420-4d92-accb-bce642d3216f by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '6978222c-6678-416a-a506-1fa962d91d64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 523, 'network_id': 'd6b7a34f-3fa8-4a38-ab72-8c6458a51990'}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:35:39.740408 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Attempting to bind port dd4a50f7-3420-4d92-accb-bce642d3216f on network d6b7a34f-3fa8-4a38-ab72-8c6458a51990 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:35:39.746931 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Port dd4a50f7-3420-4d92-accb-bce642d3216f on network d6b7a34f-3fa8-4a38-ab72-8c6458a51990 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 03 08:35:39.747298 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Attempting to bind port dd4a50f7-3420-4d92-accb-bce642d3216f on network d6b7a34f-3fa8-4a38-ab72-8c6458a51990 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:35:39.755273 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Checking agent: {'id': '181c5753-100b-4f03-bda8-e34279b057f4', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'started_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 35, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:35:39.755703 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Checking segment: {'id': '6978222c-6678-416a-a506-1fa962d91d64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 523, 'network_id': 'd6b7a34f-3fa8-4a38-ab72-8c6458a51990'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:35:39.756198 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Bound using segment: {'id': '6978222c-6678-416a-a506-1fa962d91d64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 523, 'network_id': 'd6b7a34f-3fa8-4a38-ab72-8c6458a51990'} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:35:39.756684 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Bound port: dd4a50f7-3420-4d92-accb-bce642d3216f, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6978222c-6678-416a-a506-1fa962d91d64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 523, 'network_id': 'd6b7a34f-3fa8-4a38-ab72-8c6458a51990'}}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:35:39.757121 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:39.874899 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] For port dd4a50f7-3420-4d92-accb-bce642d3216f, host hv-cinder-78726, cleared binding levels {{(pid=92323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:35:39.874899 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] For port dd4a50f7-3420-4d92-accb-bce642d3216f, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=dd4a50f7-3420-4d92-accb-bce642d3216f,segment=NetworkSegment(6978222c-6678-416a-a506-1fa962d91d64),segment_id=6978222c-6678-416a-a506-1fa962d91d64)] {{(pid=92323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:35:40.045854 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cdb7c6-16b6-4b16-bad4-bb13cc627f4d req-74f504a4-f8e7-4ff0-9f32-210c2d128ec3 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:40.047524 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c5cdb7c6-16b6-4b16-bad4-bb13cc627f4d req-74f504a4-f8e7-4ff0-9f32-210c2d128ec3 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.55 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.0871525
Jun 03 08:35:40.098242 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a672ac2-bae5-49ba-a3a5-ffa09fd1b01c req-bf8a7975-e169-473c-9045-f89ac0d96372 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:40.099773 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-1a672ac2-bae5-49ba-a3a5-ffa09fd1b01c req-bf8a7975-e169-473c-9045-f89ac0d96372 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 943 time: 0.0906210
Jun 03 08:35:40.152075 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-1a672ac2-bae5-49ba-a3a5-ffa09fd1b01c req-9346fae7-8560-4b47-a378-9dad2eb94dd2 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0465517
Jun 03 08:35:40.175303 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14211294'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:40.177807 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-0f7e2206-c119-4f1f-a429-494f64e32c3c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:40.249576 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:40.250104 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:40.251625 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] 10.222.0.55 "PUT /v2.0/ports/dd4a50f7-3420-4d92-accb-bce642d3216f HTTP/1.1" status: 200  len: 1093 time: 1.5291679
Jun 03 08:35:40.254374 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fd73c345-63e5-4a4b-b638-d7fb6250aa36', 'tag': 'dd4a50f7-3420-4d92-accb-bce642d3216f'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:35:40.256776 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fe71b7b3-ac76-4296-806b-27c8e7fd8016" -d '{"events": [{"name": "network-changed", "server_uuid": "fd73c345-63e5-4a4b-b638-d7fb6250aa36", "tag": "dd4a50f7-3420-4d92-accb-bce642d3216f"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:35:40.281246 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Pushing event updated for resources: {'Port': ['ID=dd4a50f7-3420-4d92-accb-bce642d3216f,revision_number=3']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:40.285728 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:40.287229 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-c5cdb7c6-16b6-4b16-bad4-bb13cc627f4d req-0e5919bf-af98-4c5f-97f6-2ac6f7e2d0f6 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Deleting port 716f2131-2965-4ead-984f-8ccfcadea071 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:35:40.287567 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-c5cdb7c6-16b6-4b16-bad4-bb13cc627f4d req-0e5919bf-af98-4c5f-97f6-2ac6f7e2d0f6 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:40.305584 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:35:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a0aca57f-72dd-410f-a0a2-7268bc300b1e x-openstack-request-id: req-a0aca57f-72dd-410f-a0a2-7268bc300b1e {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:35:40.305899 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fd73c345-63e5-4a4b-b638-d7fb6250aa36", "tag": "dd4a50f7-3420-4d92-accb-bce642d3216f", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:35:40.306176 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-a0aca57f-72dd-410f-a0a2-7268bc300b1e {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:35:40.306609 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fd73c345-63e5-4a4b-b638-d7fb6250aa36', 'tag': 'dd4a50f7-3420-4d92-accb-bce642d3216f', 'status': 'completed', 'code': 200}
Jun 03 08:35:40.518370 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e72946c6-911a-4efd-a9c1-ca941197d292 req-44586748-6f8b-482e-9523-b82b4685c258 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:40.519915 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e72946c6-911a-4efd-a9c1-ca941197d292 req-44586748-6f8b-482e-9523-b82b4685c258 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 946 time: 0.0858631
Jun 03 08:35:40.570098 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e72946c6-911a-4efd-a9c1-ca941197d292 req-d3ade405-5c56-4b9a-9d0e-6bc14746d8ac tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/security-groups?id=b20b0dee-1798-4811-81d5-712ca54f9835&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0444064
Jun 03 08:35:40.571830 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-c5cdb7c6-16b6-4b16-bad4-bb13cc627f4d req-0e5919bf-af98-4c5f-97f6-2ac6f7e2d0f6 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] For port 716f2131-2965-4ead-984f-8ccfcadea071, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=716f2131-2965-4ead-984f-8ccfcadea071,segment=NetworkSegment(1b8fb38d-ade8-4355-bd2b-f2b171f31184),segment_id=1b8fb38d-ade8-4355-bd2b-f2b171f31184)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:35:40.572204 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-c5cdb7c6-16b6-4b16-bad4-bb13cc627f4d req-0e5919bf-af98-4c5f-97f6-2ac6f7e2d0f6 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:40.639888 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe71b7b3-ac76-4296-806b-27c8e7fd8016 req-90953357-c4a4-41a6-8469-37f8fdc7dff4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:40.641013 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fe71b7b3-ac76-4296-806b-27c8e7fd8016 req-90953357-c4a4-41a6-8469-37f8fdc7dff4 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=9a96090cd93b48608ead040676d45129&device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 1096 time: 0.3088503
Jun 03 08:35:40.725009 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-c5cdb7c6-16b6-4b16-bad4-bb13cc627f4d req-0e5919bf-af98-4c5f-97f6-2ac6f7e2d0f6 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Calling delete_port for 716f2131-2965-4ead-984f-8ccfcadea071 owned by compute:nova {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:35:40.873614 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe71b7b3-ac76-4296-806b-27c8e7fd8016 req-12f17dfc-5a0c-4082-a2c3-9f78944a50b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:40.875101 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fe71b7b3-ac76-4296-806b-27c8e7fd8016 req-12f17dfc-5a0c-4082-a2c3-9f78944a50b1 service neutron] 10.222.0.55 "GET /v2.0/networks?tenant_id=9a96090cd93b48608ead040676d45129&shared=False HTTP/1.1" status: 200  len: 915 time: 0.1783597
Jun 03 08:35:41.074611 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe71b7b3-ac76-4296-806b-27c8e7fd8016 req-361d5429-01a9-45b3-bac9-93ec00c0f5e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:41.074611 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fe71b7b3-ac76-4296-806b-27c8e7fd8016 req-361d5429-01a9-45b3-bac9-93ec00c0f5e0 service neutron] 10.222.0.55 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1549778
Jun 03 08:35:41.184544 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-c5cdb7c6-16b6-4b16-bad4-bb13cc627f4d req-0e5919bf-af98-4c5f-97f6-2ac6f7e2d0f6 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:41.191329 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-487b13d3-7d2d-4bbd-bbc7-38e1b8289af0 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:41.197754 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['716f2131-2965-4ead-984f-8ccfcadea071'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:35:41.241403 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-e8ea4e9b-d609-4dd1-977d-8917085daace service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:41.242960 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-e8ea4e9b-d609-4dd1-977d-8917085daace service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=9a96090cd93b48608ead040676d45129&device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 1096 time: 0.1259367
Jun 03 08:35:41.252631 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e5919bf-af98-4c5f-97f6-2ac6f7e2d0f6 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Pushing event deleted for resources: {'Port': ['ID=716f2131-2965-4ead-984f-8ccfcadea071,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:41.255858 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-0e5919bf-af98-4c5f-97f6-2ac6f7e2d0f6 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:41.424696 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-b12a8516-29e7-47a6-adfa-0f47b0221c07 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=dd4a50f7-3420-4d92-accb-bce642d3216f HTTP/1.1" status: 200  len: 217 time: 0.1677983
Jun 03 08:35:41.434405 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-c5cdb7c6-16b6-4b16-bad4-bb13cc627f4d req-0e5919bf-af98-4c5f-97f6-2ac6f7e2d0f6 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] No DVR routers for this DVR port 716f2131-2965-4ead-984f-8ccfcadea071 on host hv-cinder-78726 {{(pid=92323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:35:41.439152 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-c5cdb7c6-16b6-4b16-bad4-bb13cc627f4d req-0e5919bf-af98-4c5f-97f6-2ac6f7e2d0f6 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:41.527840 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-86ed8dd9-f407-42f1-85be-97cf071ac29a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:41.529307 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-86ed8dd9-f407-42f1-85be-97cf071ac29a service neutron] 10.222.0.55 "GET /v2.0/subnets?id=511f126c-ca8b-42fb-80d6-5f4b9a80cf7e HTTP/1.1" status: 200  len: 854 time: 0.0852127
Jun 03 08:35:41.544331 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-287cb920-5402-43bb-a256-e9896a089483 req-b3349a17-d885-4de9-8aa4-baeb72730137 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:41.545673 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-287cb920-5402-43bb-a256-e9896a089483 req-b3349a17-d885-4de9-8aa4-baeb72730137 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Synchronizing usage tracker for tenant:9a96090cd93b48608ead040676d45129 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:35:41.597775 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-6158341c-e367-4b5c-a67e-5cd7eb744389 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=d6b7a34f-3fa8-4a38-ab72-8c6458a51990&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0496967
Jun 03 08:35:41.636016 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c5cdb7c6-16b6-4b16-bad4-bb13cc627f4d req-0e5919bf-af98-4c5f-97f6-2ac6f7e2d0f6 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.55 "DELETE /v2.0/ports/716f2131-2965-4ead-984f-8ccfcadea071 HTTP/1.1" status: 204  len: 173 time: 1.5828683
Jun 03 08:35:41.732384 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-287cb920-5402-43bb-a256-e9896a089483 req-b3349a17-d885-4de9-8aa4-baeb72730137 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Unset dirty status for tenant:9a96090cd93b48608ead040676d45129 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:35:41.733718 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-287cb920-5402-43bb-a256-e9896a089483 req-b3349a17-d885-4de9-8aa4-baeb72730137 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 943 time: 0.3930295
Jun 03 08:35:41.802742 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-68bf0442-d747-495b-95cf-b02c413b39b0 req-49c6667d-83ff-4e15-84bc-7b5646765f0e tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 210 time: 0.0916266
Jun 03 08:35:41.851295 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-056f8b8f-781b-4228-9af9-4f7202439221 service neutron] 10.222.0.55 "GET /v2.0/networks/d6b7a34f-3fa8-4a38-ab72-8c6458a51990?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2448046
Jun 03 08:35:41.854370 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-287cb920-5402-43bb-a256-e9896a089483 req-1078c41c-05bd-4426-ac5e-e2ef7f95afaf tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1040740
Jun 03 08:35:42.007242 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d14563a6-00c7-4b00-8a65-d26c8db15a82 req-7df84f57-8afe-42ff-ad0a-805ca92235e1 service neutron] 10.222.0.55 "GET /v2.0/networks/d6b7a34f-3fa8-4a38-ab72-8c6458a51990?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1451821
Jun 03 08:35:42.310161 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fdc4e210-a267-4553-8e0c-701eb8001997', 'name': 'network-vif-deleted', 'tag': '716f2131-2965-4ead-984f-8ccfcadea071'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:35:42.312931 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-25d62239-53ea-49a6-b9af-19d141598915" -d '{"events": [{"server_uuid": "fdc4e210-a267-4553-8e0c-701eb8001997", "name": "network-vif-deleted", "tag": "716f2131-2965-4ead-984f-8ccfcadea071"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:35:42.360612 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:35:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ba5468d2-9934-4e01-a661-7504eb2caf3f x-openstack-request-id: req-ba5468d2-9934-4e01-a661-7504eb2caf3f {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:35:42.360612 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fdc4e210-a267-4553-8e0c-701eb8001997", "name": "network-vif-deleted", "tag": "716f2131-2965-4ead-984f-8ccfcadea071", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:35:42.360612 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-ba5468d2-9934-4e01-a661-7504eb2caf3f {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:35:42.360612 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fdc4e210-a267-4553-8e0c-701eb8001997', 'name': 'network-vif-deleted', 'tag': '716f2131-2965-4ead-984f-8ccfcadea071', 'status': 'completed', 'code': 200}
Jun 03 08:35:42.990903 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-2d5ad8ca-8ea3-46eb-b529-b597a06fae5f req-60875a44-aff6-4a93-b0e0-d92f512fefbc tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Synchronizing usage tracker for tenant:b9cf7834ca79439981d1f8e77b89daed on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:35:43.073653 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-2d5ad8ca-8ea3-46eb-b529-b597a06fae5f req-60875a44-aff6-4a93-b0e0-d92f512fefbc tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Unset dirty status for tenant:b9cf7834ca79439981d1f8e77b89daed on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:35:43.075321 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5e2412a-d313-48f7-bf75-3e446326182a req-2390aa4d-0490-4b8d-9e04-5e16c971b873 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:43.075816 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2d5ad8ca-8ea3-46eb-b529-b597a06fae5f req-60875a44-aff6-4a93-b0e0-d92f512fefbc tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] 10.222.0.11 "GET /v2.0/ports?device_id=fdc4e210-a267-4553-8e0c-701eb8001997 HTTP/1.1" status: 200  len: 210 time: 0.1344366
Jun 03 08:35:43.080626 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f5e2412a-d313-48f7-bf75-3e446326182a req-2390aa4d-0490-4b8d-9e04-5e16c971b873 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 943 time: 0.1043398
Jun 03 08:35:43.129252 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f5e2412a-d313-48f7-bf75-3e446326182a req-95c6e816-e0c0-40a6-8a34-b7654bfdecdb tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0456457
Jun 03 08:35:44.203447 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 52572) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:44.260935 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 52574) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:44.329934 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:35:44.409676 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-33986fe6-f822-4838-94cc-4fc3b9de6add admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:44.426253 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-33986fe6-f822-4838-94cc-4fc3b9de6add admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:35:44.430253 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-33986fe6-f822-4838-94cc-4fc3b9de6add admin admin] Usage tracker for resource:security_group_rule and tenant:b5dda1a85719427bb094e4e0d0ab4daa is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:35:44.433945 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-33986fe6-f822-4838-94cc-4fc3b9de6add admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:35:44.440293 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-33986fe6-f822-4838-94cc-4fc3b9de6add admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:35:44.535816 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-33986fe6-f822-4838-94cc-4fc3b9de6add admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:44.631884 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25d2e0fb-8363-4356-a3c4-813ce5bdc52f req-57862ebe-0ff5-4578-a4f7-b85e2543be34 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:44.633345 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-25d2e0fb-8363-4356-a3c4-813ce5bdc52f req-57862ebe-0ff5-4578-a4f7-b85e2543be34 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 943 time: 0.3362033
Jun 03 08:35:44.661786 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-33986fe6-f822-4838-94cc-4fc3b9de6add admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:44.670825 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-94de04a1-566a-41c3-8191-c329408a3ea3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:44.714976 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-33986fe6-f822-4838-94cc-4fc3b9de6add admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=b5dda1a85719427bb094e4e0d0ab4daa&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4529524
Jun 03 08:35:44.716574 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33986fe6-f822-4838-94cc-4fc3b9de6add admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c0d5d3b4-45b2-4f5a-a7b0-1f27ed65b318,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:44.718596 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 52580) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:44.720346 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-33986fe6-f822-4838-94cc-4fc3b9de6add admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:44.788762 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-25d2e0fb-8363-4356-a3c4-813ce5bdc52f req-bb91c08a-d839-4370-b66a-2730af6edc4a tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1494443
Jun 03 08:35:44.900356 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-6f464e8e-fe6a-4229-a466-81b6a80a146a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:44.991538 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-6f464e8e-fe6a-4229-a466-81b6a80a146a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:45.162176 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-86606e33-3641-4406-b3f9-a3a0c5e5a148 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-16328733'] for router_interface, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:45.217733 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-6f464e8e-fe6a-4229-a466-81b6a80a146a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:45.233129 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-2cf70a1f-1b84-446e-b47d-f5f9b3d5efda admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:45.261713 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f464e8e-fe6a-4229-a466-81b6a80a146a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c0d5d3b4-45b2-4f5a-a7b0-1f27ed65b318,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:45.264121 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-6f464e8e-fe6a-4229-a466-81b6a80a146a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:45.324038 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-6f464e8e-fe6a-4229-a466-81b6a80a146a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:45.325917 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-6f464e8e-fe6a-4229-a466-81b6a80a146a admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/c0d5d3b4-45b2-4f5a-a7b0-1f27ed65b318 HTTP/1.1" status: 204  len: 168 time: 0.6057155
Jun 03 08:35:45.613526 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-86606e33-3641-4406-b3f9-a3a0c5e5a148 admin admin] Deleting port 4bcbfa9c-b0be-4036-a7ea-53eec8e82b52 {{(pid=92324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:35:45.613999 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-86606e33-3641-4406-b3f9-a3a0c5e5a148 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:45.742248 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.db [None req-86606e33-3641-4406-b3f9-a3a0c5e5a148 admin admin] For port 4bcbfa9c-b0be-4036-a7ea-53eec8e82b52, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=4bcbfa9c-b0be-4036-a7ea-53eec8e82b52,segment=NetworkSegment(1b8fb38d-ade8-4355-bd2b-f2b171f31184),segment_id=1b8fb38d-ade8-4355-bd2b-f2b171f31184)] {{(pid=92324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:35:45.742663 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-86606e33-3641-4406-b3f9-a3a0c5e5a148 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:45.870760 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-86606e33-3641-4406-b3f9-a3a0c5e5a148 admin admin] Calling delete_port for 4bcbfa9c-b0be-4036-a7ea-53eec8e82b52 owned by network:router_interface {{(pid=92324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:35:46.056617 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 716f2131-2965-4ead-984f-8ccfcadea071 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:35:46.076046 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 52590) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:46.095210 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] No Port match for: 716f2131-2965-4ead-984f-8ccfcadea071 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:35:46.095955 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 716f2131-2965-4ead-984f-8ccfcadea071 not bound to the agent host hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:35:46.125322 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f0d95c06-a21e-4476-86d8-870e09d42ec3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:46.165111 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-f0d95c06-a21e-4476-86d8-870e09d42ec3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:35:46.174934 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-f0d95c06-a21e-4476-86d8-870e09d42ec3 admin admin] Usage tracker for resource:security_group_rule and tenant:28eb319529fa468e8d7ee655ad7f71fa is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:35:46.181016 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-f0d95c06-a21e-4476-86d8-870e09d42ec3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:35:46.194222 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-f0d95c06-a21e-4476-86d8-870e09d42ec3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:35:46.253519 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aceb1eb9-cbb9-4926-b741-ef3eaf0d2aa9 req-dd4bc0fc-42fe-4de9-bc41-cbab12d3c770 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:46.258411 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-aceb1eb9-cbb9-4926-b741-ef3eaf0d2aa9 req-dd4bc0fc-42fe-4de9-bc41-cbab12d3c770 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 943 time: 0.3599782
Jun 03 08:35:46.362614 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-aceb1eb9-cbb9-4926-b741-ef3eaf0d2aa9 req-80c80de9-a75e-4721-8e52-2009491f63a7 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0926712
Jun 03 08:35:46.410052 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f0d95c06-a21e-4476-86d8-870e09d42ec3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:46.502615 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f0d95c06-a21e-4476-86d8-870e09d42ec3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:46.509377 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-68604577-209c-460f-8e49-a6a94cd700d6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:46.547428 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-86606e33-3641-4406-b3f9-a3a0c5e5a148 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:46.550154 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0d95c06-a21e-4476-86d8-870e09d42ec3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=69b317ff-2ac0-405a-8320-a24518d82222,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:46.554559 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:46.558173 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-f0d95c06-a21e-4476-86d8-870e09d42ec3 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=28eb319529fa468e8d7ee655ad7f71fa&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4710479
Jun 03 08:35:46.558294 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f0d95c06-a21e-4476-86d8-870e09d42ec3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:46.558897 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 52594) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:46.608397 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86606e33-3641-4406-b3f9-a3a0c5e5a148 admin admin] Pushing event deleted for resources: {'Port': ['ID=4bcbfa9c-b0be-4036-a7ea-53eec8e82b52,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:46.613057 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-86606e33-3641-4406-b3f9-a3a0c5e5a148 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:46.619424 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7c6a4d04-f80b-4af9-b3a0-e4f875a762bf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:46.660854 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7c6a4d04-f80b-4af9-b3a0-e4f875a762bf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:46.914173 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-86606e33-3641-4406-b3f9-a3a0c5e5a148 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-16344783', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-16328833'] for router_interface, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:46.965072 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7c6a4d04-f80b-4af9-b3a0-e4f875a762bf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:46.968994 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-17caceba-6077-4742-a561-8c6c36b98e77 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:46.985267 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6a4d04-f80b-4af9-b3a0-e4f875a762bf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=69b317ff-2ac0-405a-8320-a24518d82222,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:46.988426 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-7c6a4d04-f80b-4af9-b3a0-e4f875a762bf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:46.995755 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7c6a4d04-f80b-4af9-b3a0-e4f875a762bf admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:46.996890 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-7c6a4d04-f80b-4af9-b3a0-e4f875a762bf admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/69b317ff-2ac0-405a-8320-a24518d82222 HTTP/1.1" status: 204  len: 168 time: 0.4370680
Jun 03 08:35:47.302315 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-86606e33-3641-4406-b3f9-a3a0c5e5a148 admin admin] Router 195a7c09-ac04-4351-bdeb-7bc97d7d574d has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:35:47.556605 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-86606e33-3641-4406-b3f9-a3a0c5e5a148 admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:35:47.567125 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02e7e726-86a4-43aa-829e-10e0f4c102eb None None] Sync routers for ids ['195a7c09-ac04-4351-bdeb-7bc97d7d574d'] in dv-cinder-787262-5-iscsi {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:35:47.577126 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02e7e726-86a4-43aa-829e-10e0f4c102eb None None] Routers {'195a7c09-ac04-4351-bdeb-7bc97d7d574d'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:35:47.578016 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-02e7e726-86a4-43aa-829e-10e0f4c102eb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86b36d90>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:35:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['195a7c09-ac04-4351-bdeb-7bc97d7d574d'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:35:47.602293 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49f51422-e9aa-4418-880a-6b44e3bb6038 req-ecb104fd-e22e-4ee3-af44-9e46d314bd62 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:47.603852 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-49f51422-e9aa-4418-880a-6b44e3bb6038 req-ecb104fd-e22e-4ee3-af44-9e46d314bd62 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 943 time: 0.1109185
Jun 03 08:35:47.651460 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-49f51422-e9aa-4418-880a-6b44e3bb6038 req-7024a898-fa5c-496c-9531-4ae28d444c40 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0416176
Jun 03 08:35:47.682106 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-86606e33-3641-4406-b3f9-a3a0c5e5a148 admin admin] 10.222.0.11 "PUT /v2.0/routers/195a7c09-ac04-4351-bdeb-7bc97d7d574d/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 3.4765065
Jun 03 08:35:47.684529 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 52604) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:47.762424 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-02e7e726-86a4-43aa-829e-10e0f4c102eb None None] Set router 195a7c09-ac04-4351-bdeb-7bc97d7d574d gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:35:47.817391 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 52606) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:47.834800 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b34434b0-4818-488b-89dd-96178baa7262 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:47.854837 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-b34434b0-4818-488b-89dd-96178baa7262 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:35:47.855004 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-b34434b0-4818-488b-89dd-96178baa7262 admin admin] Usage tracker for resource:security_group_rule and tenant:1e013c0b5a0b44b4af961fbbd3f7454d is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:35:47.857773 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-b34434b0-4818-488b-89dd-96178baa7262 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:35:47.865035 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-b34434b0-4818-488b-89dd-96178baa7262 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:35:47.867474 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5d547bef-0730-44ae-be07-b8bd25acdcfa admin admin] Notify callbacks [] for router, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:47.962098 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b34434b0-4818-488b-89dd-96178baa7262 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:48.086257 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b34434b0-4818-488b-89dd-96178baa7262 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:48.086784 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device dd4a50f7-3420-4d92-accb-bce642d3216f details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:35:48.105226 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-02e7e726-86a4-43aa-829e-10e0f4c102eb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86b36d90>, [{'id': '195a7c09-ac04-4351-bdeb-7bc97d7d574d', 'name': 'tempest-ServerRescueNegativeTestJSON-1863482925-router', 'tenant_id': 'b9cf7834ca79439981d1f8e77b89daed', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.52'}], 'enable_snat': True}, 'gw_port_id': 'e13a1db6-df45-45c7-a102-bed3e3054729', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:02Z', 'updated_at': '2021-06-03T08:35:46Z', 'revision_number': 5, 'project_id': 'b9cf7834ca79439981d1f8e77b89daed', 'gw_port': {'id': 'e13a1db6-df45-45c7-a102-bed3e3054729', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:11:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '195a7c09-ac04-4351-bdeb-7bc97d7d574d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 234, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:03Z', 'updated_at': '2021-06-03T08:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:35:48.119248 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02e7e726-86a4-43aa-829e-10e0f4c102eb None None] Checking router: 195a7c09-ac04-4351-bdeb-7bc97d7d574d for host: dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:35:48.125460 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-66932741-575c-4319-b18c-d0d076f1feec admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:48.137747 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02e7e726-86a4-43aa-829e-10e0f4c102eb None None] Routers {'195a7c09-ac04-4351-bdeb-7bc97d7d574d'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:35:48.138566 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-02e7e726-86a4-43aa-829e-10e0f4c102eb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86b36d90>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:35:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['195a7c09-ac04-4351-bdeb-7bc97d7d574d'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:35:48.143795 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-b34434b0-4818-488b-89dd-96178baa7262 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=1e013c0b5a0b44b4af961fbbd3f7454d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3251762
Jun 03 08:35:48.146535 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 52610) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:48.159275 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b34434b0-4818-488b-89dd-96178baa7262 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=291d6d4c-7da9-4460-a5d5-c3c3bc8b61a2,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:48.181079 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b34434b0-4818-488b-89dd-96178baa7262 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:48.214127 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5d547bef-0730-44ae-be07-b8bd25acdcfa admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:48.247208 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cbceaf61-51f2-4d2b-a350-2f9ed4278dde admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:48.281496 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port dd4a50f7-3420-4d92-accb-bce642d3216f, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=dd4a50f7-3420-4d92-accb-bce642d3216f,segment=NetworkSegment(6978222c-6678-416a-a506-1fa962d91d64),segment_id=6978222c-6678-416a-a506-1fa962d91d64)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:35:48.290615 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cbceaf61-51f2-4d2b-a350-2f9ed4278dde admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:48.305459 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': 'dd4a50f7-3420-4d92-accb-bce642d3216f', 'network_id': 'd6b7a34f-3fa8-4a38-ab72-8c6458a51990', 'port_id': 'dd4a50f7-3420-4d92-accb-bce642d3216f', 'mac_address': 'fa:16:3e:39:b0:3b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 523, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '511f126c-ca8b-42fb-80d6-5f4b9a80cf7e', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:35:48.366945 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:48.370022 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-02e7e726-86a4-43aa-829e-10e0f4c102eb None None] Set router 195a7c09-ac04-4351-bdeb-7bc97d7d574d gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:35:48.386973 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id dd4a50f7-3420-4d92-accb-bce642d3216f {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:35:48.404215 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port dd4a50f7-3420-4d92-accb-bce642d3216f, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=dd4a50f7-3420-4d92-accb-bce642d3216f,segment=NetworkSegment(6978222c-6678-416a-a506-1fa962d91d64),segment_id=6978222c-6678-416a-a506-1fa962d91d64)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:35:48.433771 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-5d547bef-0730-44ae-be07-b8bd25acdcfa admin admin] Deleting port e13a1db6-df45-45c7-a102-bed3e3054729 {{(pid=92324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:35:48.434214 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5d547bef-0730-44ae-be07-b8bd25acdcfa admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:48.508121 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:48.510443 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:48.527314 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cbceaf61-51f2-4d2b-a350-2f9ed4278dde admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:48.534422 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e5cf0feb-cf52-4989-a948-379444a2eef1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:48.555417 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbceaf61-51f2-4d2b-a350-2f9ed4278dde admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=291d6d4c-7da9-4460-a5d5-c3c3bc8b61a2,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:48.569141 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-cbceaf61-51f2-4d2b-a350-2f9ed4278dde admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:48.577582 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cbceaf61-51f2-4d2b-a350-2f9ed4278dde admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:48.598348 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-cbceaf61-51f2-4d2b-a350-2f9ed4278dde admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/291d6d4c-7da9-4460-a5d5-c3c3bc8b61a2 HTTP/1.1" status: 204  len: 168 time: 0.4313760
Jun 03 08:35:48.613317 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=dd4a50f7-3420-4d92-accb-bce642d3216f,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:48.623754 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.db [None req-5d547bef-0730-44ae-be07-b8bd25acdcfa admin admin] For port e13a1db6-df45-45c7-a102-bed3e3054729, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=e13a1db6-df45-45c7-a102-bed3e3054729,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:35:48.624184 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5d547bef-0730-44ae-be07-b8bd25acdcfa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:48.638089 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:48.639117 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:48.640178 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:48.641042 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:48.641614 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:48.642353 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:48.644766 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:48.645399 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:48.647307 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:48.647808 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:48.648805 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:48.651350 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:48.659354 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:48.756572 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-02e7e726-86a4-43aa-829e-10e0f4c102eb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86b36d90>, [{'id': '195a7c09-ac04-4351-bdeb-7bc97d7d574d', 'name': 'tempest-ServerRescueNegativeTestJSON-1863482925-router', 'tenant_id': 'b9cf7834ca79439981d1f8e77b89daed', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.52'}], 'enable_snat': True}, 'gw_port_id': 'e13a1db6-df45-45c7-a102-bed3e3054729', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:02Z', 'updated_at': '2021-06-03T08:35:46Z', 'revision_number': 5, 'project_id': 'b9cf7834ca79439981d1f8e77b89daed', 'gw_port': {'id': 'e13a1db6-df45-45c7-a102-bed3e3054729', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:11:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '195a7c09-ac04-4351-bdeb-7bc97d7d574d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 234, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:03Z', 'updated_at': '2021-06-03T08:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:35:48.765191 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02e7e726-86a4-43aa-829e-10e0f4c102eb None None] The sync data for ids ['195a7c09-ac04-4351-bdeb-7bc97d7d574d'] in dv-cinder-787262-5-iscsi is: [{'id': '195a7c09-ac04-4351-bdeb-7bc97d7d574d', 'name': 'tempest-ServerRescueNegativeTestJSON-1863482925-router', 'tenant_id': 'b9cf7834ca79439981d1f8e77b89daed', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.52'}], 'enable_snat': True}, 'gw_port_id': 'e13a1db6-df45-45c7-a102-bed3e3054729', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:02Z', 'updated_at': '2021-06-03T08:35:46Z', 'revision_number': 5, 'project_id': 'b9cf7834ca79439981d1f8e77b89daed', 'gw_port': {'id': 'e13a1db6-df45-45c7-a102-bed3e3054729', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:bf:11:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '195a7c09-ac04-4351-bdeb-7bc97d7d574d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 234, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:03Z', 'updated_at': '2021-06-03T08:32:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}] {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:35:48.835417 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['dd4a50f7-3420-4d92-accb-bce642d3216f'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:35:48.868969 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-5d547bef-0730-44ae-be07-b8bd25acdcfa admin admin] Calling delete_port for e13a1db6-df45-45c7-a102-bed3e3054729 owned by network:router_gateway {{(pid=92324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:35:48.994694 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea65688f-e5d4-42f4-ba83-92c73e2f6177 req-7af59a07-a3de-44a1-84a9-adc68eabe73f tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:48.996213 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ea65688f-e5d4-42f4-ba83-92c73e2f6177 req-7af59a07-a3de-44a1-84a9-adc68eabe73f tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.1128006
Jun 03 08:35:49.008375 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-744f8b09-c2f9-4302-86c8-018b731904d2 req-9c0fda19-6a90-4195-ac0f-28d4458716fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:49.009970 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-744f8b09-c2f9-4302-86c8-018b731904d2 req-9c0fda19-6a90-4195-ac0f-28d4458716fc service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=96a989a900784d61a1475d86dd209c5f&device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 1137 time: 0.1671877
Jun 03 08:35:49.053739 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63c97d34-c235-4d67-9be2-c73910d0d781 req-f5e50fdd-f981-4944-94e5-9a802924ef7c tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:49.061133 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-63c97d34-c235-4d67-9be2-c73910d0d781 req-f5e50fdd-f981-4944-94e5-9a802924ef7c tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 944 time: 0.1603084
Jun 03 08:35:49.063339 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ea65688f-e5d4-42f4-ba83-92c73e2f6177 req-09129099-2fcc-4c4f-b97d-1d4ba76d471d tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0566607
Jun 03 08:35:49.187537 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-63c97d34-c235-4d67-9be2-c73910d0d781 req-5297acf5-38a0-4c74-a320-9b11ecc033f9 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1254919
Jun 03 08:35:49.204840 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5d547bef-0730-44ae-be07-b8bd25acdcfa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:49.209022 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:49.231027 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-744f8b09-c2f9-4302-86c8-018b731904d2 req-4c50af54-1d2d-43a0-8239-9cfe4121e72c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:49.232913 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-744f8b09-c2f9-4302-86c8-018b731904d2 req-4c50af54-1d2d-43a0-8239-9cfe4121e72c service neutron] 10.222.0.55 "GET /v2.0/networks?id=113ded30-096c-4860-8773-fb717f3ea4c6 HTTP/1.1" status: 200  len: 915 time: 0.2145000
Jun 03 08:35:49.269797 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d547bef-0730-44ae-be07-b8bd25acdcfa admin admin] Pushing event deleted for resources: {'Port': ['ID=e13a1db6-df45-45c7-a102-bed3e3054729,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:49.273250 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-5d547bef-0730-44ae-be07-b8bd25acdcfa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:49.398269 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5d547bef-0730-44ae-be07-b8bd25acdcfa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-16327738'] for router_gateway, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:49.399995 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-744f8b09-c2f9-4302-86c8-018b731904d2 req-206a8f6a-a72a-4b93-9705-0151242ccab0 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=37525065-c740-4aee-a826-af098f4b7727 HTTP/1.1" status: 200  len: 999 time: 0.1499808
Jun 03 08:35:49.472318 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-744f8b09-c2f9-4302-86c8-018b731904d2 req-e0f81185-203b-4317-b60c-6fa912686973 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:49.474007 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-744f8b09-c2f9-4302-86c8-018b731904d2 req-e0f81185-203b-4317-b60c-6fa912686973 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=159409d9-9245-4f6d-adbe-4aa8aad78d07 HTTP/1.1" status: 200  len: 853 time: 0.0639565
Jun 03 08:35:49.561787 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-744f8b09-c2f9-4302-86c8-018b731904d2 req-94a38105-f6b1-47e7-8131-5a4a2e8036e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:49.566680 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-744f8b09-c2f9-4302-86c8-018b731904d2 req-94a38105-f6b1-47e7-8131-5a4a2e8036e1 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=113ded30-096c-4860-8773-fb717f3ea4c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0816095
Jun 03 08:35:49.591705 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5d547bef-0730-44ae-be07-b8bd25acdcfa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-16388336', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2351'] for router, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:49.593978 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5d547bef-0730-44ae-be07-b8bd25acdcfa admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:49.709819 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-744f8b09-c2f9-4302-86c8-018b731904d2 req-babb2581-111f-42b9-a696-3f70b46568ba service neutron] 10.222.0.55 "GET /v2.0/networks/113ded30-096c-4860-8773-fb717f3ea4c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1339025
Jun 03 08:35:49.800217 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5d547bef-0730-44ae-be07-b8bd25acdcfa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-16388448'] for router, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:49.800749 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5d547bef-0730-44ae-be07-b8bd25acdcfa admin admin] Fanout notify agent at l3_agent the message router_deleted on router 195a7c09-ac04-4351-bdeb-7bc97d7d574d {{(pid=92324) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 03 08:35:49.816369 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5d547bef-0730-44ae-be07-b8bd25acdcfa admin admin] Notify callbacks [] for router, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:49.817914 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-5d547bef-0730-44ae-be07-b8bd25acdcfa admin admin] 10.222.0.11 "DELETE /v2.0/routers/195a7c09-ac04-4351-bdeb-7bc97d7d574d HTTP/1.1" status: 204  len: 168 time: 2.1324162
Jun 03 08:35:49.820380 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 52640) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:49.855278 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-744f8b09-c2f9-4302-86c8-018b731904d2 req-ff5a7794-4e46-4b43-a659-a9498dfab86f service neutron] 10.222.0.55 "GET /v2.0/networks/113ded30-096c-4860-8773-fb717f3ea4c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1364524
Jun 03 08:35:49.888700 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.db_base_plugin_v2 [None req-1ef54362-f4f8-4309-bb51-dbfd892add1d admin admin] Deleting subnet 0ea4966f-f9de-4d69-a774-7746b1ee12ee {{(pid=92324) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 03 08:35:49.892283 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1ef54362-f4f8-4309-bb51-dbfd892add1d admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:49.947857 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1ef54362-f4f8-4309-bb51-dbfd892add1d admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-15250429'] for subnet, precommit_delete_associations {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:50.007735 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1ef54362-f4f8-4309-bb51-dbfd892add1d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-862421'] for subnet, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:50.101008 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device dd4a50f7-3420-4d92-accb-bce642d3216f up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:35:50.324909 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning for port dd4a50f7-3420-4d92-accb-bce642d3216f completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:35:50.331270 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port dd4a50f7-3420-4d92-accb-bce642d3216f triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:35:50.331753 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:50.471599 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device e13a1db6-df45-45c7-a102-bed3e3054729 no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:35:50.493259 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-527976d6-5a66-4600-962b-2df1dfe70461 req-e307754c-0e2f-4a05-859e-029e871a6491 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:50.501781 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-527976d6-5a66-4600-962b-2df1dfe70461 req-e307754c-0e2f-4a05-859e-029e871a6491 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 944 time: 0.1678507
Jun 03 08:35:50.565201 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-527976d6-5a66-4600-962b-2df1dfe70461 req-42e4eb9f-1ed4-40f0-874c-81d0cdbf6edb tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0622773
Jun 03 08:35:50.580030 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: e13a1db6-df45-45c7-a102-bed3e3054729 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:35:50.580437 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device e13a1db6-df45-45c7-a102-bed3e3054729 not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:35:50.580939 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 4bcbfa9c-b0be-4036-a7ea-53eec8e82b52 no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:35:50.605128 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e37faa9d-2540-47d0-9191-5ede706c0cd3 req-f411610d-f2c8-484d-b451-2f0066ef36cc tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:50.606981 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e37faa9d-2540-47d0-9191-5ede706c0cd3 req-f411610d-f2c8-484d-b451-2f0066ef36cc tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.3995841
Jun 03 08:35:50.621750 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: 4bcbfa9c-b0be-4036-a7ea-53eec8e82b52 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:35:50.622100 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 4bcbfa9c-b0be-4036-a7ea-53eec8e82b52 not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:35:50.676462 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e37faa9d-2540-47d0-9191-5ede706c0cd3 req-9e4e85ec-c057-4b7e-a60a-c4428e680d74 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0623066
Jun 03 08:35:50.689783 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:50.720658 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fd73c345-63e5-4a4b-b638-d7fb6250aa36', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dd4a50f7-3420-4d92-accb-bce642d3216f'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:35:50.723326 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5a3d3977-9848-483f-b417-e91f591df7b2" -d '{"events": [{"server_uuid": "fd73c345-63e5-4a4b-b638-d7fb6250aa36", "name": "network-vif-plugged", "status": "completed", "tag": "dd4a50f7-3420-4d92-accb-bce642d3216f"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:35:50.731929 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port dd4a50f7-3420-4d92-accb-bce642d3216f, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=dd4a50f7-3420-4d92-accb-bce642d3216f,segment=NetworkSegment(6978222c-6678-416a-a506-1fa962d91d64),segment_id=6978222c-6678-416a-a506-1fa962d91d64)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:35:50.772581 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:35:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0f659278-dbf7-42ce-b294-97bc6f08f1b7 x-openstack-request-id: req-0f659278-dbf7-42ce-b294-97bc6f08f1b7 {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:35:50.772882 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fd73c345-63e5-4a4b-b638-d7fb6250aa36", "name": "network-vif-plugged", "status": "completed", "tag": "dd4a50f7-3420-4d92-accb-bce642d3216f", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:35:50.773140 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-0f659278-dbf7-42ce-b294-97bc6f08f1b7 {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:35:50.773528 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fd73c345-63e5-4a4b-b638-d7fb6250aa36', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dd4a50f7-3420-4d92-accb-bce642d3216f', 'code': 200}
Jun 03 08:35:50.953764 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:50.954687 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1ef54362-f4f8-4309-bb51-dbfd892add1d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-862434', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15641431', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14870376'] for subnet, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:50.956508 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-ac62d933-6d83-4e0f-b501-4a6eb418cb9e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:50.961588 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-bbbd0cdc-1a2a-4e11-b13c-6874f694d258 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:51.003064 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ef54362-f4f8-4309-bb51-dbfd892add1d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0ea4966f-f9de-4d69-a774-7746b1ee12ee,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:51.005956 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-1ef54362-f4f8-4309-bb51-dbfd892add1d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:51.008625 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1ef54362-f4f8-4309-bb51-dbfd892add1d admin admin] Notify callbacks [] for subnet, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:51.017503 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-1ef54362-f4f8-4309-bb51-dbfd892add1d admin admin] 10.222.0.11 "DELETE /v2.0/subnets/0ea4966f-f9de-4d69-a774-7746b1ee12ee HTTP/1.1" status: 204  len: 168 time: 1.1950445
Jun 03 08:35:51.019639 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 52702) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:51.034371 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=dd4a50f7-3420-4d92-accb-bce642d3216f,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:51.037754 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:51.140994 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c7c74e1a-65b9-4a22-aa95-d9ef41c6c88f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-529010'] for network, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:51.268654 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c7c74e1a-65b9-4a22-aa95-d9ef41c6c88f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-862046', 'neutron.services.segments.db._delete_segments_for_network-8774224358894'] for network, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:51.389679 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-c7c74e1a-65b9-4a22-aa95-d9ef41c6c88f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fae8616eb80>,) {'filters': {'network_id': ['6861b4db-6cd2-4a5b-bf02-87826345c933']}} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:35:51.405931 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-c7c74e1a-65b9-4a22-aa95-d9ef41c6c88f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fae8616eb80>, '1b8fb38d-ade8-4355-bd2b-f2b171f31184') {'for_net_delete': True} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:35:51.406226 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-c7c74e1a-65b9-4a22-aa95-d9ef41c6c88f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fae8616eb80>, '1b8fb38d-ade8-4355-bd2b-f2b171f31184') {} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:35:51.428496 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c7c74e1a-65b9-4a22-aa95-d9ef41c6c88f admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8774224362253', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14518195'] for segment, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:51.450443 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c7c74e1a-65b9-4a22-aa95-d9ef41c6c88f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:51.460540 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c7c74e1a-65b9-4a22-aa95-d9ef41c6c88f admin admin] Releasing vlan 518 on physical network physnet1 to pool {{(pid=92323) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 03 08:35:51.465023 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c7c74e1a-65b9-4a22-aa95-d9ef41c6c88f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14211322'] for segment, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]: Traceback (most recent call last):
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:     timer()
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:     cb(*args, **kw)
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:     return func(*args, **kwargs)
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:     self._notify()
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:     self.callback(batched_events)
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:     event.method(event)
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:     return f(self, *a, **k)
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self._get(url).json()
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self.request(url, 'GET', **kwargs)
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 03 08:35:51.474525 dv-cinder-787262-5-iscsi neutron-server[92323]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 03 08:35:51.493078 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea40b5fe-610d-461a-b455-a687df69c4c1 req-c2967f14-87ed-431d-ba9f-aaca9006906d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:51.494595 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ea40b5fe-610d-461a-b455-a687df69c4c1 req-c2967f14-87ed-431d-ba9f-aaca9006906d service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 1098 time: 0.2187655
Jun 03 08:35:51.589775 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ea40b5fe-610d-461a-b455-a687df69c4c1 req-dd9048aa-4a55-47a3-9aa3-43187fc43e81 service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0482955
Jun 03 08:35:51.713818 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c7c74e1a-65b9-4a22-aa95-d9ef41c6c88f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-862039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16327709'] for network, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:51.719157 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b937251e-7bb8-4107-8feb-7741b6a36621 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:51.737205 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c7c74e1a-65b9-4a22-aa95-d9ef41c6c88f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:51.749582 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7c74e1a-65b9-4a22-aa95-d9ef41c6c88f admin admin] Pushing event deleted for resources: {'Network': ['ID=6861b4db-6cd2-4a5b-bf02-87826345c933,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:51.755475 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c7c74e1a-65b9-4a22-aa95-d9ef41c6c88f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:51.862701 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-c7c74e1a-65b9-4a22-aa95-d9ef41c6c88f admin admin] 10.222.0.11 "DELETE /v2.0/networks/6861b4db-6cd2-4a5b-bf02-87826345c933 HTTP/1.1" status: 204  len: 168 time: 0.8417161
Jun 03 08:35:51.922128 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17b858fa-3cb3-49ff-a7ef-7a45dea9aa1a req-11aa835b-86e8-4ca5-a703-dc6f63bfe3c9 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:51.924577 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-17b858fa-3cb3-49ff-a7ef-7a45dea9aa1a req-11aa835b-86e8-4ca5-a703-dc6f63bfe3c9 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 945 time: 0.0958037
Jun 03 08:35:51.947511 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fc0d830-593b-4373-8e6a-4977dc1b2d41 req-e5bf14e2-6f96-409c-ae88-4d18515c07f9 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:51.959313 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9fc0d830-593b-4373-8e6a-4977dc1b2d41 req-e5bf14e2-6f96-409c-ae88-4d18515c07f9 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.1369321
Jun 03 08:35:51.986826 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-17b858fa-3cb3-49ff-a7ef-7a45dea9aa1a req-66b00cdb-3427-445a-a683-d5349ca784ba tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0565426
Jun 03 08:35:52.017790 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-9fc0d830-593b-4373-8e6a-4977dc1b2d41 req-b1e57f65-abc3-4fc2-a94b-69cf2cde6a8d tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Synchronizing usage tracker for tenant:96a989a900784d61a1475d86dd209c5f on resource:security_group {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:35:52.148312 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-9fc0d830-593b-4373-8e6a-4977dc1b2d41 req-b1e57f65-abc3-4fc2-a94b-69cf2cde6a8d tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Unset dirty status for tenant:96a989a900784d61a1475d86dd209c5f on resource:security_group {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:35:52.149742 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9fc0d830-593b-4373-8e6a-4977dc1b2d41 req-b1e57f65-abc3-4fc2-a94b-69cf2cde6a8d tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.1894765
Jun 03 08:35:52.465606 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 52728) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:52.523675 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-2787d085-8037-40e6-9eaf-f5b629cb9a62 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=b9cf7834ca79439981d1f8e77b89daed&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0531173
Jun 03 08:35:52.524208 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 52736) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:52.592907 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-b68cfb80-49e6-4852-8729-dbaeefd835a3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:52.632108 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-b68cfb80-49e6-4852-8729-dbaeefd835a3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:52.827613 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-b68cfb80-49e6-4852-8729-dbaeefd835a3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:52.833416 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-0e83dd2f-e309-42ca-a1a3-02ffa02ee5c9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:52.845047 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b68cfb80-49e6-4852-8729-dbaeefd835a3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b20b0dee-1798-4811-81d5-712ca54f9835,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:52.848488 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-b68cfb80-49e6-4852-8729-dbaeefd835a3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:52.975350 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-b68cfb80-49e6-4852-8729-dbaeefd835a3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:52.977216 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-b68cfb80-49e6-4852-8729-dbaeefd835a3 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/b20b0dee-1798-4811-81d5-712ca54f9835 HTTP/1.1" status: 204  len: 168 time: 0.4523113
Jun 03 08:35:53.171987 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9f2c239-100c-4e72-abe4-08bdc1d9196e req-34a56ea5-a4aa-49c4-be86-2747cb96fd36 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:53.174558 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f9f2c239-100c-4e72-abe4-08bdc1d9196e req-34a56ea5-a4aa-49c4-be86-2747cb96fd36 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 945 time: 0.0872986
Jun 03 08:35:53.225989 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f9f2c239-100c-4e72-abe4-08bdc1d9196e req-0123d1e3-ea2a-4915-beb3-9c0f9f407997 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0447655
Jun 03 08:35:53.348390 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-357d6c45-090d-488f-a67c-ae8e701a98ec req-36037efd-0ee1-4e96-b5fa-bf7f407d2c4a tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:53.356473 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-357d6c45-090d-488f-a67c-ae8e701a98ec req-36037efd-0ee1-4e96-b5fa-bf7f407d2c4a tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.0916624
Jun 03 08:35:53.403990 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-357d6c45-090d-488f-a67c-ae8e701a98ec req-4213e9f9-82ea-4c5d-9e63-941e3f0f0d51 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0465891
Jun 03 08:35:54.627722 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22bfc3d4-2553-4ee3-a8b6-eb83af7c3382 req-25a0d241-7350-4fc7-84d3-f689246b53b7 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:54.629506 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-22bfc3d4-2553-4ee3-a8b6-eb83af7c3382 req-25a0d241-7350-4fc7-84d3-f689246b53b7 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.0912540
Jun 03 08:35:54.679246 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-22bfc3d4-2553-4ee3-a8b6-eb83af7c3382 req-45cdb8b6-1c2c-4b1f-a486-734f2a98078d tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0432403
Jun 03 08:35:55.891508 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f251558b-a93b-413b-ad5a-02bfadff64f7 req-0b40842b-91f0-4497-b35e-39e4febe742c tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:55.899576 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f251558b-a93b-413b-ad5a-02bfadff64f7 req-0b40842b-91f0-4497-b35e-39e4febe742c tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.1003294
Jun 03 08:35:55.931892 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 52832) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:55.962642 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f251558b-a93b-413b-ad5a-02bfadff64f7 req-550b8c79-7669-4a94-aaa5-f1045855caa7 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0616496
Jun 03 08:35:56.088113 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:56.104603 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:35:56.117866 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] Usage tracker for resource:security_group_rule and tenant:7ae4f55b4eb343e9829962bb50ebb2f3 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:35:56.125304 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:35:56.132039 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:35:56.176525 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:56.247659 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:56.347339 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:56.354349 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-794f35fd-c563-444c-a56b-dbee369dffff admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:56.401740 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=7ae4f55b4eb343e9829962bb50ebb2f3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4685102
Jun 03 08:35:56.402614 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce679a4b-3cc8-4ea4-8d1d-413a39a5e6f4,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:56.404473 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 52840) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:35:56.410654 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.411035 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.411407 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.411776 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.412143 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.412507 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.412868 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.413226 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.413584 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.413939 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.414294 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.414716 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.418431 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:56.468852 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-521fec0c-2c14-4edd-8324-13e6db7162b9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:56.496752 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-521fec0c-2c14-4edd-8324-13e6db7162b9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:56.657475 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-521fec0c-2c14-4edd-8324-13e6db7162b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:56.662749 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-bfe061f7-89e8-4480-8314-4818c423e447 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:35:56.677650 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-521fec0c-2c14-4edd-8324-13e6db7162b9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce679a4b-3cc8-4ea4-8d1d-413a39a5e6f4,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:35:56.690051 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-521fec0c-2c14-4edd-8324-13e6db7162b9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.690417 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-521fec0c-2c14-4edd-8324-13e6db7162b9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.690803 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-521fec0c-2c14-4edd-8324-13e6db7162b9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.691156 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-521fec0c-2c14-4edd-8324-13e6db7162b9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.695463 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-521fec0c-2c14-4edd-8324-13e6db7162b9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.695463 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-521fec0c-2c14-4edd-8324-13e6db7162b9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.695463 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-521fec0c-2c14-4edd-8324-13e6db7162b9 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.695463 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-521fec0c-2c14-4edd-8324-13e6db7162b9 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.695463 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-521fec0c-2c14-4edd-8324-13e6db7162b9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.695463 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-521fec0c-2c14-4edd-8324-13e6db7162b9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.695463 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-521fec0c-2c14-4edd-8324-13e6db7162b9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.695463 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-521fec0c-2c14-4edd-8324-13e6db7162b9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:35:56.704907 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-521fec0c-2c14-4edd-8324-13e6db7162b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:35:56.706353 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-521fec0c-2c14-4edd-8324-13e6db7162b9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:56.711660 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-521fec0c-2c14-4edd-8324-13e6db7162b9 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/ce679a4b-3cc8-4ea4-8d1d-413a39a5e6f4 HTTP/1.1" status: 204  len: 168 time: 0.3019986
Jun 03 08:35:57.014223 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38b64634-7e9f-49a9-873f-b2a7aee70703 req-1547620a-3760-4da1-8a14-ae6181004d37 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:57.015770 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-38b64634-7e9f-49a9-873f-b2a7aee70703 req-1547620a-3760-4da1-8a14-ae6181004d37 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 946 time: 0.0867326
Jun 03 08:35:57.064688 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-38b64634-7e9f-49a9-873f-b2a7aee70703 req-223d989c-db47-4a36-9ded-6fe68004bb6f tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0425038
Jun 03 08:35:57.205052 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f05fa3b-98eb-48fa-a962-a3afbd7d253d req-b9e7d35b-3282-4656-adff-72fa44c28465 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:57.206782 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0f05fa3b-98eb-48fa-a962-a3afbd7d253d req-b9e7d35b-3282-4656-adff-72fa44c28465 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.0996342
Jun 03 08:35:57.263191 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0f05fa3b-98eb-48fa-a962-a3afbd7d253d req-fa0d477e-c5ed-4418-814b-f541774ed084 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0500994
Jun 03 08:35:58.261963 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b357eff-3167-4a25-9880-e3a6a8f639cd req-5132495e-0f5c-404c-845b-7ecf73c7cb09 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:58.272944 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8b357eff-3167-4a25-9880-e3a6a8f639cd req-5132495e-0f5c-404c-845b-7ecf73c7cb09 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.1173921
Jun 03 08:35:58.312505 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a42e3a-f59e-4dda-b5dc-f20dd7e3e37a req-a4c6ffaf-032c-43ea-9eb9-99ad6bb108d7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:58.314557 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-32a42e3a-f59e-4dda-b5dc-f20dd7e3e37a req-a4c6ffaf-032c-43ea-9eb9-99ad6bb108d7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 946 time: 0.1224701
Jun 03 08:35:58.327334 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8b357eff-3167-4a25-9880-e3a6a8f639cd req-62c020ba-710e-4de9-b3b5-fcb8cd89a740 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0533350
Jun 03 08:35:58.385857 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-32a42e3a-f59e-4dda-b5dc-f20dd7e3e37a req-efda6515-c805-421f-b13b-584cdef46cbd tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0656536
Jun 03 08:35:58.871629 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de4bf0fc-463b-4df1-8e92-0a0bb649ad90 req-d9a233c7-f57a-4252-9841-a594d8232dec tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:58.874389 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-de4bf0fc-463b-4df1-8e92-0a0bb649ad90 req-d9a233c7-f57a-4252-9841-a594d8232dec tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.55 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 946 time: 0.2433770
Jun 03 08:35:58.892564 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed463abd-72b2-406f-9dc9-ac79554b24d1 req-7c4b0e8a-ad88-4021-98c3-153cfa72a521 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:58.894087 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ed463abd-72b2-406f-9dc9-ac79554b24d1 req-7c4b0e8a-ad88-4021-98c3-153cfa72a521 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.2285993
Jun 03 08:35:58.943055 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04735857-0458-4c91-9603-0b98d21d7f67 req-4320c99d-3dde-4040-8579-d1336e742b14 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:58.944842 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-04735857-0458-4c91-9603-0b98d21d7f67 req-4320c99d-3dde-4040-8579-d1336e742b14 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=96a989a900784d61a1475d86dd209c5f&device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 1137 time: 0.3906868
Jun 03 08:35:59.160022 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ed463abd-72b2-406f-9dc9-ac79554b24d1 req-157427f5-f9c9-436d-8bb3-1685e8b7e93f tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.2265742
Jun 03 08:35:59.231062 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04735857-0458-4c91-9603-0b98d21d7f67 req-87785c82-a887-4b46-961c-baa8b2199404 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:59.232524 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-04735857-0458-4c91-9603-0b98d21d7f67 req-87785c82-a887-4b46-961c-baa8b2199404 service neutron] 10.222.0.55 "GET /v2.0/networks?id=113ded30-096c-4860-8773-fb717f3ea4c6 HTTP/1.1" status: 200  len: 915 time: 0.2498810
Jun 03 08:35:59.244106 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-de4bf0fc-463b-4df1-8e92-0a0bb649ad90 req-6de2a1b2-a365-4103-a1ac-3bab11f216c1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Deleting port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:35:59.244451 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-de4bf0fc-463b-4df1-8e92-0a0bb649ad90 req-6de2a1b2-a365-4103-a1ac-3bab11f216c1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:59.403973 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-de4bf0fc-463b-4df1-8e92-0a0bb649ad90 req-6de2a1b2-a365-4103-a1ac-3bab11f216c1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] For port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:35:59.403973 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-de4bf0fc-463b-4df1-8e92-0a0bb649ad90 req-6de2a1b2-a365-4103-a1ac-3bab11f216c1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:59.553636 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ee6d2bf-8de6-4262-b5f8-f8866f1e521a req-0bed7218-e3fc-43be-a23b-ee5677e7e7d8 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:59.555201 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6ee6d2bf-8de6-4262-b5f8-f8866f1e521a req-0bed7218-e3fc-43be-a23b-ee5677e7e7d8 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.0852852
Jun 03 08:35:59.617122 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6ee6d2bf-8de6-4262-b5f8-f8866f1e521a req-d056fb38-14d6-4130-acca-1503cb7286fb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0543432
Jun 03 08:35:59.864644 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3421074b-c83f-45f3-866c-24c99855b367 req-464f98bc-25fc-4930-ade3-14f7f6af467d tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:35:59.866153 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3421074b-c83f-45f3-866c-24c99855b367 req-464f98bc-25fc-4930-ade3-14f7f6af467d tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 946 time: 0.3415706
Jun 03 08:35:59.901236 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-de4bf0fc-463b-4df1-8e92-0a0bb649ad90 req-6de2a1b2-a365-4103-a1ac-3bab11f216c1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:59.901621 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-de4bf0fc-463b-4df1-8e92-0a0bb649ad90 req-6de2a1b2-a365-4103-a1ac-3bab11f216c1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16327919'] for floatingip, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:35:59.901968 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.db.l3_db [req-de4bf0fc-463b-4df1-8e92-0a0bb649ad90 req-6de2a1b2-a365-4103-a1ac-3bab11f216c1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Floating IP 4ac13f19-aae2-4b91-8bfd-97e4db2bcc6b disassociated. External IP: 172.27.0.151, port: 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97.
Jun 03 08:35:59.902302 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-de4bf0fc-463b-4df1-8e92-0a0bb649ad90 req-6de2a1b2-a365-4103-a1ac-3bab11f216c1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Calling delete_port for 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 owned by compute:nova {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:35:59.943126 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3421074b-c83f-45f3-866c-24c99855b367 req-0f7222bd-e734-46f5-9229-70dd4212bd7c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=548f6ffb-55f0-4e53-89ee-7d877c658fda&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0693305
Jun 03 08:36:00.142257 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-de4bf0fc-463b-4df1-8e92-0a0bb649ad90 req-6de2a1b2-a365-4103-a1ac-3bab11f216c1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:00.149565 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-70075ceb-cb54-4e37-a0c0-bfaf85f7ad12 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:00.195663 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de2a1b2-a365-4103-a1ac-3bab11f216c1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Pushing event deleted for resources: {'Port': ['ID=7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:00.199906 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-6de2a1b2-a365-4103-a1ac-3bab11f216c1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:00.375227 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4d0ff7-509f-4722-8b09-53f41e57d543 req-35a1b459-7fc2-4b99-b667-8196e21e5a9e tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:00.377317 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8a4d0ff7-509f-4722-8b09-53f41e57d543 req-35a1b459-7fc2-4b99-b667-8196e21e5a9e tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.1020889
Jun 03 08:36:00.426307 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [req-de4bf0fc-463b-4df1-8e92-0a0bb649ad90 req-6de2a1b2-a365-4103-a1ac-3bab11f216c1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Router cb358121-3d7d-46b4-8e93-e40d5a92215c has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:36:00.435481 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8a4d0ff7-509f-4722-8b09-53f41e57d543 req-65d4e7a8-c3b8-48d2-b526-c452ed55be7b tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0516381
Jun 03 08:36:00.681821 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-04735857-0458-4c91-9603-0b98d21d7f67 req-623a5962-bfc2-4aad-9abe-51237ffbfb60 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=37525065-c740-4aee-a826-af098f4b7727 HTTP/1.1" status: 200  len: 999 time: 0.1890159
Jun 03 08:36:00.721449 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-de4bf0fc-463b-4df1-8e92-0a0bb649ad90 req-6de2a1b2-a365-4103-a1ac-3bab11f216c1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:36:00.738847 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bdec629-13ce-4e78-b467-cca0e9695ac7 None None] Sync routers for ids ['cb358121-3d7d-46b4-8e93-e40d5a92215c'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:36:00.748870 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bdec629-13ce-4e78-b467-cca0e9695ac7 None None] Routers {'cb358121-3d7d-46b4-8e93-e40d5a92215c'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:36:00.749740 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-7bdec629-13ce-4e78-b467-cca0e9695ac7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86d55d30>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:35:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['cb358121-3d7d-46b4-8e93-e40d5a92215c'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:36:00.814315 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-de4bf0fc-463b-4df1-8e92-0a0bb649ad90 req-6de2a1b2-a365-4103-a1ac-3bab11f216c1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] No DVR routers for this DVR port 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 on host hv-cinder-78726 {{(pid=92323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:36:00.817437 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-de4bf0fc-463b-4df1-8e92-0a0bb649ad90 req-6de2a1b2-a365-4103-a1ac-3bab11f216c1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:00.821611 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0c731ecb-c3fc-401e-af74-34336582cf7d', 'name': 'network-vif-deleted', 'tag': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:36:00.823555 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-86890b93-61b7-4e40-a8a2-dd1386ba582b" -d '{"events": [{"server_uuid": "0c731ecb-c3fc-401e-af74-34336582cf7d", "name": "network-vif-deleted", "tag": "7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:36:00.892528 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:36:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-64173413-5e32-4ac2-bc5f-b1995a6c61e1 x-openstack-request-id: req-64173413-5e32-4ac2-bc5f-b1995a6c61e1 {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:36:00.893126 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0c731ecb-c3fc-401e-af74-34336582cf7d", "name": "network-vif-deleted", "tag": "7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:36:00.893775 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-64173413-5e32-4ac2-bc5f-b1995a6c61e1 {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:36:00.894396 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0c731ecb-c3fc-401e-af74-34336582cf7d', 'name': 'network-vif-deleted', 'tag': '7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97', 'status': 'completed', 'code': 200}
Jun 03 08:36:00.949039 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-de4bf0fc-463b-4df1-8e92-0a0bb649ad90 req-6de2a1b2-a365-4103-a1ac-3bab11f216c1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.55 "DELETE /v2.0/ports/7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 HTTP/1.1" status: 204  len: 173 time: 2.0538075
Jun 03 08:36:00.957243 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-7bdec629-13ce-4e78-b467-cca0e9695ac7 None None] Set router cb358121-3d7d-46b4-8e93-e40d5a92215c gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:36:01.109252 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7010a035-d7ce-469b-ab45-25459e926af2 req-96d94aee-5a1c-45ee-97d9-43c21a5abe6f tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:01.119242 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7010a035-d7ce-469b-ab45-25459e926af2 req-96d94aee-5a1c-45ee-97d9-43c21a5abe6f tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.1164243
Jun 03 08:36:01.137614 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-07a26be5-843c-4da0-b761-c9767f436246 req-abb9c2ae-5913-4322-9f6b-08750354f175 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 210 time: 0.0641344
Jun 03 08:36:01.180708 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7010a035-d7ce-469b-ab45-25459e926af2 req-3218b3ff-f63c-4474-bbec-f654175eda02 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0605524
Jun 03 08:36:01.335494 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-7bdec629-13ce-4e78-b467-cca0e9695ac7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86d55d30>, [{'id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-router', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:37Z', 'updated_at': '2021-06-03T08:30:48Z', 'revision_number': 4, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'gw_port': {'id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:11:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '5d9c4d5c-7c2e-4911-823a-3a3242707096', 'name': '', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'mac_address': 'fa:16:3e:0c:7e:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_interface', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:46Z', 'updated_at': '2021-06-03T08:31:03Z', 'revision_number': 5, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'subnets': [{'id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:36:01.339501 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bdec629-13ce-4e78-b467-cca0e9695ac7 None None] Checking router: cb358121-3d7d-46b4-8e93-e40d5a92215c for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:36:01.350070 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bdec629-13ce-4e78-b467-cca0e9695ac7 None None] Routers {'cb358121-3d7d-46b4-8e93-e40d5a92215c'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:36:01.350998 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-7bdec629-13ce-4e78-b467-cca0e9695ac7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86d55d30>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:35:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['cb358121-3d7d-46b4-8e93-e40d5a92215c'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:36:01.547881 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-7bdec629-13ce-4e78-b467-cca0e9695ac7 None None] Set router cb358121-3d7d-46b4-8e93-e40d5a92215c gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:36:01.676822 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00fc62d3-8474-44a8-b598-5112fdf4fd7c req-a8f86c1e-aafe-407f-932c-717a7861d4ed tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:01.684642 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-00fc62d3-8474-44a8-b598-5112fdf4fd7c req-a8f86c1e-aafe-407f-932c-717a7861d4ed tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.1085005
Jun 03 08:36:01.747877 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-00fc62d3-8474-44a8-b598-5112fdf4fd7c req-48744813-bf8a-4eb7-b80f-7f6e90e91e90 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0596349
Jun 03 08:36:01.941820 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-7bdec629-13ce-4e78-b467-cca0e9695ac7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86d55d30>, [{'id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-router', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:37Z', 'updated_at': '2021-06-03T08:30:48Z', 'revision_number': 4, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'gw_port': {'id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:11:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '5d9c4d5c-7c2e-4911-823a-3a3242707096', 'name': '', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'mac_address': 'fa:16:3e:0c:7e:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_interface', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:46Z', 'updated_at': '2021-06-03T08:31:03Z', 'revision_number': 5, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'subnets': [{'id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:36:01.946087 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bdec629-13ce-4e78-b467-cca0e9695ac7 None None] The sync data for ids ['cb358121-3d7d-46b4-8e93-e40d5a92215c'] in dv-cinder-787262-5-iscsi is: [{'id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-router', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:37Z', 'updated_at': '2021-06-03T08:30:48Z', 'revision_number': 4, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'gw_port': {'id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:11:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '5d9c4d5c-7c2e-4911-823a-3a3242707096', 'name': '', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'mac_address': 'fa:16:3e:0c:7e:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_interface', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:46Z', 'updated_at': '2021-06-03T08:31:03Z', 'revision_number': 5, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'subnets': [{'id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:36:02.169517 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b10869a7-0443-464b-b3b3-132963e91c6c None None] New status for floating IP 4ac13f19-aae2-4b91-8bfd-97e4db2bcc6b: DOWN {{(pid=92326) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 03 08:36:02.343981 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-6b049caa-5ea9-40e3-a686-583579bbccfe req-cfa5d518-6719-4968-a10e-8341c966acca tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Synchronizing usage tracker for tenant:36c42f532cd14f19811ffbee3a39a208 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:36:02.427695 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-6b049caa-5ea9-40e3-a686-583579bbccfe req-cfa5d518-6719-4968-a10e-8341c966acca tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Unset dirty status for tenant:36c42f532cd14f19811ffbee3a39a208 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:36:02.429015 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6b049caa-5ea9-40e3-a686-583579bbccfe req-cfa5d518-6719-4968-a10e-8341c966acca tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 210 time: 0.1300848
Jun 03 08:36:02.439254 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5a38aa0-dcfe-430d-b14b-aa354a911f5c req-87c2e614-8169-42f5-9fec-ce160e2f1db0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:02.442784 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f5a38aa0-dcfe-430d-b14b-aa354a911f5c req-87c2e614-8169-42f5-9fec-ce160e2f1db0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.0911243
Jun 03 08:36:02.500752 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f5a38aa0-dcfe-430d-b14b-aa354a911f5c req-c5a1e2b8-51c8-4d07-909b-bb7e94685c53 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0517960
Jun 03 08:36:02.524630 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-cc6eca8f-29a5-4586-b22d-8c48f2a4e2e0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:02.905421 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04735857-0458-4c91-9603-0b98d21d7f67 req-0c0aef8b-ef92-4053-bb90-62b4f8754f6b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:02.908116 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-04735857-0458-4c91-9603-0b98d21d7f67 req-0c0aef8b-ef92-4053-bb90-62b4f8754f6b service neutron] 10.222.0.55 "GET /v2.0/subnets?id=159409d9-9245-4f6d-adbe-4aa8aad78d07 HTTP/1.1" status: 200  len: 853 time: 0.1292145
Jun 03 08:36:03.076215 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43841038-7ddc-4b16-aa35-137ae2c00ee8 req-867844cd-4218-46c9-90a1-ec90f5c89d61 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:03.077716 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-43841038-7ddc-4b16-aa35-137ae2c00ee8 req-867844cd-4218-46c9-90a1-ec90f5c89d61 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.1670048
Jun 03 08:36:03.084767 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04735857-0458-4c91-9603-0b98d21d7f67 req-cf35cdcf-95d3-471c-a90f-ad19845604d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:03.086232 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-04735857-0458-4c91-9603-0b98d21d7f67 req-cf35cdcf-95d3-471c-a90f-ad19845604d0 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=113ded30-096c-4860-8773-fb717f3ea4c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1150756
Jun 03 08:36:03.211234 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-43841038-7ddc-4b16-aa35-137ae2c00ee8 req-ab185c0f-063e-45cc-868e-a83727ad4305 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.1239250
Jun 03 08:36:03.257526 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-04735857-0458-4c91-9603-0b98d21d7f67 req-56ba0b8f-afb1-4a17-817f-7d1a16743591 service neutron] 10.222.0.55 "GET /v2.0/networks/113ded30-096c-4860-8773-fb717f3ea4c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1526079
Jun 03 08:36:03.495476 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-04735857-0458-4c91-9603-0b98d21d7f67 req-2f5125e2-6b9c-422b-8af7-e7b3c68c361c service neutron] 10.222.0.55 "GET /v2.0/networks/113ded30-096c-4860-8773-fb717f3ea4c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2184267
Jun 03 08:36:03.625602 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3face30f-bb26-4d1d-91c7-24ebff904ec7 req-b2e36406-b65b-4f0b-b84a-4c4471634c16 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=0c731ecb-c3fc-401e-af74-34336582cf7d HTTP/1.1" status: 200  len: 210 time: 0.0442300
Jun 03 08:36:03.711634 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a685d45-8fe7-47a6-91af-db6d937abd7a req-aab5f3fe-821c-4a49-bffa-bb1619703cbf tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:03.713338 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4a685d45-8fe7-47a6-91af-db6d937abd7a req-aab5f3fe-821c-4a49-bffa-bb1619703cbf tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.0879605
Jun 03 08:36:03.759276 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4a685d45-8fe7-47a6-91af-db6d937abd7a req-992ffe97-9047-4911-aed0-733f88801d8d tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0402937
Jun 03 08:36:04.418971 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1db2694-226b-47e7-b27c-7c321c145009 req-ef03e413-2c84-4a0d-b9e6-3d7745d62545 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:04.420475 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f1db2694-226b-47e7-b27c-7c321c145009 req-ef03e413-2c84-4a0d-b9e6-3d7745d62545 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.0862718
Jun 03 08:36:04.474377 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f1db2694-226b-47e7-b27c-7c321c145009 req-ea32e789-b85f-40cb-937f-26010d8f4ee2 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0482113
Jun 03 08:36:04.590796 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71ea61d5-797f-42df-9337-f885920edff0 req-bcab356b-6532-42e9-9f20-5fd7ab848526 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:04.592395 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-71ea61d5-797f-42df-9337-f885920edff0 req-bcab356b-6532-42e9-9f20-5fd7ab848526 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.55 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.1074989
Jun 03 08:36:04.763451 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-71ea61d5-797f-42df-9337-f885920edff0 req-8b91234d-755c-4b59-a95b-fd42fe3eebea tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Deleting port 19f733be-bd85-43df-86fd-5a9c617b3df4 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:36:04.763798 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-71ea61d5-797f-42df-9337-f885920edff0 req-8b91234d-755c-4b59-a95b-fd42fe3eebea tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:04.856571 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:04.869936 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 52964) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:05.024650 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-71ea61d5-797f-42df-9337-f885920edff0 req-8b91234d-755c-4b59-a95b-fd42fe3eebea tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] For port 19f733be-bd85-43df-86fd-5a9c617b3df4, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=19f733be-bd85-43df-86fd-5a9c617b3df4,segment=NetworkSegment(56366949-8cc8-4cf3-b3eb-d458d3515059),segment_id=56366949-8cc8-4cf3-b3eb-d458d3515059)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:36:05.024924 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-71ea61d5-797f-42df-9337-f885920edff0 req-8b91234d-755c-4b59-a95b-fd42fe3eebea tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:05.104601 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-6225f69e-1b90-43e5-ad38-3a8205fecee1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:05.173992 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-6225f69e-1b90-43e5-ad38-3a8205fecee1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:05.195719 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0782a75-1d4b-4ff7-97c7-6c4924d86e08 req-1a4a4a90-b945-4861-b822-6ed48876dc55 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:05.199301 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a0782a75-1d4b-4ff7-97c7-6c4924d86e08 req-1a4a4a90-b945-4861-b822-6ed48876dc55 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 945 time: 0.3186777
Jun 03 08:36:05.273476 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-a613720f-dc64-4ec6-a368-b96ceabc74b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:05.415650 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a0782a75-1d4b-4ff7-97c7-6c4924d86e08 req-bc06980a-2806-4ce8-a5c2-07efed4bd411 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2095783
Jun 03 08:36:05.464032 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-71ea61d5-797f-42df-9337-f885920edff0 req-8b91234d-755c-4b59-a95b-fd42fe3eebea tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:05.464400 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-71ea61d5-797f-42df-9337-f885920edff0 req-8b91234d-755c-4b59-a95b-fd42fe3eebea tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16327919'] for floatingip, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:05.472529 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.db.l3_db [req-71ea61d5-797f-42df-9337-f885920edff0 req-8b91234d-755c-4b59-a95b-fd42fe3eebea tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Floating IP 6175662d-b2ef-45f8-ada4-07ee4d1d828f disassociated. External IP: 172.27.0.237, port: 19f733be-bd85-43df-86fd-5a9c617b3df4.
Jun 03 08:36:05.472529 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-71ea61d5-797f-42df-9337-f885920edff0 req-8b91234d-755c-4b59-a95b-fd42fe3eebea tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Calling delete_port for 19f733be-bd85-43df-86fd-5a9c617b3df4 owned by compute:nova {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:36:05.549151 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-6225f69e-1b90-43e5-ad38-3a8205fecee1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:05.554181 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-ce5a7ac0-cdab-458f-a357-ac5bfa1b8c9e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:05.577440 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6225f69e-1b90-43e5-ad38-3a8205fecee1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=548f6ffb-55f0-4e53-89ee-7d877c658fda,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:05.582400 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-6225f69e-1b90-43e5-ad38-3a8205fecee1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:05.673016 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-6225f69e-1b90-43e5-ad38-3a8205fecee1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:05.678580 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-6225f69e-1b90-43e5-ad38-3a8205fecee1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "DELETE /v2.0/security-groups/548f6ffb-55f0-4e53-89ee-7d877c658fda HTTP/1.1" status: 204  len: 168 time: 0.8083401
Jun 03 08:36:05.678580 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 52976) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:05.695445 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.api.v2.resource [None req-56b59e3d-6adc-40b1-90c3-04db83533977 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] show failed (client error): The resource could not be found.
Jun 03 08:36:05.696550 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-56b59e3d-6adc-40b1-90c3-04db83533977 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups/548f6ffb-55f0-4e53-89ee-7d877c658fda HTTP/1.1" status: 404  len: 347 time: 0.0178266
Jun 03 08:36:05.699862 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 52978) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:05.763111 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-71ea61d5-797f-42df-9337-f885920edff0 req-8b91234d-755c-4b59-a95b-fd42fe3eebea tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:05.776881 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-d149a831-620d-4758-8637-4b05609da202 tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:05.801363 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08e90bf3-ffe5-4f76-b8ec-dc8e923cd8ca req-dc5937c9-5c36-4659-b3de-e894ae4562d3 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:05.802978 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-08e90bf3-ffe5-4f76-b8ec-dc8e923cd8ca req-dc5937c9-5c36-4659-b3de-e894ae4562d3 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.1940789
Jun 03 08:36:05.863846 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-08e90bf3-ffe5-4f76-b8ec-dc8e923cd8ca req-c5158731-ab6a-4e29-8556-ef639396b34f tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0546918
Jun 03 08:36:05.892431 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b91234d-755c-4b59-a95b-fd42fe3eebea tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Pushing event deleted for resources: {'Port': ['ID=19f733be-bd85-43df-86fd-5a9c617b3df4,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:05.901569 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-8b91234d-755c-4b59-a95b-fd42fe3eebea tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:06.226057 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:06.248848 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-7f4b5042-f722-41ff-ad97-22e45d28a8fc tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Deleting port d889b1e4-520a-45ff-a1c2-e0155186650d {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:36:06.249187 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7f4b5042-f722-41ff-ad97-22e45d28a8fc tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:06.274475 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [req-71ea61d5-797f-42df-9337-f885920edff0 req-8b91234d-755c-4b59-a95b-fd42fe3eebea tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Router a4b01ad1-d952-4deb-88df-6930ad4824db has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:36:06.533683 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7f4b5042-f722-41ff-ad97-22e45d28a8fc tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:06.534026 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7f4b5042-f722-41ff-ad97-22e45d28a8fc tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:06.717358 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-0646d1d3-41f8-4c58-8721-0a44a84e5412 req-15700b6f-2c61-46aa-a29a-4e193e71e972 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Synchronizing usage tracker for tenant:755371c3d9de4747a47ba62e4d101829 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:36:06.729057 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-7f4b5042-f722-41ff-ad97-22e45d28a8fc tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Calling delete_port for d889b1e4-520a-45ff-a1c2-e0155186650d owned by network:floatingip {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:36:06.752243 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-71ea61d5-797f-42df-9337-f885920edff0 req-8b91234d-755c-4b59-a95b-fd42fe3eebea tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:36:06.765060 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e86c6a2-12b6-48ab-b128-3587ac480ce4 None None] Sync routers for ids ['a4b01ad1-d952-4deb-88df-6930ad4824db'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:36:06.775855 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e86c6a2-12b6-48ab-b128-3587ac480ce4 None None] Routers {'a4b01ad1-d952-4deb-88df-6930ad4824db'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:36:06.776756 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-5e86c6a2-12b6-48ab-b128-3587ac480ce4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86fb32b0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:36:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['a4b01ad1-d952-4deb-88df-6930ad4824db'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:36:06.849188 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-71ea61d5-797f-42df-9337-f885920edff0 req-8b91234d-755c-4b59-a95b-fd42fe3eebea tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] No DVR routers for this DVR port 19f733be-bd85-43df-86fd-5a9c617b3df4 on host hv-cinder-78726 {{(pid=92323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:36:06.852157 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-0646d1d3-41f8-4c58-8721-0a44a84e5412 req-15700b6f-2c61-46aa-a29a-4e193e71e972 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Unset dirty status for tenant:755371c3d9de4747a47ba62e4d101829 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:36:06.853328 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0646d1d3-41f8-4c58-8721-0a44a84e5412 req-15700b6f-2c61-46aa-a29a-4e193e71e972 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 210 time: 0.3118699
Jun 03 08:36:06.854360 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-71ea61d5-797f-42df-9337-f885920edff0 req-8b91234d-755c-4b59-a95b-fd42fe3eebea tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:06.856170 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-71ea61d5-797f-42df-9337-f885920edff0 req-8b91234d-755c-4b59-a95b-fd42fe3eebea tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.55 "DELETE /v2.0/ports/19f733be-bd85-43df-86fd-5a9c617b3df4 HTTP/1.1" status: 204  len: 173 time: 2.2579291
Jun 03 08:36:06.857825 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '86bd903e-c2b5-4452-bc75-39a347cba9db', 'name': 'network-vif-deleted', 'tag': '19f733be-bd85-43df-86fd-5a9c617b3df4'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:36:06.860320 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9f176828-b51e-444d-b730-d33271dc8c17" -d '{"events": [{"server_uuid": "86bd903e-c2b5-4452-bc75-39a347cba9db", "name": "network-vif-deleted", "tag": "19f733be-bd85-43df-86fd-5a9c617b3df4"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:36:07.002422 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-5e86c6a2-12b6-48ab-b128-3587ac480ce4 None None] Set router a4b01ad1-d952-4deb-88df-6930ad4824db gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:36:07.033443 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:36:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-00f2d52b-35d3-4d74-b1a2-6456e04165a2 x-openstack-request-id: req-00f2d52b-35d3-4d74-b1a2-6456e04165a2 {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:36:07.033799 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "86bd903e-c2b5-4452-bc75-39a347cba9db", "name": "network-vif-deleted", "tag": "19f733be-bd85-43df-86fd-5a9c617b3df4", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:36:07.035623 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-00f2d52b-35d3-4d74-b1a2-6456e04165a2 {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:36:07.035623 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '86bd903e-c2b5-4452-bc75-39a347cba9db', 'name': 'network-vif-deleted', 'tag': '19f733be-bd85-43df-86fd-5a9c617b3df4', 'status': 'completed', 'code': 200}
Jun 03 08:36:07.056749 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7f4b5042-f722-41ff-ad97-22e45d28a8fc tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:07.061285 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-2846eee4-0eaf-42d3-8f04-da05f5d66cdf tempest-VolumesActionsTest-779929254 tempest-VolumesActionsTest-779929254-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:07.142147 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f4b5042-f722-41ff-ad97-22e45d28a8fc tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Pushing event deleted for resources: {'Port': ['ID=d889b1e4-520a-45ff-a1c2-e0155186650d,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:07.150460 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-7f4b5042-f722-41ff-ad97-22e45d28a8fc tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:07.209535 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eabd55a-fecf-4aa6-80c0-bfaf0d4fb2a4 req-dbf66834-7e5b-49c3-a979-ff750da34d7d tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:07.211096 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0eabd55a-fecf-4aa6-80c0-bfaf0d4fb2a4 req-dbf66834-7e5b-49c3-a979-ff750da34d7d tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.2199912
Jun 03 08:36:07.266096 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7f4b5042-f722-41ff-ad97-22e45d28a8fc tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for floatingip, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:07.284276 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0eabd55a-fecf-4aa6-80c0-bfaf0d4fb2a4 req-5184ba16-a2a9-466c-a3bd-f92b4a3b022c tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0639064
Jun 03 08:36:07.370704 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-5e86c6a2-12b6-48ab-b128-3587ac480ce4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86fb32b0>, [{'id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'name': 'tempest-AttachVolumeTestJSON-1767133114-router', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241'}], 'enable_snat': True}, 'gw_port_id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:38Z', 'updated_at': '2021-06-03T08:30:51Z', 'revision_number': 4, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'gw_port': {'id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:65:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '09aff824-d423-4557-8913-463e6f53d3e5', 'name': '', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'mac_address': 'fa:16:3e:c4:92:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_interface', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:47Z', 'updated_at': '2021-06-03T08:31:05Z', 'revision_number': 5, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'subnets': [{'id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:36:07.374792 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e86c6a2-12b6-48ab-b128-3587ac480ce4 None None] Checking router: a4b01ad1-d952-4deb-88df-6930ad4824db for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:36:07.382276 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7f4b5042-f722-41ff-ad97-22e45d28a8fc tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for floatingip, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:07.383483 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-7f4b5042-f722-41ff-ad97-22e45d28a8fc tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "DELETE /v2.0/floatingips/4ac13f19-aae2-4b91-8bfd-97e4db2bcc6b HTTP/1.1" status: 204  len: 168 time: 1.6825523
Jun 03 08:36:07.384509 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e86c6a2-12b6-48ab-b128-3587ac480ce4 None None] Routers {'a4b01ad1-d952-4deb-88df-6930ad4824db'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:36:07.385123 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-5e86c6a2-12b6-48ab-b128-3587ac480ce4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86fb32b0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:36:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['a4b01ad1-d952-4deb-88df-6930ad4824db'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:36:07.575836 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-5e86c6a2-12b6-48ab-b128-3587ac480ce4 None None] Set router a4b01ad1-d952-4deb-88df-6930ad4824db gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:36:07.833426 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 53002) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:07.837276 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-a6a497f3-9e7c-4427-b45e-0194628d490c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1989062797', 'description': 'tempest-description--449736274'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:36:07.843411 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-a6a497f3-9e7c-4427-b45e-0194628d490c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:36:07.848076 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-a6a497f3-9e7c-4427-b45e-0194628d490c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Usage tracker for resource:security_group and tenant:36c42f532cd14f19811ffbee3a39a208 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:36:07.850992 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-a6a497f3-9e7c-4427-b45e-0194628d490c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:36:07.856689 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-a6a497f3-9e7c-4427-b45e-0194628d490c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:36:07.881222 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 19f733be-bd85-43df-86fd-5a9c617b3df4 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:36:07.944749 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] No Port match for: 19f733be-bd85-43df-86fd-5a9c617b3df4 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:36:07.945108 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 19f733be-bd85-43df-86fd-5a9c617b3df4 not bound to the agent host hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:36:07.945545 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:36:07.953130 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a6a497f3-9e7c-4427-b45e-0194628d490c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:07.975485 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-a6a497f3-9e7c-4427-b45e-0194628d490c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:36:07.979764 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-a6a497f3-9e7c-4427-b45e-0194628d490c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Usage tracker for resource:security_group_rule and tenant:36c42f532cd14f19811ffbee3a39a208 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:36:07.983130 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-a6a497f3-9e7c-4427-b45e-0194628d490c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:36:07.989916 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-a6a497f3-9e7c-4427-b45e-0194628d490c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:36:07.996140 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] No Port match for: 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:36:07.996500 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 7edf21a6-fd0e-4d5d-aeb2-3ceffee92e97 not bound to the agent host hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:36:08.004063 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-5e86c6a2-12b6-48ab-b128-3587ac480ce4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86fb32b0>, [{'id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'name': 'tempest-AttachVolumeTestJSON-1767133114-router', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241'}], 'enable_snat': True}, 'gw_port_id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:38Z', 'updated_at': '2021-06-03T08:30:51Z', 'revision_number': 4, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'gw_port': {'id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:65:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '09aff824-d423-4557-8913-463e6f53d3e5', 'name': '', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'mac_address': 'fa:16:3e:c4:92:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_interface', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:47Z', 'updated_at': '2021-06-03T08:31:05Z', 'revision_number': 5, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'subnets': [{'id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:36:08.008148 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e86c6a2-12b6-48ab-b128-3587ac480ce4 None None] The sync data for ids ['a4b01ad1-d952-4deb-88df-6930ad4824db'] in dv-cinder-787262-5-iscsi is: [{'id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'name': 'tempest-AttachVolumeTestJSON-1767133114-router', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241'}], 'enable_snat': True}, 'gw_port_id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:38Z', 'updated_at': '2021-06-03T08:30:51Z', 'revision_number': 4, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'gw_port': {'id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:65:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '09aff824-d423-4557-8913-463e6f53d3e5', 'name': '', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'mac_address': 'fa:16:3e:c4:92:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_interface', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:47Z', 'updated_at': '2021-06-03T08:31:05Z', 'revision_number': 5, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'subnets': [{'id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:36:08.053239 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2f24bbc8-3fb6-4e45-867b-fd0c839e3fd8 req-86c670cf-a1ab-4d6e-9dc7-310a05566ed9 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 210 time: 0.0578012
Jun 03 08:36:08.107324 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:08.119669 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a6a497f3-9e7c-4427-b45e-0194628d490c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:08.198751 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a6a497f3-9e7c-4427-b45e-0194628d490c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:08.202672 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-6d33dcad-e82b-4193-b499-ab8443c780b2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:08.230816 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8b382f6-2efc-4077-bb6b-d155d4c4a0da None None] New status for floating IP 6175662d-b2ef-45f8-ada4-07ee4d1d828f: DOWN {{(pid=92326) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 03 08:36:08.246989 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6a497f3-9e7c-4427-b45e-0194628d490c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Pushing event updated for resources: {'SecurityGroup': ['ID=98e250d0-0941-4a9a-af9c-14f7797b1b84,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:08.251205 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a6a497f3-9e7c-4427-b45e-0194628d490c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:08.319307 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a6a497f3-9e7c-4427-b45e-0194628d490c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:08.320969 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-a6a497f3-9e7c-4427-b45e-0194628d490c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 0.4869993
Jun 03 08:36:08.323714 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 53014) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:08.328396 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-8efe3409-7da6-4817-9172-7e6698b6e974 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Request body: {'security_group_rule': {'security_group_id': '98e250d0-0941-4a9a-af9c-14f7797b1b84', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:36:08.334874 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-8efe3409-7da6-4817-9172-7e6698b6e974 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:36:08.339042 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-8efe3409-7da6-4817-9172-7e6698b6e974 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Usage tracker for resource:security_group_rule and tenant:36c42f532cd14f19811ffbee3a39a208 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:36:08.342085 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-8efe3409-7da6-4817-9172-7e6698b6e974 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:36:08.349299 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-8efe3409-7da6-4817-9172-7e6698b6e974 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:36:08.490797 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4546f47e-15bf-4b21-b343-46a7a62b0223 req-ac3d8bb6-cc92-4d93-841c-d2e0b09e5afd tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:08.492304 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-4546f47e-15bf-4b21-b343-46a7a62b0223 req-ac3d8bb6-cc92-4d93-841c-d2e0b09e5afd tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.0840213
Jun 03 08:36:08.540956 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-4546f47e-15bf-4b21-b343-46a7a62b0223 req-3cbf8ad0-c30a-4887-9c79-afe267bafd2c tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0428770
Jun 03 08:36:08.604576 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8efe3409-7da6-4817-9172-7e6698b6e974 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:08.669048 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8efe3409-7da6-4817-9172-7e6698b6e974 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:08.776138 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8efe3409-7da6-4817-9172-7e6698b6e974 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:08.784409 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-6c0ae267-6ef9-49e1-815c-c31212947051 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:08.803386 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8efe3409-7da6-4817-9172-7e6698b6e974 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=62dd2598-eab5-46e1-af82-679d3124071a,revision_number=0']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:08.805841 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-8efe3409-7da6-4817-9172-7e6698b6e974 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:08.879344 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8efe3409-7da6-4817-9172-7e6698b6e974 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:08.880477 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-8efe3409-7da6-4817-9172-7e6698b6e974 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.5558600
Jun 03 08:36:08.883140 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 53016) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:08.887516 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-fcf793b2-9a00-4620-9a54-064e3da6ed98 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Request body: {'security_group_rule': {'security_group_id': '98e250d0-0941-4a9a-af9c-14f7797b1b84', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:36:08.894007 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-fcf793b2-9a00-4620-9a54-064e3da6ed98 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:36:08.897899 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-fcf793b2-9a00-4620-9a54-064e3da6ed98 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Usage tracker for resource:security_group_rule and tenant:36c42f532cd14f19811ffbee3a39a208 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:36:08.900756 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-fcf793b2-9a00-4620-9a54-064e3da6ed98 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:36:08.906404 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-fcf793b2-9a00-4620-9a54-064e3da6ed98 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:36:08.981818 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-fcf793b2-9a00-4620-9a54-064e3da6ed98 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:09.049043 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-fcf793b2-9a00-4620-9a54-064e3da6ed98 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:09.130256 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-fcf793b2-9a00-4620-9a54-064e3da6ed98 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:09.132266 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:09.158238 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcf793b2-9a00-4620-9a54-064e3da6ed98 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=72c01d4e-fcff-4c3e-9488-7b7bc301e3ea,revision_number=0']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:09.163433 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-fcf793b2-9a00-4620-9a54-064e3da6ed98 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:09.241819 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-80e85444-3929-4b76-8dd6-21768ec488d6 req-5f493103-61f4-43b3-994f-fbbb89553120 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 210 time: 0.0518584
Jun 03 08:36:09.242708 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-fcf793b2-9a00-4620-9a54-064e3da6ed98 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:09.243777 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-fcf793b2-9a00-4620-9a54-064e3da6ed98 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.3597453
Jun 03 08:36:09.249756 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 53030) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:09.255060 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Request body: {'floatingip': {'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:36:09.262948 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:36:09.268220 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Usage tracker for resource:floatingip and tenant:36c42f532cd14f19811ffbee3a39a208 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:36:09.271308 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:36:09.277346 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:36:09.387505 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for floatingip, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:09.604540 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:09.730984 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e59331dd-2f96-493e-bd8b-465ef6c90494 req-ebf67677-a61d-47e7-b894-9e8b303540fc tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:09.732362 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e59331dd-2f96-493e-bd8b-465ef6c90494 req-ebf67677-a61d-47e7-b894-9e8b303540fc tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.0795720
Jun 03 08:36:09.743829 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Allocated IP 172.27.0.166 (684ef871-89aa-450d-ae0d-e232bfaf51fb/e7b58fba-1ed5-483b-b341-7736b2ffb853/e8d7eb7e-5f0b-4c0e-bc57-29125096cfca) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:36:09.784729 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e59331dd-2f96-493e-bd8b-465ef6c90494 req-9978935f-929a-4283-98e9-37bd07fe280e tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0456758
Jun 03 08:36:09.890755 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:09.994088 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:09.998810 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-0e5919bf-af98-4c5f-97f6-2ac6f7e2d0f6 tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:10.059075 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:36:10.061941 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:36:10.066556 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:36:10.130222 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Pushing event updated for resources: {'Port': ['ID=e8d7eb7e-5f0b-4c0e-bc57-29125096cfca,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:10.138281 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:10.222456 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:10.422863 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c16dae54-65dd-48c5-9472-7451604d83f9 req-7e295b85-69d6-4986-92d8-35451fd02205 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 210 time: 0.0508142
Jun 03 08:36:10.431375 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:10.658756 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:10.964455 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14211294'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:10.970475 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-2f34226a-c8fb-4041-ad62-2c3972e3caec admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:10.982064 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86e923b6-a7dd-4a6b-8483-3bce03607adb req-d2ed8c1c-a4df-41ce-aed0-3536f37f84f1 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:10.983008 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-86e923b6-a7dd-4a6b-8483-3bce03607adb req-d2ed8c1c-a4df-41ce-aed0-3536f37f84f1 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.0835049
Jun 03 08:36:11.040762 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-86e923b6-a7dd-4a6b-8483-3bce03607adb req-715223fc-eb25-477f-96bc-b06b226f8b51 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0508506
Jun 03 08:36:11.089019 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Pushing event updated for resources: {'Port': ['ID=e8d7eb7e-5f0b-4c0e-bc57-29125096cfca,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:11.093863 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:11.102392 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16327919'] for floatingip, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:11.227819 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for floatingip, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:11.234117 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 1.9782870
Jun 03 08:36:11.460312 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-806c5453-9e81-468c-bef7-c80640dce3d8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Synchronizing usage tracker for tenant:36c42f532cd14f19811ffbee3a39a208 on resource:security_group {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:36:11.530063 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-806c5453-9e81-468c-bef7-c80640dce3d8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Unset dirty status for tenant:36c42f532cd14f19811ffbee3a39a208 on resource:security_group {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:36:11.531311 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-806c5453-9e81-468c-bef7-c80640dce3d8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-securitygroup--1989062797&fields=id&tenant_id=36c42f532cd14f19811ffbee3a39a208 HTTP/1.1" status: 200  len: 267 time: 0.1130586
Jun 03 08:36:11.588751 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-bf85e899-133f-4967-aeb3-d612d8c899d1 req-d1a4d8f1-427f-4c32-9abc-9b8eff6ffa2a tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 210 time: 0.0447137
Jun 03 08:36:11.686146 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-49d0e77b-2f99-425d-8d9d-63009de0dcaa tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:11.687628 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-49d0e77b-2f99-425d-8d9d-63009de0dcaa tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/networks?id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba HTTP/1.1" status: 200  len: 817 time: 0.1485736
Jun 03 08:36:11.703271 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-2b42e529-3416-4412-8cad-e1584968d5f3 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/quotas/36c42f532cd14f19811ffbee3a39a208 HTTP/1.1" status: 200  len: 375 time: 0.0095079
Jun 03 08:36:11.790426 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-50ae5512-0003-4030-9a53-d5f8be68cb62 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Synchronizing usage tracker for tenant:36c42f532cd14f19811ffbee3a39a208 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:36:11.873463 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-50ae5512-0003-4030-9a53-d5f8be68cb62 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Unset dirty status for tenant:36c42f532cd14f19811ffbee3a39a208 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:36:11.874738 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-50ae5512-0003-4030-9a53-d5f8be68cb62 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=36c42f532cd14f19811ffbee3a39a208&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1649308
Jun 03 08:36:12.082065 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-370d4c43-3f65-48f5-a0c0-4d7f90e377c7 service neutron] 10.222.0.11 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1944082
Jun 03 08:36:12.229871 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-d22ffe7b-840c-4c17-a207-f169d03dbcde service neutron] 10.222.0.11 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1466975
Jun 03 08:36:12.251326 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-754de4e2-0970-4e08-8fec-8b83fbbdfe0c req-ae64c3d4-7195-4556-a013-ad694a10b75c tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:12.252892 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-754de4e2-0970-4e08-8fec-8b83fbbdfe0c req-ae64c3d4-7195-4556-a013-ad694a10b75c tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.0888071
Jun 03 08:36:12.314316 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-754de4e2-0970-4e08-8fec-8b83fbbdfe0c req-56bfdb72-62a7-44bd-891b-0821e86e46bb tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0529366
Jun 03 08:36:12.524972 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b2e4e886-cb66-4df0-89f4-6f061d801b03 req-62d4730f-36eb-4fa8-b1cc-a271a7813d19 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 210 time: 0.0454278
Jun 03 08:36:12.861350 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9e4cdcdd-35bf-469c-8a24-202df1510f95 req-515b149f-d762-4e32-80c0-0f0fe4213e71 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=86bd903e-c2b5-4452-bc75-39a347cba9db HTTP/1.1" status: 200  len: 210 time: 0.1410444
Jun 03 08:36:13.537400 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca3d698a-8666-4c23-bb77-a66dc5c0d2e4 req-7b552900-5bdd-48e3-a355-62f15279e847 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:13.538924 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ca3d698a-8666-4c23-bb77-a66dc5c0d2e4 req-7b552900-5bdd-48e3-a355-62f15279e847 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.0912342
Jun 03 08:36:13.594328 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ca3d698a-8666-4c23-bb77-a66dc5c0d2e4 req-44a02298-2839-4934-96db-0ac597cf57d1 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0457988
Jun 03 08:36:13.704668 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-41642b25-7e87-4c16-81c9-6b0094401d34 req-b342da4a-13c0-4608-9d8f-57308d584303 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 210 time: 0.0553396
Jun 03 08:36:14.074827 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 53124) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:14.138431 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4449fcc4-dcd0-4808-88dc-80ddd55efcdf tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:14.169126 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4449fcc4-dcd0-4808-88dc-80ddd55efcdf tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:14.286307 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4449fcc4-dcd0-4808-88dc-80ddd55efcdf tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:14.291913 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b7d71af1-c0ac-4799-84c1-4a84af7d75fe tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:14.307238 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4449fcc4-dcd0-4808-88dc-80ddd55efcdf tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:14.309886 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-4449fcc4-dcd0-4808-88dc-80ddd55efcdf tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:14.404444 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4449fcc4-dcd0-4808-88dc-80ddd55efcdf tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:14.405684 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-4449fcc4-dcd0-4808-88dc-80ddd55efcdf tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "DELETE /v2.0/security-groups/ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7 HTTP/1.1" status: 204  len: 168 time: 0.3296926
Jun 03 08:36:14.408718 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 53134) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:14.425402 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.api.v2.resource [None req-50be7b5a-4a5f-47f3-afe4-f20559bd7879 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] show failed (client error): The resource could not be found.
Jun 03 08:36:14.426568 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-50be7b5a-4a5f-47f3-afe4-f20559bd7879 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups/ff4ac5bc-2355-40e0-bc55-3a2a6144b7d7 HTTP/1.1" status: 404  len: 347 time: 0.0166702
Jun 03 08:36:14.429812 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 53136) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:14.682287 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-679147f8-ffab-4dc2-b53d-06a632fb5784 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Deleting port 03327af9-40af-442d-a5f1-adb5c39cb86a {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:36:14.682563 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-679147f8-ffab-4dc2-b53d-06a632fb5784 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:14.825389 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-679147f8-ffab-4dc2-b53d-06a632fb5784 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:14.826825 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-679147f8-ffab-4dc2-b53d-06a632fb5784 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:14.843495 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b66d2f0-402c-4666-ae3c-9f1133bbd393 req-a8b2af33-994d-4164-83eb-8cee90d49f40 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:14.845630 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0b66d2f0-402c-4666-ae3c-9f1133bbd393 req-a8b2af33-994d-4164-83eb-8cee90d49f40 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.1183162
Jun 03 08:36:14.898021 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0b66d2f0-402c-4666-ae3c-9f1133bbd393 req-7a90cb56-8c4f-4c71-a717-1917d05d28ca tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0465040
Jun 03 08:36:14.996325 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-679147f8-ffab-4dc2-b53d-06a632fb5784 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Calling delete_port for 03327af9-40af-442d-a5f1-adb5c39cb86a owned by network:floatingip {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:36:15.006405 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ca6acafd-76c5-48be-bb9a-a39b7ffdafb8 req-15830b3c-8a97-4b47-9826-ab8c2529a9ef tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 210 time: 0.1182678
Jun 03 08:36:15.187220 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-679147f8-ffab-4dc2-b53d-06a632fb5784 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:15.191018 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:15.234176 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-679147f8-ffab-4dc2-b53d-06a632fb5784 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Pushing event deleted for resources: {'Port': ['ID=03327af9-40af-442d-a5f1-adb5c39cb86a,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:15.237783 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-679147f8-ffab-4dc2-b53d-06a632fb5784 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:15.326912 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-679147f8-ffab-4dc2-b53d-06a632fb5784 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for floatingip, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:15.410753 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-679147f8-ffab-4dc2-b53d-06a632fb5784 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for floatingip, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:15.411897 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-679147f8-ffab-4dc2-b53d-06a632fb5784 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "DELETE /v2.0/floatingips/6175662d-b2ef-45f8-ada4-07ee4d1d828f HTTP/1.1" status: 204  len: 168 time: 0.9810960
Jun 03 08:36:15.993138 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 53158) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:15.998357 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-02f75687-fc25-43cf-9060-ba9bfe17a4c0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1059874133', 'description': 'tempest-description--6171451'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:36:16.007215 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-02f75687-fc25-43cf-9060-ba9bfe17a4c0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:36:16.011683 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-02f75687-fc25-43cf-9060-ba9bfe17a4c0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Usage tracker for resource:security_group and tenant:755371c3d9de4747a47ba62e4d101829 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:36:16.016884 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-02f75687-fc25-43cf-9060-ba9bfe17a4c0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:36:16.023026 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-02f75687-fc25-43cf-9060-ba9bfe17a4c0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:36:16.108619 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-02f75687-fc25-43cf-9060-ba9bfe17a4c0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:16.113461 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76a1ff8c-b0d3-40a6-bf31-9deb83419075 req-84a82bcd-f04b-4ceb-91c9-406fda668396 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:16.115047 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-76a1ff8c-b0d3-40a6-bf31-9deb83419075 req-84a82bcd-f04b-4ceb-91c9-406fda668396 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.0853271
Jun 03 08:36:16.165049 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-76a1ff8c-b0d3-40a6-bf31-9deb83419075 req-5e4db926-af21-4d1f-9546-4b2c6519ca25 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0435846
Jun 03 08:36:16.175314 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e7acbd16-4973-4f59-957f-bbc68e8c610f req-2b9e0e6a-fb7f-4b9d-8790-056b6bac3c33 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 210 time: 0.0510254
Jun 03 08:36:16.179740 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-02f75687-fc25-43cf-9060-ba9bfe17a4c0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:36:16.183947 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-02f75687-fc25-43cf-9060-ba9bfe17a4c0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Usage tracker for resource:security_group_rule and tenant:755371c3d9de4747a47ba62e4d101829 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:36:16.187101 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-02f75687-fc25-43cf-9060-ba9bfe17a4c0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:36:16.194282 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-02f75687-fc25-43cf-9060-ba9bfe17a4c0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:36:16.268495 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-02f75687-fc25-43cf-9060-ba9bfe17a4c0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:16.341811 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-02f75687-fc25-43cf-9060-ba9bfe17a4c0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:16.346321 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9b38759a-d6e7-419b-be2b-bbf63ab76bde admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:16.408631 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02f75687-fc25-43cf-9060-ba9bfe17a4c0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f7460adc-d3b2-4e2f-9865-c9faf88a2da7,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:16.412295 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-02f75687-fc25-43cf-9060-ba9bfe17a4c0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:16.479262 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-02f75687-fc25-43cf-9060-ba9bfe17a4c0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:16.480547 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-02f75687-fc25-43cf-9060-ba9bfe17a4c0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1777 time: 0.4863608
Jun 03 08:36:16.483508 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 53162) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:16.488707 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-3f26b34c-7d1c-4f40-bc44-17258a34ea32 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Request body: {'security_group_rule': {'security_group_id': 'f7460adc-d3b2-4e2f-9865-c9faf88a2da7', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:36:16.494766 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-3f26b34c-7d1c-4f40-bc44-17258a34ea32 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:36:16.498846 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-3f26b34c-7d1c-4f40-bc44-17258a34ea32 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Usage tracker for resource:security_group_rule and tenant:755371c3d9de4747a47ba62e4d101829 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:36:16.502782 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-3f26b34c-7d1c-4f40-bc44-17258a34ea32 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:36:16.508583 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-3f26b34c-7d1c-4f40-bc44-17258a34ea32 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:36:16.581553 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-3f26b34c-7d1c-4f40-bc44-17258a34ea32 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:16.642250 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-3f26b34c-7d1c-4f40-bc44-17258a34ea32 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:16.737692 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-3f26b34c-7d1c-4f40-bc44-17258a34ea32 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:16.740760 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-5ae9c399-b242-4b62-b699-f942c94a5dae tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:16.767745 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f26b34c-7d1c-4f40-bc44-17258a34ea32 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1163676d-b6aa-4ab0-a2bf-d6da62cadabb,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:16.770760 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-3f26b34c-7d1c-4f40-bc44-17258a34ea32 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:16.850148 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-3f26b34c-7d1c-4f40-bc44-17258a34ea32 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:16.851359 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-3f26b34c-7d1c-4f40-bc44-17258a34ea32 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3669324
Jun 03 08:36:16.854092 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 53168) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:16.858635 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-36ee7e71-880b-4438-9ce3-a949bc412c24 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Request body: {'security_group_rule': {'security_group_id': 'f7460adc-d3b2-4e2f-9865-c9faf88a2da7', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:36:16.865239 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-36ee7e71-880b-4438-9ce3-a949bc412c24 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:36:16.869127 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-36ee7e71-880b-4438-9ce3-a949bc412c24 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Usage tracker for resource:security_group_rule and tenant:755371c3d9de4747a47ba62e4d101829 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:36:16.871977 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-36ee7e71-880b-4438-9ce3-a949bc412c24 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:36:16.877855 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-36ee7e71-880b-4438-9ce3-a949bc412c24 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:36:16.935610 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-36ee7e71-880b-4438-9ce3-a949bc412c24 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:16.995202 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-36ee7e71-880b-4438-9ce3-a949bc412c24 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:17.044548 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-36ee7e71-880b-4438-9ce3-a949bc412c24 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:17.046672 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:17.073909 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36ee7e71-880b-4438-9ce3-a949bc412c24 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3ac003e3-ad4f-4d33-acba-03267b40a4a6,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:17.076484 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-36ee7e71-880b-4438-9ce3-a949bc412c24 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:17.153051 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-36ee7e71-880b-4438-9ce3-a949bc412c24 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:17.154261 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-36ee7e71-880b-4438-9ce3-a949bc412c24 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.2991910
Jun 03 08:36:17.158030 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 53172) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:17.162779 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Request body: {'floatingip': {'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:36:17.169107 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:36:17.172952 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Usage tracker for resource:floatingip and tenant:755371c3d9de4747a47ba62e4d101829 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:36:17.175917 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:36:17.181862 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:36:17.285300 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for floatingip, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:17.350856 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b6656cae-0b12-4583-aa7e-0c5575e04155 req-d24db275-bc89-4fbb-a989-989dd4ea9cb8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 210 time: 0.0496185
Jun 03 08:36:17.364086 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f346469-a559-4d5d-88e2-deab7ebc4987 req-c28e63e7-e707-4d65-9ff2-fc7aa6582dba tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:17.365589 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5f346469-a559-4d5d-88e2-deab7ebc4987 req-c28e63e7-e707-4d65-9ff2-fc7aa6582dba tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.0868495
Jun 03 08:36:17.414838 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5f346469-a559-4d5d-88e2-deab7ebc4987 req-488dbeca-3665-47ba-b15a-8f1e8757ded5 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0424204
Jun 03 08:36:17.472607 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:17.609292 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.db_base_plugin_common [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Allocated IP 172.27.0.151 (684ef871-89aa-450d-ae0d-e232bfaf51fb/e7b58fba-1ed5-483b-b341-7736b2ffb853/835aedf4-779c-4bfc-b8d2-2d5a43b181d3) {{(pid=92324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:36:17.756398 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for port, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:17.839247 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:17.843044 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-5d547bef-0730-44ae-be07-b8bd25acdcfa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:17.904574 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:36:17.907455 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:36:17.911177 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Received port after_create {{(pid=92324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:36:17.946014 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Pushing event updated for resources: {'Port': ['ID=835aedf4-779c-4bfc-b8d2-2d5a43b181d3,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:17.950417 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:17.997669 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:18.149528 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:18.435488 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for port, precommit_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:18.506252 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15641369'] for port, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:18.514817 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:18.553686 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-cf85a5c3-4680-4369-aa7e-98aec5a122ff req-3b54fae4-87c7-4d8e-bfe1-83114fbce1bf tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 210 time: 0.0890646
Jun 03 08:36:18.604728 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d19e88c1-272a-4510-9fa0-42cb1afefa50 req-f6fd8ca2-73c4-4d77-98fb-039f90f47bc1 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:18.606253 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d19e88c1-272a-4510-9fa0-42cb1afefa50 req-f6fd8ca2-73c4-4d77-98fb-039f90f47bc1 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.0836649
Jun 03 08:36:18.631386 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Pushing event updated for resources: {'Port': ['ID=835aedf4-779c-4bfc-b8d2-2d5a43b181d3,revision_number=2']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:18.634310 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:18.642410 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16327919'] for floatingip, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:18.660229 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d19e88c1-272a-4510-9fa0-42cb1afefa50 req-42d9936d-0b03-4214-aeaa-79ea99cbbbb8 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0475876
Jun 03 08:36:18.747650 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for floatingip, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:18.749008 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-7857743c-2f07-4f12-8606-015aa3187e14 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 1.5899940
Jun 03 08:36:18.917689 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-5214e191-77fb-4dfe-9b99-877aa91d0197 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Synchronizing usage tracker for tenant:755371c3d9de4747a47ba62e4d101829 on resource:security_group {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:36:18.987750 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-5214e191-77fb-4dfe-9b99-877aa91d0197 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Unset dirty status for tenant:755371c3d9de4747a47ba62e4d101829 on resource:security_group {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:36:18.988975 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-5214e191-77fb-4dfe-9b99-877aa91d0197 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-securitygroup--1059874133&fields=id&tenant_id=755371c3d9de4747a47ba62e4d101829 HTTP/1.1" status: 200  len: 267 time: 0.1136954
Jun 03 08:36:19.145422 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-da3c039a-740f-4ed5-bbce-c3ab4e31e424 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:19.146843 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-da3c039a-740f-4ed5-bbce-c3ab4e31e424 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/networks?id=020eaa43-2d59-46e1-8aec-0a688069f72b HTTP/1.1" status: 200  len: 811 time: 0.1507709
Jun 03 08:36:19.162176 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-47be8a20-b3b9-4ff3-b4ca-158e059be70a tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/quotas/755371c3d9de4747a47ba62e4d101829 HTTP/1.1" status: 200  len: 375 time: 0.0099273
Jun 03 08:36:19.256277 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-f526ae0e-1497-4c41-8652-c757b40e1292 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=755371c3d9de4747a47ba62e4d101829&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0885999
Jun 03 08:36:19.478843 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-ecaacfe9-7e8f-48ec-8598-4224e9ebf820 service neutron] 10.222.0.11 "GET /v2.0/networks/020eaa43-2d59-46e1-8aec-0a688069f72b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2099962
Jun 03 08:36:19.626235 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-42df11a4-43f8-4c43-8b89-3ad91b329c77 service neutron] 10.222.0.11 "GET /v2.0/networks/020eaa43-2d59-46e1-8aec-0a688069f72b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1380002
Jun 03 08:36:19.747460 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7f38648c-25d8-43ff-913e-b7db57b0e0ae req-242fbfdc-4150-4af1-bd96-378eb052fc1b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 210 time: 0.0626776
Jun 03 08:36:19.908988 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ab45dcd9-4cc0-4400-9d9b-59b25ab9e4ac req-c573a332-4829-4a8e-a760-3b1efb536429 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 210 time: 0.0732954
Jun 03 08:36:19.922322 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-b1dfff83-4413-4c17-ba49-9f7d09c27b29 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:19.922322 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-b1dfff83-4413-4c17-ba49-9f7d09c27b29 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.55 "GET /v2.0/networks?id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba HTTP/1.1" status: 200  len: 817 time: 0.2610507
Jun 03 08:36:20.076332 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-cb51a14d-35ed-4a04-8b38-a1a25a69de21 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.55 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=36c42f532cd14f19811ffbee3a39a208 HTTP/1.1" status: 200  len: 380 time: 0.1466351
Jun 03 08:36:20.087595 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-193fad95-fe7b-45ee-b04f-662eed462090 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Request body: {'port': {'device_id': '41d57543-e5c8-45b5-8eef-2f829250eec3', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'admin_state_up': True, 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'security_groups': ['98e250d0-0941-4a9a-af9c-14f7797b1b84']}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:36:20.195125 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ddfae12-165a-49cb-a6bb-2adbcdcce262 req-8eb59fa8-f297-48c7-8090-12b157c07c0e tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:20.196643 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9ddfae12-165a-49cb-a6bb-2adbcdcce262 req-8eb59fa8-f297-48c7-8090-12b157c07c0e tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.3252773
Jun 03 08:36:20.286321 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9ddfae12-165a-49cb-a6bb-2adbcdcce262 req-d5c95c63-5f38-4fb8-9853-86e73def6c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&id=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0829878
Jun 03 08:36:20.293516 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-193fad95-fe7b-45ee-b04f-662eed462090 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:36:20.305126 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-193fad95-fe7b-45ee-b04f-662eed462090 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:36:20.410391 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-193fad95-fe7b-45ee-b04f-662eed462090 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Made reservation on behalf of 36c42f532cd14f19811ffbee3a39a208 for: {'port': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:36:20.414285 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-193fad95-fe7b-45ee-b04f-662eed462090 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:20.586982 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-193fad95-fe7b-45ee-b04f-662eed462090 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Allocated IP 172.20.0.11 (958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba/cff67a13-bc33-4d3e-a796-5829103ca25c/1837d7d5-12fa-4414-9722-e593f5ed4c48) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:36:20.801432 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-193fad95-fe7b-45ee-b04f-662eed462090 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:20.818104 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-193fad95-fe7b-45ee-b04f-662eed462090 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Transition to ACTIVE for port object 1837d7d5-12fa-4414-9722-e593f5ed4c48 will not be triggered until provisioned by entity DHCP. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:36:20.908736 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f405eede-8c43-45ce-80c1-b941f735230d req-5f1db3df-f8e3-40dc-9083-fad6dbc0b6f3 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 210 time: 0.0456460
Jun 03 08:36:20.959101 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-193fad95-fe7b-45ee-b04f-662eed462090 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:20.964894 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:21.078546 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-193fad95-fe7b-45ee-b04f-662eed462090 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Network 958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:36:21.080820 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-36bab182-89ea-4bc2-84b9-458beb106c8f req-26fa5f3f-6d5b-465e-8a39-cfc9a36b4edf tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Synchronizing usage tracker for tenant:755371c3d9de4747a47ba62e4d101829 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:36:21.086773 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-193fad95-fe7b-45ee-b04f-662eed462090 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:36:21.091214 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-193fad95-fe7b-45ee-b04f-662eed462090 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:36:21.146014 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-193fad95-fe7b-45ee-b04f-662eed462090 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Pushing event updated for resources: {'Port': ['ID=1837d7d5-12fa-4414-9722-e593f5ed4c48,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:21.155446 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-193fad95-fe7b-45ee-b04f-662eed462090 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:21.190191 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-193fad95-fe7b-45ee-b04f-662eed462090 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:21.191021 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-193fad95-fe7b-45ee-b04f-662eed462090 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:21.228557 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-36bab182-89ea-4bc2-84b9-458beb106c8f req-26fa5f3f-6d5b-465e-8a39-cfc9a36b4edf tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Unset dirty status for tenant:755371c3d9de4747a47ba62e4d101829 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:36:21.229864 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-36bab182-89ea-4bc2-84b9-458beb106c8f req-26fa5f3f-6d5b-465e-8a39-cfc9a36b4edf tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 210 time: 0.2174733
Jun 03 08:36:21.319474 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-193fad95-fe7b-45ee-b04f-662eed462090 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.55 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.2358832
Jun 03 08:36:21.331477 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:36:21.410520 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-db2638a5-140f-406c-add3-47f93529f21a None None] Provisioning for port 1837d7d5-12fa-4414-9722-e593f5ed4c48 completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:36:21.415789 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-db2638a5-140f-406c-add3-47f93529f21a None None] Provisioning complete for port 1837d7d5-12fa-4414-9722-e593f5ed4c48 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:36:21.416164 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-db2638a5-140f-406c-add3-47f93529f21a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:21.511656 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-db2638a5-140f-406c-add3-47f93529f21a None None] Port 1837d7d5-12fa-4414-9722-e593f5ed4c48 cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:36:22.103214 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a2a949d-418b-412a-a060-e62d52f1bb17 req-68a1b8d5-f6d4-44b7-9a71-b907704e066c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:22.104702 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-1a2a949d-418b-412a-a060-e62d52f1bb17 req-68a1b8d5-f6d4-44b7-9a71-b907704e066c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 932 time: 0.0843074
Jun 03 08:36:22.151203 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-1a2a949d-418b-412a-a060-e62d52f1bb17 req-91a786a2-34ea-43ca-be33-48588e5a066b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0407939
Jun 03 08:36:22.386860 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2e12e1fb-ecf3-4848-9379-fa11492ccf43 req-13b07faf-39bd-4105-af87-8fcb1e678daf tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 210 time: 0.0479596
Jun 03 08:36:23.353007 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36a2f772-e734-4d2a-80f7-9b0a206e79c7 req-b9bda81e-b499-4739-94b9-58fe3aa74aab tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:23.354529 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-36a2f772-e734-4d2a-80f7-9b0a206e79c7 req-b9bda81e-b499-4739-94b9-58fe3aa74aab tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 932 time: 0.0883081
Jun 03 08:36:23.402589 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-36a2f772-e734-4d2a-80f7-9b0a206e79c7 req-ec366a8c-b4ed-475a-bd4f-421c1ecc31a0 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0423746
Jun 03 08:36:23.536127 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-69ce1164-9c86-4d07-b128-f7b8abe25f65 req-e68de278-2a5c-461c-bd53-795b3c7e0ee2 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 210 time: 0.0427313
Jun 03 08:36:23.679901 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Request body: {'port': {'device_id': '41d57543-e5c8-45b5-8eef-2f829250eec3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:36:23.794386 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:24.145082 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1837d7d5-12fa-4414-9722-e593f5ed4c48 {{(pid=92323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:36:24.152667 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:24.167774 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Transition to ACTIVE for port object 1837d7d5-12fa-4414-9722-e593f5ed4c48 will not be triggered until provisioned by entity L2. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:36:24.364615 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14211294'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:24.369408 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-e10f915c-000d-4fec-bbea-c8005cea1099 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:24.533747 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Pushing event updated for resources: {'Port': ['ID=1837d7d5-12fa-4414-9722-e593f5ed4c48,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:24.537248 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:24.627255 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Attempting to bind port 1837d7d5-12fa-4414-9722-e593f5ed4c48 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:36:24.627582 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Attempting to bind port 1837d7d5-12fa-4414-9722-e593f5ed4c48 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '377c6f4a-d9be-4dae-86db-35230d8009c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba'}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:36:24.634643 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Attempting to bind port 1837d7d5-12fa-4414-9722-e593f5ed4c48 on network 958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:36:24.634643 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Port 1837d7d5-12fa-4414-9722-e593f5ed4c48 on network 958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 03 08:36:24.634643 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Attempting to bind port 1837d7d5-12fa-4414-9722-e593f5ed4c48 on network 958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:36:24.641334 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Checking agent: {'id': '181c5753-100b-4f03-bda8-e34279b057f4', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'started_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 35, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:36:24.642274 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Checking segment: {'id': '377c6f4a-d9be-4dae-86db-35230d8009c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:36:24.642694 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Bound using segment: {'id': '377c6f4a-d9be-4dae-86db-35230d8009c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba'} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:36:24.643192 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Bound port: 1837d7d5-12fa-4414-9722-e593f5ed4c48, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '377c6f4a-d9be-4dae-86db-35230d8009c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 526, 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba'}}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:36:24.643543 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:24.649570 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75b1f2bf-8419-4c02-aee9-a510387bacf4 req-c688fc45-2355-469d-b3ad-1d1340d644c2 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:24.671189 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-75b1f2bf-8419-4c02-aee9-a510387bacf4 req-c688fc45-2355-469d-b3ad-1d1340d644c2 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 944 time: 0.1447730
Jun 03 08:36:24.732015 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-75b1f2bf-8419-4c02-aee9-a510387bacf4 req-2e582b5f-149f-4ab2-8fa8-1b5cd84ddc55 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0596564
Jun 03 08:36:24.869170 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-63228251-634b-4dfb-94fd-5dda36197860 req-7c37717a-841b-41c9-af98-88fa3868cfcb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 210 time: 0.1417680
Jun 03 08:36:24.881679 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] For port 1837d7d5-12fa-4414-9722-e593f5ed4c48, host hv-cinder-78726, cleared binding levels {{(pid=92323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:36:24.884810 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] For port 1837d7d5-12fa-4414-9722-e593f5ed4c48, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=1837d7d5-12fa-4414-9722-e593f5ed4c48,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:36:24.967749 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14211294'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:24.973122 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c83e0499-4682-4dc9-b360-f81f839d77dc tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:25.095442 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:25.096122 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:25.097388 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] 10.222.0.55 "PUT /v2.0/ports/1837d7d5-12fa-4414-9722-e593f5ed4c48 HTTP/1.1" status: 200  len: 1094 time: 1.4220369
Jun 03 08:36:25.097883 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '41d57543-e5c8-45b5-8eef-2f829250eec3', 'tag': '1837d7d5-12fa-4414-9722-e593f5ed4c48'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:36:25.100188 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4f96d900-4b23-4499-bae1-f521a91ed78b" -d '{"events": [{"name": "network-changed", "server_uuid": "41d57543-e5c8-45b5-8eef-2f829250eec3", "tag": "1837d7d5-12fa-4414-9722-e593f5ed4c48"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:36:25.149195 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Pushing event updated for resources: {'Port': ['ID=1837d7d5-12fa-4414-9722-e593f5ed4c48,revision_number=3']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:25.161440 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.188s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:25.169951 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-d929638d-ad71-44ea-a2dc-67250344f6de tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:25.171455 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-d929638d-ad71-44ea-a2dc-67250344f6de tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.55 "GET /v2.0/networks?id=020eaa43-2d59-46e1-8aec-0a688069f72b HTTP/1.1" status: 200  len: 811 time: 0.2469566
Jun 03 08:36:25.173708 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:36:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-96f011d1-945b-4958-a2d6-911e7358d87e x-openstack-request-id: req-96f011d1-945b-4958-a2d6-911e7358d87e {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:36:25.173938 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "41d57543-e5c8-45b5-8eef-2f829250eec3", "tag": "1837d7d5-12fa-4414-9722-e593f5ed4c48", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:36:25.174193 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-96f011d1-945b-4958-a2d6-911e7358d87e {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:36:25.174637 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '41d57543-e5c8-45b5-8eef-2f829250eec3', 'tag': '1837d7d5-12fa-4414-9722-e593f5ed4c48', 'status': 'completed', 'code': 200}
Jun 03 08:36:25.282620 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-25a7906e-9f4a-459f-8862-055820eab497 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Synchronizing usage tracker for tenant:755371c3d9de4747a47ba62e4d101829 on resource:security_group {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:36:25.307158 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-25a7906e-9f4a-459f-8862-055820eab497 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Unset dirty status for tenant:755371c3d9de4747a47ba62e4d101829 on resource:security_group {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:36:25.308272 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-25a7906e-9f4a-459f-8862-055820eab497 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.55 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=755371c3d9de4747a47ba62e4d101829 HTTP/1.1" status: 200  len: 380 time: 0.1156158
Jun 03 08:36:25.318622 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-b2ea83ef-5464-404b-8256-c70b0909f9eb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Request body: {'port': {'device_id': '02b21c4a-5207-45ed-b0dd-42675e4322a8', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'admin_state_up': True, 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'security_groups': ['f7460adc-d3b2-4e2f-9865-c9faf88a2da7']}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:36:25.361724 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f96d900-4b23-4499-bae1-f521a91ed78b req-9382e789-761b-48d3-9b22-4b9137ff5edc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:25.363121 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4f96d900-4b23-4499-bae1-f521a91ed78b req-9382e789-761b-48d3-9b22-4b9137ff5edc service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=36c42f532cd14f19811ffbee3a39a208&device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 1097 time: 0.1354458
Jun 03 08:36:25.567327 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-b2ea83ef-5464-404b-8256-c70b0909f9eb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:36:25.591454 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-b2ea83ef-5464-404b-8256-c70b0909f9eb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:36:25.599745 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f96d900-4b23-4499-bae1-f521a91ed78b req-6618ea28-e1c2-48fb-9f6d-4e0dbaef06bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:25.601199 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4f96d900-4b23-4499-bae1-f521a91ed78b req-6618ea28-e1c2-48fb-9f6d-4e0dbaef06bd service neutron] 10.222.0.55 "GET /v2.0/networks?tenant_id=36c42f532cd14f19811ffbee3a39a208&shared=False HTTP/1.1" status: 200  len: 918 time: 0.1925910
Jun 03 08:36:25.721728 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-b2ea83ef-5464-404b-8256-c70b0909f9eb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Made reservation on behalf of 755371c3d9de4747a47ba62e4d101829 for: {'port': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:36:25.729136 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-b2ea83ef-5464-404b-8256-c70b0909f9eb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:25.763338 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f96d900-4b23-4499-bae1-f521a91ed78b req-a43a9071-9809-4312-a42b-a44dfb8eeaa0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:25.780754 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4f96d900-4b23-4499-bae1-f521a91ed78b req-a43a9071-9809-4312-a42b-a44dfb8eeaa0 service neutron] 10.222.0.55 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1545029
Jun 03 08:36:26.034224 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-b2ea83ef-5464-404b-8256-c70b0909f9eb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Allocated IP 172.20.0.13 (020eaa43-2d59-46e1-8aec-0a688069f72b/5baf74c9-e686-40a5-b52f-f01da3bd1af9/9b84dcd4-a96a-49e0-9102-07b3ed50b805) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:36:26.041001 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-e5735a6f-0c19-47bc-a691-e3f63d83f3e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:26.042519 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-e5735a6f-0c19-47bc-a691-e3f63d83f3e9 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=36c42f532cd14f19811ffbee3a39a208&device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 1097 time: 0.2370760
Jun 03 08:36:26.043109 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0cba6cbf-4f41-4b4d-971d-8bda9a8c7801 req-2e7492f1-ba87-4b44-a6af-24af04d37aa9 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 210 time: 0.0436020
Jun 03 08:36:26.058166 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baeb1327-815d-412d-a018-56db079dd324 req-3c4e99cb-2241-41c4-84b5-9c5a7350f600 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:26.058905 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-baeb1327-815d-412d-a018-56db079dd324 req-3c4e99cb-2241-41c4-84b5-9c5a7350f600 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Synchronizing usage tracker for tenant:36c42f532cd14f19811ffbee3a39a208 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:36:26.079104 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:26.142705 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-364b8f27-5dbd-48aa-a081-27e612291729 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=1837d7d5-12fa-4414-9722-e593f5ed4c48 HTTP/1.1" status: 200  len: 217 time: 0.0796490
Jun 03 08:36:26.266305 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-baeb1327-815d-412d-a018-56db079dd324 req-3c4e99cb-2241-41c4-84b5-9c5a7350f600 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Unset dirty status for tenant:36c42f532cd14f19811ffbee3a39a208 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:36:26.267848 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-baeb1327-815d-412d-a018-56db079dd324 req-3c4e99cb-2241-41c4-84b5-9c5a7350f600 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 944 time: 0.4157069
Jun 03 08:36:26.321008 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-d1c6bdf8-b161-462e-9863-7b0e9bcef20f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:26.322420 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-d1c6bdf8-b161-462e-9863-7b0e9bcef20f service neutron] 10.222.0.55 "GET /v2.0/subnets?id=cff67a13-bc33-4d3e-a796-5829103ca25c HTTP/1.1" status: 200  len: 856 time: 0.1697130
Jun 03 08:36:26.440782 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-baeb1327-815d-412d-a018-56db079dd324 req-ebe087ea-6c4e-4ee0-9a10-4b6430e7dee0 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1262627
Jun 03 08:36:26.477520 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-b2ea83ef-5464-404b-8256-c70b0909f9eb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:26.498935 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-b2ea83ef-5464-404b-8256-c70b0909f9eb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Transition to ACTIVE for port object 9b84dcd4-a96a-49e0-9102-07b3ed50b805 will not be triggered until provisioned by entity DHCP. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:36:26.505263 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-1a4a7591-32ad-4730-b508-da18833322f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:26.506804 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-1a4a7591-32ad-4730-b508-da18833322f4 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1580453
Jun 03 08:36:26.696334 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-b2ea83ef-5464-404b-8256-c70b0909f9eb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:26.707949 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-9f3f0d39-f4f2-44f4-a90d-bfeb5e84ed6a tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:26.800173 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-b2ea83ef-5464-404b-8256-c70b0909f9eb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Network 020eaa43-2d59-46e1-8aec-0a688069f72b is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:36:26.807005 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-b2ea83ef-5464-404b-8256-c70b0909f9eb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:36:26.812761 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-b2ea83ef-5464-404b-8256-c70b0909f9eb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:36:26.843034 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2ea83ef-5464-404b-8256-c70b0909f9eb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Pushing event updated for resources: {'Port': ['ID=9b84dcd4-a96a-49e0-9102-07b3ed50b805,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:26.848173 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-2f267801-5222-4e71-850b-7d18ecdbd16f service neutron] 10.222.0.55 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3320529
Jun 03 08:36:26.852178 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b2ea83ef-5464-404b-8256-c70b0909f9eb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:26.968240 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-b2ea83ef-5464-404b-8256-c70b0909f9eb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:26.968907 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-b2ea83ef-5464-404b-8256-c70b0909f9eb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:27.024203 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ca36bb70-20fd-4eb7-bd77-e642f4bac1d3 req-332b5716-5fb8-47cf-87b5-e574a6e37d96 service neutron] 10.222.0.55 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1668084
Jun 03 08:36:27.107907 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-b2ea83ef-5464-404b-8256-c70b0909f9eb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.55 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.7930281
Jun 03 08:36:27.109278 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-88803022-f2a7-4c38-b474-34c3756572a4 None None] Provisioning for port 9b84dcd4-a96a-49e0-9102-07b3ed50b805 completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:36:27.114688 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-88803022-f2a7-4c38-b474-34c3756572a4 None None] Provisioning complete for port 9b84dcd4-a96a-49e0-9102-07b3ed50b805 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:36:27.116743 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-88803022-f2a7-4c38-b474-34c3756572a4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:27.121730 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Request body: {'port': {'device_id': '02b21c4a-5207-45ed-b0dd-42675e4322a8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:36:27.174768 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-88803022-f2a7-4c38-b474-34c3756572a4 None None] Port 9b84dcd4-a96a-49e0-9102-07b3ed50b805 cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:36:27.237885 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfa91bca-e807-4dc3-9399-c5f13ee95f8c req-e4721c5b-8548-4e78-940f-1115a3cdbad4 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:27.238441 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:27.239544 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-bfa91bca-e807-4dc3-9399-c5f13ee95f8c req-e4721c5b-8548-4e78-940f-1115a3cdbad4 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 932 time: 0.0846167
Jun 03 08:36:27.286747 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-bfa91bca-e807-4dc3-9399-c5f13ee95f8c req-66b0e360-f5c7-4281-ae37-2eb3ddbc4665 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=f7460adc-d3b2-4e2f-9865-c9faf88a2da7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0407774
Jun 03 08:36:27.629347 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9b84dcd4-a96a-49e0-9102-07b3ed50b805 {{(pid=92323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:36:27.637774 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:27.657943 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Transition to ACTIVE for port object 9b84dcd4-a96a-49e0-9102-07b3ed50b805 will not be triggered until provisioned by entity L2. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:36:27.673871 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21e8b8f8-7457-4b93-9ef5-fb4844bd16e4 req-4323ce6c-78a9-4673-9b86-21cfbfb78499 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:27.675361 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-21e8b8f8-7457-4b93-9ef5-fb4844bd16e4 req-4323ce6c-78a9-4673-9b86-21cfbfb78499 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 944 time: 0.1213193
Jun 03 08:36:27.722887 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-21e8b8f8-7457-4b93-9ef5-fb4844bd16e4 req-2962ebbb-aa9b-403a-95dc-859802d85536 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0412996
Jun 03 08:36:27.758683 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14211294'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:27.763648 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:27.922785 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Pushing event updated for resources: {'Port': ['ID=9b84dcd4-a96a-49e0-9102-07b3ed50b805,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:27.933922 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:28.004116 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Attempting to bind port 9b84dcd4-a96a-49e0-9102-07b3ed50b805 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:36:28.004455 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Attempting to bind port 9b84dcd4-a96a-49e0-9102-07b3ed50b805 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '56366949-8cc8-4cf3-b3eb-d458d3515059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 531, 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b'}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:36:28.004784 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Attempting to bind port 9b84dcd4-a96a-49e0-9102-07b3ed50b805 on network 020eaa43-2d59-46e1-8aec-0a688069f72b {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:36:28.009591 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Port 9b84dcd4-a96a-49e0-9102-07b3ed50b805 on network 020eaa43-2d59-46e1-8aec-0a688069f72b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 03 08:36:28.009910 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Attempting to bind port 9b84dcd4-a96a-49e0-9102-07b3ed50b805 on network 020eaa43-2d59-46e1-8aec-0a688069f72b {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:36:28.014979 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Checking agent: {'id': '181c5753-100b-4f03-bda8-e34279b057f4', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'started_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 36, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:36:28.015315 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Checking segment: {'id': '56366949-8cc8-4cf3-b3eb-d458d3515059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 531, 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:36:28.015695 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Bound using segment: {'id': '56366949-8cc8-4cf3-b3eb-d458d3515059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 531, 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b'} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:36:28.016165 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Bound port: 9b84dcd4-a96a-49e0-9102-07b3ed50b805, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '56366949-8cc8-4cf3-b3eb-d458d3515059', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 531, 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b'}}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:36:28.016735 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:28.128265 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] For port 9b84dcd4-a96a-49e0-9102-07b3ed50b805, host hv-cinder-78726, cleared binding levels {{(pid=92323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:36:28.131782 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] For port 9b84dcd4-a96a-49e0-9102-07b3ed50b805, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=9b84dcd4-a96a-49e0-9102-07b3ed50b805,segment=NetworkSegment(56366949-8cc8-4cf3-b3eb-d458d3515059),segment_id=56366949-8cc8-4cf3-b3eb-d458d3515059)] {{(pid=92323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:36:28.199015 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14211294'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:28.203721 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-6de2a1b2-a365-4103-a1ac-3bab11f216c1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:28.265149 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:28.265691 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:28.267846 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] 10.222.0.55 "PUT /v2.0/ports/9b84dcd4-a96a-49e0-9102-07b3ed50b805 HTTP/1.1" status: 200  len: 1094 time: 1.1509850
Jun 03 08:36:28.268431 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '02b21c4a-5207-45ed-b0dd-42675e4322a8', 'tag': '9b84dcd4-a96a-49e0-9102-07b3ed50b805'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:36:28.270755 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-69ecbaa9-111c-44be-87c5-821e634038ba" -d '{"events": [{"name": "network-changed", "server_uuid": "02b21c4a-5207-45ed-b0dd-42675e4322a8", "tag": "9b84dcd4-a96a-49e0-9102-07b3ed50b805"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:36:28.291205 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Pushing event updated for resources: {'Port': ['ID=9b84dcd4-a96a-49e0-9102-07b3ed50b805,revision_number=3']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:28.294323 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:28.320835 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:36:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e863b5a3-b045-4c9d-a489-cecd0e0a122d x-openstack-request-id: req-e863b5a3-b045-4c9d-a489-cecd0e0a122d {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:36:28.321107 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "02b21c4a-5207-45ed-b0dd-42675e4322a8", "tag": "9b84dcd4-a96a-49e0-9102-07b3ed50b805", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:36:28.321388 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-e863b5a3-b045-4c9d-a489-cecd0e0a122d {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:36:28.321812 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '02b21c4a-5207-45ed-b0dd-42675e4322a8', 'tag': '9b84dcd4-a96a-49e0-9102-07b3ed50b805', 'status': 'completed', 'code': 200}
Jun 03 08:36:28.487752 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11cac752-e0a8-488e-803e-3f4a52743831 req-37802358-140f-473a-a7d7-9b92cc223af9 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:28.488447 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-11cac752-e0a8-488e-803e-3f4a52743831 req-37802358-140f-473a-a7d7-9b92cc223af9 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Synchronizing usage tracker for tenant:755371c3d9de4747a47ba62e4d101829 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:36:28.547136 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-11cac752-e0a8-488e-803e-3f4a52743831 req-37802358-140f-473a-a7d7-9b92cc223af9 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Unset dirty status for tenant:755371c3d9de4747a47ba62e4d101829 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:36:28.548740 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-11cac752-e0a8-488e-803e-3f4a52743831 req-37802358-140f-473a-a7d7-9b92cc223af9 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 944 time: 0.1401362
Jun 03 08:36:28.599201 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-11cac752-e0a8-488e-803e-3f4a52743831 req-389c1fc4-ff99-4343-9872-58760b69eaf6 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=f7460adc-d3b2-4e2f-9865-c9faf88a2da7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0447917
Jun 03 08:36:28.918652 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e787925-9a06-49de-8cc9-56f64ef6cbd3 req-e69c3094-2c0c-4ef5-b989-0a13e0e71788 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:28.920100 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-1e787925-9a06-49de-8cc9-56f64ef6cbd3 req-e69c3094-2c0c-4ef5-b989-0a13e0e71788 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 944 time: 0.0831950
Jun 03 08:36:28.964515 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-1e787925-9a06-49de-8cc9-56f64ef6cbd3 req-91e9cb43-cf14-40fc-bc96-b87ff17f3117 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0385346
Jun 03 08:36:29.788257 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d676abe-b59e-4277-94d3-8bd4c6173154 req-a4605c08-8c50-42ac-8c12-22d9d569ceeb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:29.789707 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2d676abe-b59e-4277-94d3-8bd4c6173154 req-a4605c08-8c50-42ac-8c12-22d9d569ceeb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 944 time: 0.0808489
Jun 03 08:36:29.833531 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2d676abe-b59e-4277-94d3-8bd4c6173154 req-d807e448-77d2-4b82-a6ca-c8f8f5a0bee3 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=f7460adc-d3b2-4e2f-9865-c9faf88a2da7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0381975
Jun 03 08:36:30.158862 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a31c96f5-af0e-4217-871f-fbcea47d59a7 req-570d7d0e-3614-4333-8a11-846d053cf197 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:30.160257 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a31c96f5-af0e-4217-871f-fbcea47d59a7 req-570d7d0e-3614-4333-8a11-846d053cf197 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 944 time: 0.0840454
Jun 03 08:36:30.203560 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a31c96f5-af0e-4217-871f-fbcea47d59a7 req-3073ca0b-ace5-4934-b33e-79209b49c432 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0378258
Jun 03 08:36:30.570847 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69ecbaa9-111c-44be-87c5-821e634038ba req-d2e783cf-fe64-49ec-90a9-7cc0b2052ccf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:30.572299 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-69ecbaa9-111c-44be-87c5-821e634038ba req-d2e783cf-fe64-49ec-90a9-7cc0b2052ccf service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=755371c3d9de4747a47ba62e4d101829&device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 1097 time: 0.0740700
Jun 03 08:36:30.792076 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69ecbaa9-111c-44be-87c5-821e634038ba req-548cc078-6576-4969-abcb-5db89391ab64 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:30.793590 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-69ecbaa9-111c-44be-87c5-821e634038ba req-548cc078-6576-4969-abcb-5db89391ab64 service neutron] 10.222.0.55 "GET /v2.0/networks?tenant_id=755371c3d9de4747a47ba62e4d101829&shared=False HTTP/1.1" status: 200  len: 912 time: 0.2137563
Jun 03 08:36:30.947745 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69ecbaa9-111c-44be-87c5-821e634038ba req-df315e12-7ece-47e0-bef3-8d8e6bf80546 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:30.949153 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-69ecbaa9-111c-44be-87c5-821e634038ba req-df315e12-7ece-47e0-bef3-8d8e6bf80546 service neutron] 10.222.0.55 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1471157
Jun 03 08:36:31.085493 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4716083-a6cb-4d4f-9e85-1d467d4d44be req-8b8cb41c-a348-4715-8e9d-3d3311a184c3 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:31.086994 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f4716083-a6cb-4d4f-9e85-1d467d4d44be req-8b8cb41c-a348-4715-8e9d-3d3311a184c3 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 944 time: 0.1407294
Jun 03 08:36:31.095916 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-3dc5b5ec-cbb7-4039-8610-3455001e64c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:31.097360 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-3dc5b5ec-cbb7-4039-8610-3455001e64c8 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=755371c3d9de4747a47ba62e4d101829&device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 1097 time: 0.1046634
Jun 03 08:36:31.179959 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-e42a8a13-f40f-4ee8-8437-96aef8279091 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9b84dcd4-a96a-49e0-9102-07b3ed50b805 HTTP/1.1" status: 200  len: 217 time: 0.0677276
Jun 03 08:36:31.234651 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f4716083-a6cb-4d4f-9e85-1d467d4d44be req-c83d610f-0c5a-43ef-83e5-4c7fc3d19c63 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=f7460adc-d3b2-4e2f-9865-c9faf88a2da7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1409845
Jun 03 08:36:31.262863 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-6288cf30-428c-489b-8f0b-3931bba7cb0f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:31.264305 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-6288cf30-428c-489b-8f0b-3931bba7cb0f service neutron] 10.222.0.55 "GET /v2.0/subnets?id=5baf74c9-e686-40a5-b52f-f01da3bd1af9 HTTP/1.1" status: 200  len: 850 time: 0.0750098
Jun 03 08:36:31.349808 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-674fdb40-c273-4c56-8c6e-8278fe6015a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:31.349971 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-674fdb40-c273-4c56-8c6e-8278fe6015a4 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=020eaa43-2d59-46e1-8aec-0a688069f72b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0780056
Jun 03 08:36:31.403525 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3322d3f5-79ef-47c9-8ffe-237db42dfe76 req-2249c7b6-e194-4709-811c-001e870b4321 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:31.405042 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3322d3f5-79ef-47c9-8ffe-237db42dfe76 req-2249c7b6-e194-4709-811c-001e870b4321 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 944 time: 0.0852213
Jun 03 08:36:31.459154 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3322d3f5-79ef-47c9-8ffe-237db42dfe76 req-43c73a09-11f0-481e-8c42-fc593806c2a5 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0477078
Jun 03 08:36:31.492009 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-05ef4258-da90-46c0-a229-eb8c93c94bc2 service neutron] 10.222.0.55 "GET /v2.0/networks/020eaa43-2d59-46e1-8aec-0a688069f72b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1331112
Jun 03 08:36:31.635249 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-70e3bd04-d498-4a6e-8278-626bf2d8e1e5 req-927a58d2-cb6c-404a-b4ac-e5e2454c99c9 service neutron] 10.222.0.55 "GET /v2.0/networks/020eaa43-2d59-46e1-8aec-0a688069f72b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1299188
Jun 03 08:36:32.448893 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e4c4315-044a-4a8a-a1e8-98a6e075bee8 req-481f7bdf-43cd-49c1-bc66-6941327433cc tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:32.450369 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4e4c4315-044a-4a8a-a1e8-98a6e075bee8 req-481f7bdf-43cd-49c1-bc66-6941327433cc tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 944 time: 0.0952513
Jun 03 08:36:32.469345 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 1837d7d5-12fa-4414-9722-e593f5ed4c48 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:36:32.496612 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4e4c4315-044a-4a8a-a1e8-98a6e075bee8 req-d184987b-7160-4d55-9f39-5e54cc3406b3 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=f7460adc-d3b2-4e2f-9865-c9faf88a2da7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0377274
Jun 03 08:36:32.602580 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 1837d7d5-12fa-4414-9722-e593f5ed4c48, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=1837d7d5-12fa-4414-9722-e593f5ed4c48,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:36:32.617087 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': '1837d7d5-12fa-4414-9722-e593f5ed4c48', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'port_id': '1837d7d5-12fa-4414-9722-e593f5ed4c48', 'mac_address': 'fa:16:3e:ee:f3:ae', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 526, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:36:32.682419 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:32.698669 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-48000d58-28ff-4149-a523-43aded1c22f5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:32.718682 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1837d7d5-12fa-4414-9722-e593f5ed4c48 {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:36:32.718964 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 1837d7d5-12fa-4414-9722-e593f5ed4c48, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=1837d7d5-12fa-4414-9722-e593f5ed4c48,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:36:32.770192 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5a4ea73-2e83-4a19-9aa3-819bb1af35ee req-c095be6b-b615-4361-97bd-c360d0e7bdc4 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:32.770696 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c5a4ea73-2e83-4a19-9aa3-819bb1af35ee req-c095be6b-b615-4361-97bd-c360d0e7bdc4 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 944 time: 0.1873314
Jun 03 08:36:32.817125 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c5a4ea73-2e83-4a19-9aa3-819bb1af35ee req-a50eaa38-157c-4a83-8cc0-e84fb968bc8f tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0407772
Jun 03 08:36:32.849983 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:32.861979 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:32.921049 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=1837d7d5-12fa-4414-9722-e593f5ed4c48,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:32.924885 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:33.130385 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['1837d7d5-12fa-4414-9722-e593f5ed4c48'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:36:33.680642 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2d998ff-28aa-48c3-b459-6b7d4498c237 req-0fcae393-0c65-497f-bde5-4bc7b7d553c1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:33.682340 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c2d998ff-28aa-48c3-b459-6b7d4498c237 req-0fcae393-0c65-497f-bde5-4bc7b7d553c1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 944 time: 0.0830648
Jun 03 08:36:33.727950 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c2d998ff-28aa-48c3-b459-6b7d4498c237 req-4c59bbd2-1748-4332-86c4-197dfe60d325 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=f7460adc-d3b2-4e2f-9865-c9faf88a2da7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0400395
Jun 03 08:36:34.006585 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3b66797-0664-428c-800b-806e42df23b7 req-1332eb40-f99a-4dee-a59a-d6065e0cf28e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:34.008051 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c3b66797-0664-428c-800b-806e42df23b7 req-1332eb40-f99a-4dee-a59a-d6065e0cf28e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 945 time: 0.0827785
Jun 03 08:36:34.053575 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c3b66797-0664-428c-800b-806e42df23b7 req-b857b0fb-fcd9-4df6-a854-45df4ad7692f tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0399895
Jun 03 08:36:34.484718 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 9b84dcd4-a96a-49e0-9102-07b3ed50b805 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:36:34.489048 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 1837d7d5-12fa-4414-9722-e593f5ed4c48 up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:36:34.675566 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 9b84dcd4-a96a-49e0-9102-07b3ed50b805, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=9b84dcd4-a96a-49e0-9102-07b3ed50b805,segment=NetworkSegment(56366949-8cc8-4cf3-b3eb-d458d3515059),segment_id=56366949-8cc8-4cf3-b3eb-d458d3515059)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:36:34.688590 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': '9b84dcd4-a96a-49e0-9102-07b3ed50b805', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'port_id': '9b84dcd4-a96a-49e0-9102-07b3ed50b805', 'mac_address': 'fa:16:3e:6f:1c:51', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 531, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:36:34.741681 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning for port 1837d7d5-12fa-4414-9722-e593f5ed4c48 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:36:34.753536 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port 1837d7d5-12fa-4414-9722-e593f5ed4c48 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:36:34.753913 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:34.795304 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:34.825135 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9b84dcd4-a96a-49e0-9102-07b3ed50b805 {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:36:34.847969 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 9b84dcd4-a96a-49e0-9102-07b3ed50b805, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=9b84dcd4-a96a-49e0-9102-07b3ed50b805,segment=NetworkSegment(56366949-8cc8-4cf3-b3eb-d458d3515059),segment_id=56366949-8cc8-4cf3-b3eb-d458d3515059)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:36:34.849398 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:34.907190 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:34.918759 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d732ab81-6b08-4c05-b3f3-4469eb499c46 req-78d61ca3-fc02-463a-a7c2-cae4a7636779 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:34.920210 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d732ab81-6b08-4c05-b3f3-4469eb499c46 req-78d61ca3-fc02-463a-a7c2-cae4a7636779 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 944 time: 0.0827646
Jun 03 08:36:34.935052 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '41d57543-e5c8-45b5-8eef-2f829250eec3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1837d7d5-12fa-4414-9722-e593f5ed4c48'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:36:34.937454 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f9546b4e-6954-4948-8164-6d0d918b349c" -d '{"events": [{"server_uuid": "41d57543-e5c8-45b5-8eef-2f829250eec3", "name": "network-vif-plugged", "status": "completed", "tag": "1837d7d5-12fa-4414-9722-e593f5ed4c48"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:36:34.942837 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:34.947143 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:34.971765 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d732ab81-6b08-4c05-b3f3-4469eb499c46 req-9347d74c-3771-43e3-ac65-b8e2a33254d3 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=f7460adc-d3b2-4e2f-9865-c9faf88a2da7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0456681
Jun 03 08:36:34.987218 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 1837d7d5-12fa-4414-9722-e593f5ed4c48, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=1837d7d5-12fa-4414-9722-e593f5ed4c48,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:36:35.020803 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=9b84dcd4-a96a-49e0-9102-07b3ed50b805,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:35.023901 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:35.039425 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:36:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c6b7b870-73a6-4a20-a5e4-ff5263583b9b x-openstack-request-id: req-c6b7b870-73a6-4a20-a5e4-ff5263583b9b {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:36:35.039720 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "41d57543-e5c8-45b5-8eef-2f829250eec3", "name": "network-vif-plugged", "status": "completed", "tag": "1837d7d5-12fa-4414-9722-e593f5ed4c48", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:36:35.039977 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-c6b7b870-73a6-4a20-a5e4-ff5263583b9b {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:36:35.040365 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '41d57543-e5c8-45b5-8eef-2f829250eec3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1837d7d5-12fa-4414-9722-e593f5ed4c48', 'code': 200}
Jun 03 08:36:35.055962 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:35.058061 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-ac62d933-6d83-4e0f-b501-4a6eb418cb9e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:35.128984 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=1837d7d5-12fa-4414-9722-e593f5ed4c48,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:35.131878 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:35.230590 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['9b84dcd4-a96a-49e0-9102-07b3ed50b805'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:36:35.262685 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0d4702e-34c8-4728-961a-2c443121fc65 req-fa699467-e5e8-4251-a90c-26e23a3e3ac2 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:35.264348 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f0d4702e-34c8-4728-961a-2c443121fc65 req-fa699467-e5e8-4251-a90c-26e23a3e3ac2 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.0961730
Jun 03 08:36:35.272724 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-fff5d38e-a077-4820-bba0-b2faa0204b7e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:35.312603 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f0d4702e-34c8-4728-961a-2c443121fc65 req-a7cdb2fc-6868-4fae-a021-01c38dc66bbb tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0422795
Jun 03 08:36:35.462926 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13eddefa-e639-4642-9601-2f1579f4354c req-d6fa6e8c-01ce-46dd-a5c2-e264b2d56a57 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:35.464285 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-13eddefa-e639-4642-9601-2f1579f4354c req-d6fa6e8c-01ce-46dd-a5c2-e264b2d56a57 service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 1099 time: 0.0684543
Jun 03 08:36:35.510455 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-13eddefa-e639-4642-9601-2f1579f4354c req-8587adee-355e-4143-93c3-b8e7f314027f service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0331044
Jun 03 08:36:36.161062 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbb7279d-8895-460f-af73-a8e165a28d76 req-296523f1-6474-48b8-8198-2a56c7e0f73f tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:36.162603 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-dbb7279d-8895-460f-af73-a8e165a28d76 req-296523f1-6474-48b8-8198-2a56c7e0f73f tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 945 time: 0.0813601
Jun 03 08:36:36.211085 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-dbb7279d-8895-460f-af73-a8e165a28d76 req-377b24c0-9628-4e95-8e37-ea60f6b9ce59 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=f7460adc-d3b2-4e2f-9865-c9faf88a2da7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0429115
Jun 03 08:36:36.222218 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:36.492519 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 9b84dcd4-a96a-49e0-9102-07b3ed50b805 up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:36:36.505591 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbdee94f-a577-446f-bf95-3fa1aed9df1d req-65a1f19b-5614-400a-a436-88986e1ad579 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:36.507113 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-cbdee94f-a577-446f-bf95-3fa1aed9df1d req-65a1f19b-5614-400a-a436-88986e1ad579 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.0842915
Jun 03 08:36:36.555789 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-cbdee94f-a577-446f-bf95-3fa1aed9df1d req-60f94824-b397-42cf-be30-52b39ee00083 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0430133
Jun 03 08:36:36.650155 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning for port 9b84dcd4-a96a-49e0-9102-07b3ed50b805 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:36:36.655285 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port 9b84dcd4-a96a-49e0-9102-07b3ed50b805 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:36:36.655710 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:36.773687 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:36.806443 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 9b84dcd4-a96a-49e0-9102-07b3ed50b805, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=9b84dcd4-a96a-49e0-9102-07b3ed50b805,segment=NetworkSegment(56366949-8cc8-4cf3-b3eb-d458d3515059),segment_id=56366949-8cc8-4cf3-b3eb-d458d3515059)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:36:36.895917 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:36.897701 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:36.971004 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=9b84dcd4-a96a-49e0-9102-07b3ed50b805,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:36.973954 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:37.040869 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '02b21c4a-5207-45ed-b0dd-42675e4322a8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9b84dcd4-a96a-49e0-9102-07b3ed50b805'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:36:37.043149 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-26f8aba7-cc0f-4b87-a5e2-aed1ab8a5784" -d '{"events": [{"server_uuid": "02b21c4a-5207-45ed-b0dd-42675e4322a8", "name": "network-vif-plugged", "status": "completed", "tag": "9b84dcd4-a96a-49e0-9102-07b3ed50b805"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:36:37.084717 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:36:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-13f054a4-484f-4756-80a0-a159236fdb8b x-openstack-request-id: req-13f054a4-484f-4756-80a0-a159236fdb8b {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:36:37.085018 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "02b21c4a-5207-45ed-b0dd-42675e4322a8", "name": "network-vif-plugged", "status": "completed", "tag": "9b84dcd4-a96a-49e0-9102-07b3ed50b805", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:36:37.085277 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-13f054a4-484f-4756-80a0-a159236fdb8b {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:36:37.085671 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '02b21c4a-5207-45ed-b0dd-42675e4322a8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9b84dcd4-a96a-49e0-9102-07b3ed50b805', 'code': 200}
Jun 03 08:36:37.402630 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c89035ea-be63-4753-a333-f5590c209f6e req-af15677c-a493-4973-84c0-e3fca7aa7b59 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:37.404114 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c89035ea-be63-4753-a333-f5590c209f6e req-af15677c-a493-4973-84c0-e3fca7aa7b59 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 946 time: 0.0831513
Jun 03 08:36:37.567413 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c89035ea-be63-4753-a333-f5590c209f6e req-19035066-2c78-4011-ad44-2f0dc80a4ccc tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=f7460adc-d3b2-4e2f-9865-c9faf88a2da7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1574714
Jun 03 08:36:37.586423 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b5b8c8d-3cf0-4b0c-aa0f-8dc0c5ca57a4 req-c89c13d2-dfbb-4d90-aa53-40268d9a7662 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:37.587826 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1b5b8c8d-3cf0-4b0c-aa0f-8dc0c5ca57a4 req-c89c13d2-dfbb-4d90-aa53-40268d9a7662 service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 1099 time: 0.1760774
Jun 03 08:36:37.632138 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1b5b8c8d-3cf0-4b0c-aa0f-8dc0c5ca57a4 req-4bd2e840-18d5-4f62-9dd5-b2123c08676b service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=f7460adc-d3b2-4e2f-9865-c9faf88a2da7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0370262
Jun 03 08:36:37.753964 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47ec2d7b-1edd-41bb-87f7-f3c6343c69ab req-d20121e0-de7c-49bd-a0ff-d00d2bb6bd64 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:37.755437 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-47ec2d7b-1edd-41bb-87f7-f3c6343c69ab req-d20121e0-de7c-49bd-a0ff-d00d2bb6bd64 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.0819256
Jun 03 08:36:37.799542 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-47ec2d7b-1edd-41bb-87f7-f3c6343c69ab req-6af25843-f230-41a1-98ad-e2984ca0fe8e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0378139
Jun 03 08:36:37.983036 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48ea3332-38cd-4dd9-85ec-fc64bc46d07e req-8b547f10-9ec2-45b4-864b-a71e77a3a505 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:37.984478 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-48ea3332-38cd-4dd9-85ec-fc64bc46d07e req-8b547f10-9ec2-45b4-864b-a71e77a3a505 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.0831697
Jun 03 08:36:37.995681 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 53462) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:38.000079 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-e501ecfd-9a86-4b1b-a2ea-3ab222bc1669 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Request body: {'floatingip': {'port_id': '1837d7d5-12fa-4414-9722-e593f5ed4c48'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:36:38.050014 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:38.075454 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-e501ecfd-9a86-4b1b-a2ea-3ab222bc1669 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for floatingip, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:38.758124 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b29b0a9-c799-4162-82bd-105700f2c73d req-7b25379d-d875-4d0d-952d-2cc4dd6c5f08 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:38.759542 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2b29b0a9-c799-4162-82bd-105700f2c73d req-7b25379d-d875-4d0d-952d-2cc4dd6c5f08 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 946 time: 0.0873151
Jun 03 08:36:38.803929 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2b29b0a9-c799-4162-82bd-105700f2c73d req-d394ec9e-8ce1-4458-96a4-729a528f64be tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=f7460adc-d3b2-4e2f-9865-c9faf88a2da7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0389004
Jun 03 08:36:39.014752 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-e501ecfd-9a86-4b1b-a2ea-3ab222bc1669 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:39.096374 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-e501ecfd-9a86-4b1b-a2ea-3ab222bc1669 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16327919'] for floatingip, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:39.343869 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.db.l3_db [None req-e501ecfd-9a86-4b1b-a2ea-3ab222bc1669 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Floating IP 5234be0d-8a41-4218-9c7f-e80e95e82666 associated. External IP: 172.27.0.166, port: 1837d7d5-12fa-4414-9722-e593f5ed4c48.
Jun 03 08:36:39.692197 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e501ecfd-9a86-4b1b-a2ea-3ab222bc1669 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Router cb358121-3d7d-46b4-8e93-e40d5a92215c has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:36:39.867042 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e501ecfd-9a86-4b1b-a2ea-3ab222bc1669 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:36:39.871751 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-e501ecfd-9a86-4b1b-a2ea-3ab222bc1669 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for floatingip, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:39.878656 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ffdfca0-be9e-44ce-9f63-83df016b9379 None None] Sync routers for ids ['cb358121-3d7d-46b4-8e93-e40d5a92215c'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:36:39.887785 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ffdfca0-be9e-44ce-9f63-83df016b9379 None None] Routers {'cb358121-3d7d-46b4-8e93-e40d5a92215c'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:36:39.888409 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-5ffdfca0-be9e-44ce-9f63-83df016b9379 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae85f42dc0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:36:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['cb358121-3d7d-46b4-8e93-e40d5a92215c'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:36:39.977958 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-e501ecfd-9a86-4b1b-a2ea-3ab222bc1669 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "PUT /v2.0/floatingips/5234be0d-8a41-4218-9c7f-e80e95e82666 HTTP/1.1" status: 200  len: 992 time: 1.9812162
Jun 03 08:36:39.979891 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '41d57543-e5c8-45b5-8eef-2f829250eec3', 'tag': '1837d7d5-12fa-4414-9722-e593f5ed4c48'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:36:39.982343 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-733e95e2-a491-4c57-a195-fd3b3fb6ea78" -d '{"events": [{"name": "network-changed", "server_uuid": "41d57543-e5c8-45b5-8eef-2f829250eec3", "tag": "1837d7d5-12fa-4414-9722-e593f5ed4c48"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:36:40.012388 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4c92631-e943-4a11-b14f-8c7e32eb439a req-2cf95826-957e-4d8b-9e3d-29fb6301da77 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:40.014041 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b4c92631-e943-4a11-b14f-8c7e32eb439a req-2cf95826-957e-4d8b-9e3d-29fb6301da77 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 946 time: 0.0967698
Jun 03 08:36:40.060800 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b4c92631-e943-4a11-b14f-8c7e32eb439a req-f3690ad6-eee7-4ba3-a8d6-f7d568b85f34 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=f7460adc-d3b2-4e2f-9865-c9faf88a2da7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0401292
Jun 03 08:36:40.100853 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-5ffdfca0-be9e-44ce-9f63-83df016b9379 None None] Set router cb358121-3d7d-46b4-8e93-e40d5a92215c gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:36:40.114439 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:36:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a1c88e98-80c5-45f8-b3ff-f91b2e5b7fdf x-openstack-request-id: req-a1c88e98-80c5-45f8-b3ff-f91b2e5b7fdf {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:36:40.114887 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "41d57543-e5c8-45b5-8eef-2f829250eec3", "tag": "1837d7d5-12fa-4414-9722-e593f5ed4c48", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:36:40.115228 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-a1c88e98-80c5-45f8-b3ff-f91b2e5b7fdf {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:36:40.115657 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '41d57543-e5c8-45b5-8eef-2f829250eec3', 'tag': '1837d7d5-12fa-4414-9722-e593f5ed4c48', 'status': 'completed', 'code': 200}
Jun 03 08:36:40.233603 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-733e95e2-a491-4c57-a195-fd3b3fb6ea78 req-d081a3ad-2f57-4bbc-a2a0-41acaa526f35 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:40.235262 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-733e95e2-a491-4c57-a195-fd3b3fb6ea78 req-d081a3ad-2f57-4bbc-a2a0-41acaa526f35 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=36c42f532cd14f19811ffbee3a39a208&device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 1099 time: 0.0847313
Jun 03 08:36:40.268450 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01ee0d6-d774-4a71-b849-7b8b06eee19a req-04d02e4b-835f-4ea1-bc63-c02057a56a8c tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:40.269966 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a01ee0d6-d774-4a71-b849-7b8b06eee19a req-04d02e4b-835f-4ea1-bc63-c02057a56a8c tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 946 time: 0.0843813
Jun 03 08:36:40.278865 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 53486) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:40.286399 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-f7043edf-844d-4c10-a39d-5e418d8389c8 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Request body: {'floatingip': {'port_id': '9b84dcd4-a96a-49e0-9102-07b3ed50b805'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:36:40.415463 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f7043edf-844d-4c10-a39d-5e418d8389c8 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for floatingip, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:40.450651 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-5ffdfca0-be9e-44ce-9f63-83df016b9379 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae85f42dc0>, [{'id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-router', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:37Z', 'updated_at': '2021-06-03T08:30:48Z', 'revision_number': 4, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'gw_port': {'id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:11:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': '5234be0d-8a41-4218-9c7f-e80e95e82666', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'floating_ip_address': '172.27.0.166', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'port_id': '1837d7d5-12fa-4414-9722-e593f5ed4c48', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 493, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'mac_address': 'fa:16:3e:ee:f3:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '41d57543-e5c8-45b5-8eef-2f829250eec3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:36:10Z', 'updated_at': '2021-06-03T08:36:38Z', 'revision_number': 1, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5d9c4d5c-7c2e-4911-823a-3a3242707096', 'name': '', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'mac_address': 'fa:16:3e:0c:7e:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_interface', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:46Z', 'updated_at': '2021-06-03T08:31:03Z', 'revision_number': 5, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'subnets': [{'id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:36:40.454446 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ffdfca0-be9e-44ce-9f63-83df016b9379 None None] Checking router: cb358121-3d7d-46b4-8e93-e40d5a92215c for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:36:40.462876 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ffdfca0-be9e-44ce-9f63-83df016b9379 None None] Routers {'cb358121-3d7d-46b4-8e93-e40d5a92215c'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:36:40.463476 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-5ffdfca0-be9e-44ce-9f63-83df016b9379 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae85f42dc0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:36:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['cb358121-3d7d-46b4-8e93-e40d5a92215c'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:36:40.563562 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-733e95e2-a491-4c57-a195-fd3b3fb6ea78 req-75ba954e-9f5f-47af-af90-91e37b8a6e9e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:40.565606 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-733e95e2-a491-4c57-a195-fd3b3fb6ea78 req-75ba954e-9f5f-47af-af90-91e37b8a6e9e service neutron] 10.222.0.55 "GET /v2.0/networks?id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba HTTP/1.1" status: 200  len: 918 time: 0.3234000
Jun 03 08:36:40.650878 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-5ffdfca0-be9e-44ce-9f63-83df016b9379 None None] Set router cb358121-3d7d-46b4-8e93-e40d5a92215c gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:36:40.889512 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-733e95e2-a491-4c57-a195-fd3b3fb6ea78 req-6c055197-631a-47d6-9ab9-b7dcef76a55e service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=1837d7d5-12fa-4414-9722-e593f5ed4c48 HTTP/1.1" status: 200  len: 1000 time: 0.2959800
Jun 03 08:36:41.023497 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-5ffdfca0-be9e-44ce-9f63-83df016b9379 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae85f42dc0>, [{'id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-router', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:37Z', 'updated_at': '2021-06-03T08:30:48Z', 'revision_number': 4, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'gw_port': {'id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:11:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': '5234be0d-8a41-4218-9c7f-e80e95e82666', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'floating_ip_address': '172.27.0.166', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'port_id': '1837d7d5-12fa-4414-9722-e593f5ed4c48', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 493, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'mac_address': 'fa:16:3e:ee:f3:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '41d57543-e5c8-45b5-8eef-2f829250eec3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:36:10Z', 'updated_at': '2021-06-03T08:36:38Z', 'revision_number': 1, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5d9c4d5c-7c2e-4911-823a-3a3242707096', 'name': '', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'mac_address': 'fa:16:3e:0c:7e:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_interface', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:46Z', 'updated_at': '2021-06-03T08:31:03Z', 'revision_number': 5, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'subnets': [{'id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:36:41.027366 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ffdfca0-be9e-44ce-9f63-83df016b9379 None None] The sync data for ids ['cb358121-3d7d-46b4-8e93-e40d5a92215c'] in dv-cinder-787262-5-iscsi is: [{'id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-router', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:37Z', 'updated_at': '2021-06-03T08:30:48Z', 'revision_number': 4, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'gw_port': {'id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:11:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': '5234be0d-8a41-4218-9c7f-e80e95e82666', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'floating_ip_address': '172.27.0.166', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'port_id': '1837d7d5-12fa-4414-9722-e593f5ed4c48', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 493, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'mac_address': 'fa:16:3e:ee:f3:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '41d57543-e5c8-45b5-8eef-2f829250eec3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:36:10Z', 'updated_at': '2021-06-03T08:36:38Z', 'revision_number': 1, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5d9c4d5c-7c2e-4911-823a-3a3242707096', 'name': '', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'mac_address': 'fa:16:3e:0c:7e:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_interface', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:46Z', 'updated_at': '2021-06-03T08:31:03Z', 'revision_number': 5, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'subnets': [{'id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:36:41.039740 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-733e95e2-a491-4c57-a195-fd3b3fb6ea78 req-0f2a3ccb-6bda-48af-9345-81b9a34752dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:41.041210 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-733e95e2-a491-4c57-a195-fd3b3fb6ea78 req-0f2a3ccb-6bda-48af-9345-81b9a34752dc service neutron] 10.222.0.55 "GET /v2.0/subnets?id=cff67a13-bc33-4d3e-a796-5829103ca25c HTTP/1.1" status: 200  len: 856 time: 0.1404061
Jun 03 08:36:41.228773 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-733e95e2-a491-4c57-a195-fd3b3fb6ea78 req-662c30d3-f4fa-48ae-809a-05f619d2acef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:41.230330 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-733e95e2-a491-4c57-a195-fd3b3fb6ea78 req-662c30d3-f4fa-48ae-809a-05f619d2acef service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1755230
Jun 03 08:36:41.232084 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2adc2e90-c7c4-4788-a484-861fe0ade007 None None] New status for floating IP 5234be0d-8a41-4218-9c7f-e80e95e82666: ACTIVE {{(pid=92326) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 03 08:36:41.352711 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f7043edf-844d-4c10-a39d-5e418d8389c8 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:41.438581 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f7043edf-844d-4c10-a39d-5e418d8389c8 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16327919'] for floatingip, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:41.615760 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.db.l3_db [None req-f7043edf-844d-4c10-a39d-5e418d8389c8 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Floating IP 0cf1b680-7278-499d-96d6-d63af807b96f associated. External IP: 172.27.0.151, port: 9b84dcd4-a96a-49e0-9102-07b3ed50b805.
Jun 03 08:36:41.967360 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f7043edf-844d-4c10-a39d-5e418d8389c8 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Router a4b01ad1-d952-4deb-88df-6930ad4824db has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:36:42.152574 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f7043edf-844d-4c10-a39d-5e418d8389c8 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:36:42.157319 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f7043edf-844d-4c10-a39d-5e418d8389c8 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for floatingip, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:42.162200 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b548eda-5088-4363-9748-6da820225f1f None None] Sync routers for ids ['a4b01ad1-d952-4deb-88df-6930ad4824db'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:36:42.171770 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b548eda-5088-4363-9748-6da820225f1f None None] Routers {'a4b01ad1-d952-4deb-88df-6930ad4824db'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:36:42.172386 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-5b548eda-5088-4363-9748-6da820225f1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae85f42fa0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:36:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['a4b01ad1-d952-4deb-88df-6930ad4824db'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:36:42.213400 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-f7043edf-844d-4c10-a39d-5e418d8389c8 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "PUT /v2.0/floatingips/0cf1b680-7278-499d-96d6-d63af807b96f HTTP/1.1" status: 200  len: 992 time: 1.9334972
Jun 03 08:36:42.214023 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '02b21c4a-5207-45ed-b0dd-42675e4322a8', 'tag': '9b84dcd4-a96a-49e0-9102-07b3ed50b805'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:36:42.216322 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-703b8f22-81a5-4e6a-a2f1-a795989fec43" -d '{"events": [{"name": "network-changed", "server_uuid": "02b21c4a-5207-45ed-b0dd-42675e4322a8", "tag": "9b84dcd4-a96a-49e0-9102-07b3ed50b805"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:36:42.347905 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-5b548eda-5088-4363-9748-6da820225f1f None None] Set router a4b01ad1-d952-4deb-88df-6930ad4824db gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:36:42.747035 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-5b548eda-5088-4363-9748-6da820225f1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae85f42fa0>, [{'id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'name': 'tempest-AttachVolumeTestJSON-1767133114-router', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241'}], 'enable_snat': True}, 'gw_port_id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:38Z', 'updated_at': '2021-06-03T08:30:51Z', 'revision_number': 4, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'gw_port': {'id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:65:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': '0cf1b680-7278-499d-96d6-d63af807b96f', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'floating_ip_address': '172.27.0.151', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'port_id': '9b84dcd4-a96a-49e0-9102-07b3ed50b805', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 500, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'mac_address': 'fa:16:3e:6f:1c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02b21c4a-5207-45ed-b0dd-42675e4322a8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:36:17Z', 'updated_at': '2021-06-03T08:36:41Z', 'revision_number': 1, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '09aff824-d423-4557-8913-463e6f53d3e5', 'name': '', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'mac_address': 'fa:16:3e:c4:92:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_interface', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:47Z', 'updated_at': '2021-06-03T08:31:05Z', 'revision_number': 5, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'subnets': [{'id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:36:42.750854 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b548eda-5088-4363-9748-6da820225f1f None None] Checking router: a4b01ad1-d952-4deb-88df-6930ad4824db for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:36:42.759101 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b548eda-5088-4363-9748-6da820225f1f None None] Routers {'a4b01ad1-d952-4deb-88df-6930ad4824db'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:36:42.759831 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-5b548eda-5088-4363-9748-6da820225f1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae85f42fa0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:36:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['a4b01ad1-d952-4deb-88df-6930ad4824db'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:36:42.935592 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-5b548eda-5088-4363-9748-6da820225f1f None None] Set router a4b01ad1-d952-4deb-88df-6930ad4824db gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:36:43.285880 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-5b548eda-5088-4363-9748-6da820225f1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae85f42fa0>, [{'id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'name': 'tempest-AttachVolumeTestJSON-1767133114-router', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241'}], 'enable_snat': True}, 'gw_port_id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:38Z', 'updated_at': '2021-06-03T08:30:51Z', 'revision_number': 4, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'gw_port': {'id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:65:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': '0cf1b680-7278-499d-96d6-d63af807b96f', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'floating_ip_address': '172.27.0.151', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'port_id': '9b84dcd4-a96a-49e0-9102-07b3ed50b805', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 500, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'mac_address': 'fa:16:3e:6f:1c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02b21c4a-5207-45ed-b0dd-42675e4322a8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:36:17Z', 'updated_at': '2021-06-03T08:36:41Z', 'revision_number': 1, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '09aff824-d423-4557-8913-463e6f53d3e5', 'name': '', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'mac_address': 'fa:16:3e:c4:92:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_interface', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:47Z', 'updated_at': '2021-06-03T08:31:05Z', 'revision_number': 5, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'subnets': [{'id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:36:43.289769 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b548eda-5088-4363-9748-6da820225f1f None None] The sync data for ids ['a4b01ad1-d952-4deb-88df-6930ad4824db'] in dv-cinder-787262-5-iscsi is: [{'id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'name': 'tempest-AttachVolumeTestJSON-1767133114-router', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241'}], 'enable_snat': True}, 'gw_port_id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:38Z', 'updated_at': '2021-06-03T08:30:51Z', 'revision_number': 4, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'gw_port': {'id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:65:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': '0cf1b680-7278-499d-96d6-d63af807b96f', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'floating_ip_address': '172.27.0.151', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'port_id': '9b84dcd4-a96a-49e0-9102-07b3ed50b805', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 500, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'mac_address': 'fa:16:3e:6f:1c:51', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02b21c4a-5207-45ed-b0dd-42675e4322a8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:36:17Z', 'updated_at': '2021-06-03T08:36:41Z', 'revision_number': 1, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '09aff824-d423-4557-8913-463e6f53d3e5', 'name': '', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'mac_address': 'fa:16:3e:c4:92:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_interface', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:47Z', 'updated_at': '2021-06-03T08:31:05Z', 'revision_number': 5, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'subnets': [{'id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:36:43.472293 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7e20fb5-1fe4-47c0-9902-b5233656efb1 None None] New status for floating IP 0cf1b680-7278-499d-96d6-d63af807b96f: ACTIVE {{(pid=92326) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 03 08:36:44.447642 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:36:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-694ae984-a771-4ec6-8401-45c07267fa6a x-openstack-request-id: req-694ae984-a771-4ec6-8401-45c07267fa6a {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:36:44.448245 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "02b21c4a-5207-45ed-b0dd-42675e4322a8", "tag": "9b84dcd4-a96a-49e0-9102-07b3ed50b805", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:36:44.448245 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-694ae984-a771-4ec6-8401-45c07267fa6a {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:36:44.448614 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '02b21c4a-5207-45ed-b0dd-42675e4322a8', 'tag': '9b84dcd4-a96a-49e0-9102-07b3ed50b805', 'status': 'completed', 'code': 200}
Jun 03 08:36:44.557412 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-733e95e2-a491-4c57-a195-fd3b3fb6ea78 req-c04f84f2-730a-4e90-b92d-cefa6f4e0c83 service neutron] 10.222.0.55 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2968647
Jun 03 08:36:44.568675 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-703b8f22-81a5-4e6a-a2f1-a795989fec43 req-926ea508-b917-48eb-9152-036254d9e7ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:44.570133 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-703b8f22-81a5-4e6a-a2f1-a795989fec43 req-926ea508-b917-48eb-9152-036254d9e7ba service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=755371c3d9de4747a47ba62e4d101829&device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 1099 time: 0.1208143
Jun 03 08:36:44.814873 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-733e95e2-a491-4c57-a195-fd3b3fb6ea78 req-a9385f90-db58-4502-9dbc-d7823f1d315f service neutron] 10.222.0.55 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2434895
Jun 03 08:36:44.815822 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-703b8f22-81a5-4e6a-a2f1-a795989fec43 req-539689df-1a43-4317-bf08-347972485207 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:44.817119 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-703b8f22-81a5-4e6a-a2f1-a795989fec43 req-539689df-1a43-4317-bf08-347972485207 service neutron] 10.222.0.55 "GET /v2.0/networks?id=020eaa43-2d59-46e1-8aec-0a688069f72b HTTP/1.1" status: 200  len: 912 time: 0.2265499
Jun 03 08:36:48.034604 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-703b8f22-81a5-4e6a-a2f1-a795989fec43 req-5209500b-5f21-47e0-b5b7-1f21ccb49998 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9b84dcd4-a96a-49e0-9102-07b3ed50b805 HTTP/1.1" status: 200  len: 1002 time: 0.0998151
Jun 03 08:36:48.100749 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-703b8f22-81a5-4e6a-a2f1-a795989fec43 req-e724d30b-c355-40c6-9101-31f3e3832890 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:48.102073 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-703b8f22-81a5-4e6a-a2f1-a795989fec43 req-e724d30b-c355-40c6-9101-31f3e3832890 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=5baf74c9-e686-40a5-b52f-f01da3bd1af9 HTTP/1.1" status: 200  len: 850 time: 0.0577197
Jun 03 08:36:48.193763 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-703b8f22-81a5-4e6a-a2f1-a795989fec43 req-89d0200c-e80f-40f2-8729-84e8fbf33a70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:48.195254 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-703b8f22-81a5-4e6a-a2f1-a795989fec43 req-89d0200c-e80f-40f2-8729-84e8fbf33a70 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=020eaa43-2d59-46e1-8aec-0a688069f72b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0783033
Jun 03 08:36:48.331253 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-703b8f22-81a5-4e6a-a2f1-a795989fec43 req-eb32795d-df04-4eae-b6a7-d2dd1e8679c4 service neutron] 10.222.0.55 "GET /v2.0/networks/020eaa43-2d59-46e1-8aec-0a688069f72b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1250334
Jun 03 08:36:48.464798 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-703b8f22-81a5-4e6a-a2f1-a795989fec43 req-7319472e-28b6-42ec-8079-48441c579e01 service neutron] 10.222.0.55 "GET /v2.0/networks/020eaa43-2d59-46e1-8aec-0a688069f72b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1259856
Jun 03 08:36:50.426312 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d534c5-3407-49a2-8609-aa0ee60dd7f8 req-551085e5-e0e1-4a8d-a070-2ee95175baff tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:50.428720 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b9d534c5-3407-49a2-8609-aa0ee60dd7f8 req-551085e5-e0e1-4a8d-a070-2ee95175baff tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 945 time: 0.0946836
Jun 03 08:36:50.476356 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b9d534c5-3407-49a2-8609-aa0ee60dd7f8 req-5a4b3c86-0949-4282-9554-5b4defbd9c5f tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0415912
Jun 03 08:36:51.667520 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90e8ef91-7a6f-4f06-8f86-3478f56352a9 req-4611c674-f673-4c56-b18d-ddaec027ff5f tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:51.668949 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-90e8ef91-7a6f-4f06-8f86-3478f56352a9 req-4611c674-f673-4c56-b18d-ddaec027ff5f tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 945 time: 0.0820086
Jun 03 08:36:51.714600 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-90e8ef91-7a6f-4f06-8f86-3478f56352a9 req-50adba57-aeab-401b-b0c7-ceafc62db8bf tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391357
Jun 03 08:36:52.339981 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c2b528a-f7bd-476b-a0e2-054cd4b12b12 req-8c9b7c6f-bd73-425e-bfa3-0915971b06c2 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:52.341562 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1c2b528a-f7bd-476b-a0e2-054cd4b12b12 req-8c9b7c6f-bd73-425e-bfa3-0915971b06c2 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.55 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 945 time: 0.0841682
Jun 03 08:36:52.476549 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-1c2b528a-f7bd-476b-a0e2-054cd4b12b12 req-e80e74ec-3c2d-4bb0-9c6f-a29bd2a5fff9 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Deleting port dd4a50f7-3420-4d92-accb-bce642d3216f {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:36:52.476890 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-1c2b528a-f7bd-476b-a0e2-054cd4b12b12 req-e80e74ec-3c2d-4bb0-9c6f-a29bd2a5fff9 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:52.610397 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-1c2b528a-f7bd-476b-a0e2-054cd4b12b12 req-e80e74ec-3c2d-4bb0-9c6f-a29bd2a5fff9 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] For port dd4a50f7-3420-4d92-accb-bce642d3216f, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=dd4a50f7-3420-4d92-accb-bce642d3216f,segment=NetworkSegment(6978222c-6678-416a-a506-1fa962d91d64),segment_id=6978222c-6678-416a-a506-1fa962d91d64)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:36:52.610887 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-1c2b528a-f7bd-476b-a0e2-054cd4b12b12 req-e80e74ec-3c2d-4bb0-9c6f-a29bd2a5fff9 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:52.823758 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-1c2b528a-f7bd-476b-a0e2-054cd4b12b12 req-e80e74ec-3c2d-4bb0-9c6f-a29bd2a5fff9 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Calling delete_port for dd4a50f7-3420-4d92-accb-bce642d3216f owned by compute:nova {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:36:52.912113 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e7b8f70-6b14-4a52-96f0-b37834b70404 req-bd881374-75d0-4f25-9eca-ee70d436a980 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:52.913568 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0e7b8f70-6b14-4a52-96f0-b37834b70404 req-bd881374-75d0-4f25-9eca-ee70d436a980 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 945 time: 0.0870111
Jun 03 08:36:52.962332 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0e7b8f70-6b14-4a52-96f0-b37834b70404 req-264718e9-4a9a-412c-918a-258096385934 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/security-groups?id=1455c957-f90c-4cab-a146-6db18bd88bec&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427682
Jun 03 08:36:53.021351 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-1c2b528a-f7bd-476b-a0e2-054cd4b12b12 req-e80e74ec-3c2d-4bb0-9c6f-a29bd2a5fff9 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:53.027031 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f5171c2b-4c54-490a-8db5-65fc8f3b1b1f tempest-ServerRescueNegativeTestJSON-137743352 tempest-ServerRescueNegativeTestJSON-137743352-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:53.035092 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['dd4a50f7-3420-4d92-accb-bce642d3216f'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:36:53.074458 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e80e74ec-3c2d-4bb0-9c6f-a29bd2a5fff9 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Pushing event deleted for resources: {'Port': ['ID=dd4a50f7-3420-4d92-accb-bce642d3216f,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:53.078147 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-e80e74ec-3c2d-4bb0-9c6f-a29bd2a5fff9 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:53.161127 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-1c2b528a-f7bd-476b-a0e2-054cd4b12b12 req-e80e74ec-3c2d-4bb0-9c6f-a29bd2a5fff9 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] No DVR routers for this DVR port dd4a50f7-3420-4d92-accb-bce642d3216f on host hv-cinder-78726 {{(pid=92323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:36:53.163682 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-1c2b528a-f7bd-476b-a0e2-054cd4b12b12 req-e80e74ec-3c2d-4bb0-9c6f-a29bd2a5fff9 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:53.166116 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fd73c345-63e5-4a4b-b638-d7fb6250aa36', 'name': 'network-vif-deleted', 'tag': 'dd4a50f7-3420-4d92-accb-bce642d3216f'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:36:53.168385 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f01005c5-08e3-41df-aa90-6ab389b0f6dc" -d '{"events": [{"server_uuid": "fd73c345-63e5-4a4b-b638-d7fb6250aa36", "name": "network-vif-deleted", "tag": "dd4a50f7-3420-4d92-accb-bce642d3216f"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:36:53.211165 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:36:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9a17759e-7f83-440b-8a4a-435d4e15ebf9 x-openstack-request-id: req-9a17759e-7f83-440b-8a4a-435d4e15ebf9 {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:36:53.211308 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fd73c345-63e5-4a4b-b638-d7fb6250aa36", "name": "network-vif-deleted", "tag": "dd4a50f7-3420-4d92-accb-bce642d3216f", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:36:53.211500 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-9a17759e-7f83-440b-8a4a-435d4e15ebf9 {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:36:53.211920 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fd73c345-63e5-4a4b-b638-d7fb6250aa36', 'name': 'network-vif-deleted', 'tag': 'dd4a50f7-3420-4d92-accb-bce642d3216f', 'status': 'completed', 'code': 200}
Jun 03 08:36:53.250636 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1c2b528a-f7bd-476b-a0e2-054cd4b12b12 req-e80e74ec-3c2d-4bb0-9c6f-a29bd2a5fff9 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.55 "DELETE /v2.0/ports/dd4a50f7-3420-4d92-accb-bce642d3216f HTTP/1.1" status: 204  len: 173 time: 0.9028826
Jun 03 08:36:54.001906 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 53660) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:54.154464 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d3ff0aa1-fbad-49f4-9510-5b606e8d5a6f req-4d601eb3-332d-49bc-858f-dcd6156b8cca tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] 10.222.0.11 "GET /v2.0/ports?device_id=fd73c345-63e5-4a4b-b638-d7fb6250aa36 HTTP/1.1" status: 200  len: 210 time: 0.0616848
Jun 03 08:36:54.156728 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ffdaeb76-e0dd-4806-866f-2971af2e8cca admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:54.171782 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-ffdaeb76-e0dd-4806-866f-2971af2e8cca admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:36:54.175995 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-ffdaeb76-e0dd-4806-866f-2971af2e8cca admin admin] Usage tracker for resource:security_group_rule and tenant:cc8d85dd248d4c72953c6c7007236582 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:36:54.178837 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-ffdaeb76-e0dd-4806-866f-2971af2e8cca admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:36:54.184814 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-ffdaeb76-e0dd-4806-866f-2971af2e8cca admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:36:54.268345 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ffdaeb76-e0dd-4806-866f-2971af2e8cca admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:54.330408 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ffdaeb76-e0dd-4806-866f-2971af2e8cca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:54.339397 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:54.379678 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-ffdaeb76-e0dd-4806-866f-2971af2e8cca admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=cc8d85dd248d4c72953c6c7007236582&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3758688
Jun 03 08:36:54.381430 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffdaeb76-e0dd-4806-866f-2971af2e8cca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5765f975-874d-4633-9181-3b7f0c2c5e91,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:54.382363 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 53664) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:54.387352 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-ffdaeb76-e0dd-4806-866f-2971af2e8cca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:54.445155 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-ea70bb66-3164-43ed-8673-e97b4c9f1e99 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:54.471492 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-ea70bb66-3164-43ed-8673-e97b4c9f1e99 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:54.581340 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-ea70bb66-3164-43ed-8673-e97b4c9f1e99 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:54.584986 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-4449fcc4-dcd0-4808-88dc-80ddd55efcdf tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:54.595372 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea70bb66-3164-43ed-8673-e97b4c9f1e99 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5765f975-874d-4633-9181-3b7f0c2c5e91,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:54.599642 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-ea70bb66-3164-43ed-8673-e97b4c9f1e99 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:54.603064 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-ea70bb66-3164-43ed-8673-e97b4c9f1e99 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:54.604191 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-ea70bb66-3164-43ed-8673-e97b4c9f1e99 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/5765f975-874d-4633-9181-3b7f0c2c5e91 HTTP/1.1" status: 204  len: 168 time: 0.2207286
Jun 03 08:36:55.324250 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 53686) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:55.325498 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 53688) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:55.342300 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7ad8ef7b-b0d5-491e-bda0-e5b33cb7699d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:55.357812 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-7ad8ef7b-b0d5-491e-bda0-e5b33cb7699d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:36:55.361958 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-7ad8ef7b-b0d5-491e-bda0-e5b33cb7699d admin admin] Usage tracker for resource:security_group_rule and tenant:3aab109ea71c407eac490328256e2967 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:36:55.365016 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-7ad8ef7b-b0d5-491e-bda0-e5b33cb7699d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:36:55.370938 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-7ad8ef7b-b0d5-491e-bda0-e5b33cb7699d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:36:55.462440 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7ad8ef7b-b0d5-491e-bda0-e5b33cb7699d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:55.513747 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-eafaf4cd-2f91-44fb-a43c-7243c1ad092f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:55.528113 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-eafaf4cd-2f91-44fb-a43c-7243c1ad092f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:36:55.531870 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-eafaf4cd-2f91-44fb-a43c-7243c1ad092f admin admin] Usage tracker for resource:security_group_rule and tenant:bb5f6759ad1341d89dd2750088fc5bad is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:36:55.535294 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-eafaf4cd-2f91-44fb-a43c-7243c1ad092f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:36:55.540885 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-eafaf4cd-2f91-44fb-a43c-7243c1ad092f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:36:55.547017 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-7ad8ef7b-b0d5-491e-bda0-e5b33cb7699d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:55.554963 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:55.594384 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ad8ef7b-b0d5-491e-bda0-e5b33cb7699d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4cbe1599-5f59-460c-a911-dbeaa1c93e85,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:55.599415 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-7ad8ef7b-b0d5-491e-bda0-e5b33cb7699d admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=3aab109ea71c407eac490328256e2967&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2754841
Jun 03 08:36:55.600338 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-7ad8ef7b-b0d5-491e-bda0-e5b33cb7699d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:55.602739 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 53692) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:55.647344 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-eafaf4cd-2f91-44fb-a43c-7243c1ad092f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:55.679345 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-ab6e2ecf-d40c-4881-867d-2256fefa7b7f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:55.705145 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-ab6e2ecf-d40c-4881-867d-2256fefa7b7f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:55.787405 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-eafaf4cd-2f91-44fb-a43c-7243c1ad092f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:55.796094 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a17d73c8-c217-4d4b-8d9b-030817402eb4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:55.840204 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-eafaf4cd-2f91-44fb-a43c-7243c1ad092f admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=bb5f6759ad1341d89dd2750088fc5bad&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5134709
Jun 03 08:36:55.842815 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 53696) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:55.843253 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eafaf4cd-2f91-44fb-a43c-7243c1ad092f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=944b545c-fdb2-4299-b57b-a16aa8051ce3,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:55.846842 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-eafaf4cd-2f91-44fb-a43c-7243c1ad092f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:55.900583 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-61ad7100-a988-4341-ae23-2065d835f472 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:55.926804 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-61ad7100-a988-4341-ae23-2065d835f472 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:55.974068 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-ab6e2ecf-d40c-4881-867d-2256fefa7b7f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:55.979066 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-6225f69e-1b90-43e5-ad38-3a8205fecee1 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:55.993795 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab6e2ecf-d40c-4881-867d-2256fefa7b7f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4cbe1599-5f59-460c-a911-dbeaa1c93e85,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:55.996654 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-ab6e2ecf-d40c-4881-867d-2256fefa7b7f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:56.004491 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-ab6e2ecf-d40c-4881-867d-2256fefa7b7f admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:56.009919 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-ab6e2ecf-d40c-4881-867d-2256fefa7b7f admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/4cbe1599-5f59-460c-a911-dbeaa1c93e85 HTTP/1.1" status: 204  len: 168 time: 0.4021499
Jun 03 08:36:56.062148 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-61ad7100-a988-4341-ae23-2065d835f472 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:56.071757 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-8d11c416-76f7-467c-b9df-b59949408b3b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:56.086277 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61ad7100-a988-4341-ae23-2065d835f472 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=944b545c-fdb2-4299-b57b-a16aa8051ce3,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:56.089682 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-61ad7100-a988-4341-ae23-2065d835f472 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:56.096346 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-61ad7100-a988-4341-ae23-2065d835f472 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:56.100447 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-61ad7100-a988-4341-ae23-2065d835f472 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/944b545c-fdb2-4299-b57b-a16aa8051ce3 HTTP/1.1" status: 204  len: 168 time: 0.2566297
Jun 03 08:36:56.124641 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:56.579426 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device dd4a50f7-3420-4d92-accb-bce642d3216f no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:36:56.614955 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] No Port match for: dd4a50f7-3420-4d92-accb-bce642d3216f {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:36:56.615306 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device dd4a50f7-3420-4d92-accb-bce642d3216f not bound to the agent host hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:36:58.282398 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-901bed98-bd60-46bd-89c8-b44c724ca15a req-ae312424-7cdc-423a-9ae0-e61d5182fc27 service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0828304
Jun 03 08:36:58.330206 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:36:58.449780 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-901bed98-bd60-46bd-89c8-b44c724ca15a req-58a89de7-9274-4e38-b635-e9b51feaf569 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:58.451284 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-901bed98-bd60-46bd-89c8-b44c724ca15a req-58a89de7-9274-4e38-b635-e9b51feaf569 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=96a989a900784d61a1475d86dd209c5f&device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 1137 time: 0.0982509
Jun 03 08:36:58.628948 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-901bed98-bd60-46bd-89c8-b44c724ca15a req-b72323d4-39c4-4a5e-89b1-4915473330fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:36:58.630609 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-901bed98-bd60-46bd-89c8-b44c724ca15a req-b72323d4-39c4-4a5e-89b1-4915473330fa service neutron] 10.222.0.55 "GET /v2.0/networks?id=113ded30-096c-4860-8773-fb717f3ea4c6 HTTP/1.1" status: 200  len: 915 time: 0.1580637
Jun 03 08:36:59.024829 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 53792) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:59.157313 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:59.174001 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:36:59.177952 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] Usage tracker for resource:security_group_rule and tenant:c264aaa199d740d1a22281e38e15816f is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:36:59.181762 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:36:59.187540 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:36:59.284685 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:59.369970 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:59.378397 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a6a497f3-9e7c-4427-b45e-0194628d490c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:59.421195 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e61a5542-753f-4e53-9c6b-9e5486cf3fe3,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:59.426649 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=c264aaa199d740d1a22281e38e15816f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4007990
Jun 03 08:36:59.429363 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 53800) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:36:59.431545 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.431914 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.432272 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.432631 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.432977 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.433324 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.433667 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.434006 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.434350 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.434711 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.435050 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.435384 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.440173 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:36:59.493790 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a76a1728-ddc7-4340-a6ed-6a51d5fee7a3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:59.520420 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a76a1728-ddc7-4340-a6ed-6a51d5fee7a3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:59.649695 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a76a1728-ddc7-4340-a6ed-6a51d5fee7a3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:59.653443 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-cbceaf61-51f2-4d2b-a350-2f9ed4278dde admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:36:59.664929 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a76a1728-ddc7-4340-a6ed-6a51d5fee7a3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e61a5542-753f-4e53-9c6b-9e5486cf3fe3,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:36:59.675807 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76a1728-ddc7-4340-a6ed-6a51d5fee7a3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.676192 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76a1728-ddc7-4340-a6ed-6a51d5fee7a3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.676615 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76a1728-ddc7-4340-a6ed-6a51d5fee7a3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.676981 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76a1728-ddc7-4340-a6ed-6a51d5fee7a3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.677401 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76a1728-ddc7-4340-a6ed-6a51d5fee7a3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.677758 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76a1728-ddc7-4340-a6ed-6a51d5fee7a3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.678119 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76a1728-ddc7-4340-a6ed-6a51d5fee7a3 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.678476 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76a1728-ddc7-4340-a6ed-6a51d5fee7a3 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.678924 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76a1728-ddc7-4340-a6ed-6a51d5fee7a3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.679281 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76a1728-ddc7-4340-a6ed-6a51d5fee7a3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.679632 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76a1728-ddc7-4340-a6ed-6a51d5fee7a3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.679983 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76a1728-ddc7-4340-a6ed-6a51d5fee7a3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:36:59.682991 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a76a1728-ddc7-4340-a6ed-6a51d5fee7a3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:36:59.684120 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-a76a1728-ddc7-4340-a6ed-6a51d5fee7a3 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/e61a5542-753f-4e53-9c6b-9e5486cf3fe3 HTTP/1.1" status: 204  len: 168 time: 0.2535925
Jun 03 08:36:59.685046 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-a76a1728-ddc7-4340-a6ed-6a51d5fee7a3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:00.409083 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 53810) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:00.426416 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f5cc95b2-d537-41ae-b238-7e7f77131818 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:00.440676 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-f5cc95b2-d537-41ae-b238-7e7f77131818 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:37:00.444541 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-f5cc95b2-d537-41ae-b238-7e7f77131818 admin admin] Usage tracker for resource:security_group_rule and tenant:9688727c4d7f4fb199158220de754ae6 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:37:00.447292 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-f5cc95b2-d537-41ae-b238-7e7f77131818 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:37:00.452878 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-f5cc95b2-d537-41ae-b238-7e7f77131818 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:37:00.534591 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f5cc95b2-d537-41ae-b238-7e7f77131818 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:00.627316 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f5cc95b2-d537-41ae-b238-7e7f77131818 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:00.634197 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-91dac9d0-38da-4931-9689-366201c27eed admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:00.678538 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-f5cc95b2-d537-41ae-b238-7e7f77131818 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=9688727c4d7f4fb199158220de754ae6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2683568
Jun 03 08:37:00.680243 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5cc95b2-d537-41ae-b238-7e7f77131818 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f2154620-b713-4eab-9854-c7d872bf01fa,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:00.681435 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 53812) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:00.683837 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f5cc95b2-d537-41ae-b238-7e7f77131818 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:00.742775 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2b1c7a75-f67b-467b-a4fb-3d7f9ecf8944 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:00.768454 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2b1c7a75-f67b-467b-a4fb-3d7f9ecf8944 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:00.884066 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2b1c7a75-f67b-467b-a4fb-3d7f9ecf8944 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:00.888984 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-33986fe6-f822-4838-94cc-4fc3b9de6add admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:00.903157 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b1c7a75-f67b-467b-a4fb-3d7f9ecf8944 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f2154620-b713-4eab-9854-c7d872bf01fa,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:00.906335 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-2b1c7a75-f67b-467b-a4fb-3d7f9ecf8944 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:00.910695 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2b1c7a75-f67b-467b-a4fb-3d7f9ecf8944 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:00.912154 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-2b1c7a75-f67b-467b-a4fb-3d7f9ecf8944 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/f2154620-b713-4eab-9854-c7d872bf01fa HTTP/1.1" status: 204  len: 168 time: 0.2294223
Jun 03 08:37:01.533347 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-901bed98-bd60-46bd-89c8-b44c724ca15a req-edea695c-c774-4e3a-a797-0c7914f48631 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=37525065-c740-4aee-a826-af098f4b7727 HTTP/1.1" status: 200  len: 999 time: 0.1052451
Jun 03 08:37:01.602911 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-901bed98-bd60-46bd-89c8-b44c724ca15a req-2e3bdc11-24cf-47e2-80d4-2753b1d652de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:01.604340 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-901bed98-bd60-46bd-89c8-b44c724ca15a req-2e3bdc11-24cf-47e2-80d4-2753b1d652de service neutron] 10.222.0.55 "GET /v2.0/subnets?id=159409d9-9245-4f6d-adbe-4aa8aad78d07 HTTP/1.1" status: 200  len: 853 time: 0.0572653
Jun 03 08:37:01.687332 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-901bed98-bd60-46bd-89c8-b44c724ca15a req-a66db61e-0c13-453f-ac32-b1fd1442b169 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:01.688915 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-901bed98-bd60-46bd-89c8-b44c724ca15a req-a66db61e-0c13-453f-ac32-b1fd1442b169 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=113ded30-096c-4860-8773-fb717f3ea4c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0755477
Jun 03 08:37:01.839617 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-901bed98-bd60-46bd-89c8-b44c724ca15a req-7f7a3ab4-5a6f-49e7-9c44-424b2a2e42fe service neutron] 10.222.0.55 "GET /v2.0/networks/113ded30-096c-4860-8773-fb717f3ea4c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1348963
Jun 03 08:37:01.995184 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-901bed98-bd60-46bd-89c8-b44c724ca15a req-8d685fd1-bd49-4faf-aa12-09a834876cfe service neutron] 10.222.0.55 "GET /v2.0/networks/113ded30-096c-4860-8773-fb717f3ea4c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1478424
Jun 03 08:37:02.196845 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-3a851843-c695-4b5d-8740-74d1095ff865 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/networks?tenant_id=9769d84061ea436ab7b7d97278110278&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0306034
Jun 03 08:37:02.448080 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-69804b1c-2188-43ab-a2ca-62d2bad85fbd tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:02.455182 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-69804b1c-2188-43ab-a2ca-62d2bad85fbd tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.2527571
Jun 03 08:37:02.472055 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-4e660d02-e4cf-4e96-8904-d8d6a2a49ffe tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/quotas/9769d84061ea436ab7b7d97278110278 HTTP/1.1" status: 200  len: 375 time: 0.0156007
Jun 03 08:37:02.524658 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-af52a887-a2f2-4e93-a136-53fa8404e6a6 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=9769d84061ea436ab7b7d97278110278&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0450881
Jun 03 08:37:02.535890 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-1072dc4f-fa4a-440c-9985-f3ff7f3bd4e0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:02.783898 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1f79d85f-acf2-413e-8947-f294e195863c req-23dd9ef0-b16c-4527-be6b-671d6a201345 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/ports?device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 210 time: 0.0422039
Jun 03 08:37:02.968589 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 53880) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:03.090652 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-52ac08ad-6e58-4655-84cf-ec6c87196fa4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:03.108608 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-52ac08ad-6e58-4655-84cf-ec6c87196fa4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:37:03.112907 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-52ac08ad-6e58-4655-84cf-ec6c87196fa4 admin admin] Usage tracker for resource:security_group_rule and tenant:7cd4a9a43a6248e8958e087e4f773a25 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:37:03.115775 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-52ac08ad-6e58-4655-84cf-ec6c87196fa4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:37:03.121444 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-52ac08ad-6e58-4655-84cf-ec6c87196fa4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:37:03.207273 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-52ac08ad-6e58-4655-84cf-ec6c87196fa4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:03.307358 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-52ac08ad-6e58-4655-84cf-ec6c87196fa4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:03.315583 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-eafaf4cd-2f91-44fb-a43c-7243c1ad092f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:03.356055 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52ac08ad-6e58-4655-84cf-ec6c87196fa4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=26001a96-6140-4cfb-9f4a-932492ca4d51,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:03.360699 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-52ac08ad-6e58-4655-84cf-ec6c87196fa4 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=7cd4a9a43a6248e8958e087e4f773a25&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3910143
Jun 03 08:37:03.362571 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-52ac08ad-6e58-4655-84cf-ec6c87196fa4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:03.363686 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 53886) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:03.425071 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-4bb7432b-9634-4ac3-b1da-92702a74b887 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:03.457981 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-4bb7432b-9634-4ac3-b1da-92702a74b887 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:03.592865 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-4bb7432b-9634-4ac3-b1da-92702a74b887 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:03.598642 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e3e74759-f691-4313-b037-bb40bc56b290 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:03.611958 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bb7432b-9634-4ac3-b1da-92702a74b887 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=26001a96-6140-4cfb-9f4a-932492ca4d51,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:03.614034 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-4bb7432b-9634-4ac3-b1da-92702a74b887 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:03.630955 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-4bb7432b-9634-4ac3-b1da-92702a74b887 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:03.631128 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-4bb7432b-9634-4ac3-b1da-92702a74b887 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/26001a96-6140-4cfb-9f4a-932492ca4d51 HTTP/1.1" status: 204  len: 168 time: 0.2648880
Jun 03 08:37:03.885324 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0e93a23a-56d6-4123-a2e5-42cf40412528 req-81dbd118-af47-4fb2-be13-7feff19fd01d tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/ports?device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 210 time: 0.0464153
Jun 03 08:37:04.815848 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:05.041603 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b6a81ea0-bf8d-437c-a274-1bce1d968545 req-120f3eb0-c754-4c0d-ab1c-f134fb71c631 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/ports?device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 210 time: 0.0457709
Jun 03 08:37:05.244501 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-33daf3e6-56d8-424c-b3a9-25e24e851fa5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:05.504685 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-1b973ebb-82b9-4821-8831-4e72e4c7f75a tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.55 "GET /v2.0/networks?tenant_id=9769d84061ea436ab7b7d97278110278&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0265794
Jun 03 08:37:05.662620 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-c93b46d4-04ad-4f70-843e-d3f6e0c8792b tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:05.664036 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-c93b46d4-04ad-4f70-843e-d3f6e0c8792b tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.55 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.1541932
Jun 03 08:37:05.678504 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Request body: {'port': {'device_id': '6e8db443-b118-4bb2-a065-1fdddf99a4dc', 'network_id': 'ab8445d9-ca0f-4f8d-a3a6-879278f29bef', 'admin_state_up': True, 'tenant_id': '9769d84061ea436ab7b7d97278110278'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:37:05.824788 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:37:05.828640 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Usage tracker for resource:port and tenant:9769d84061ea436ab7b7d97278110278 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:37:05.831953 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:37:05.838038 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:37:05.937222 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Made reservation on behalf of 9769d84061ea436ab7b7d97278110278 for: {'port': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:37:05.943724 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:05.958772 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:05.975432 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:37:05.978671 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Usage tracker for resource:security_group_rule and tenant:9769d84061ea436ab7b7d97278110278 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:37:05.981563 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:37:05.989182 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:37:06.092940 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:06.215847 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-01aef003-653c-4820-9375-3951b4577fca req-9b339d2a-6e1b-4a97-9358-a9e7d68103bc tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/ports?device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 210 time: 0.0426011
Jun 03 08:37:06.221910 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:06.227292 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-7ef0ae56-9ce6-43ca-86ac-f449d6dc25e1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:06.243990 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:06.313182 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ed308533-9177-43f2-a03c-e71760884d5c,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:06.318938 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:06.406524 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Allocated IP 192.168.233.46 (ab8445d9-ca0f-4f8d-a3a6-879278f29bef/88f9612e-eb31-4bd0-847f-97b1f6d84cd0/3fb6ed83-5749-4766-be6e-bf70ab84d04c) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:37:06.613996 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:06.628916 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Transition to ACTIVE for port object 3fb6ed83-5749-4766-be6e-bf70ab84d04c will not be triggered until provisioned by entity DHCP. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:37:06.741902 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:06.747379 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-5c2e098e-b008-4001-8d79-e25198adb79b tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:06.816015 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Network ab8445d9-ca0f-4f8d-a3a6-879278f29bef is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:37:06.818971 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:37:06.822652 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:37:06.857371 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Pushing event updated for resources: {'Port': ['ID=3fb6ed83-5749-4766-be6e-bf70ab84d04c,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:06.862241 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:06.889949 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:06.890713 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:06.976907 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.55 "POST /v2.0/ports HTTP/1.1" status: 201  len: 937 time: 1.3019090
Jun 03 08:37:06.993122 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Request body: {'port': {'device_id': '6e8db443-b118-4bb2-a065-1fdddf99a4dc', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:37:07.111851 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:07.130196 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-5db0eb75-6af5-49ed-8d75-6e37f874042a None None] Provisioning for port 3fb6ed83-5749-4766-be6e-bf70ab84d04c completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:37:07.135819 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-5db0eb75-6af5-49ed-8d75-6e37f874042a None None] Provisioning complete for port 3fb6ed83-5749-4766-be6e-bf70ab84d04c triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:37:07.136275 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5db0eb75-6af5-49ed-8d75-6e37f874042a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:07.198181 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-5db0eb75-6af5-49ed-8d75-6e37f874042a None None] Port 3fb6ed83-5749-4766-be6e-bf70ab84d04c cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:37:07.490427 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f41678d-af9e-4129-af48-30bb480c4e7a req-7cdfe304-8618-4b9d-9512-68ab43cbe445 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:07.491148 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-8f41678d-af9e-4129-af48-30bb480c4e7a req-7cdfe304-8618-4b9d-9512-68ab43cbe445 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Synchronizing usage tracker for tenant:9769d84061ea436ab7b7d97278110278 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:37:07.644548 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3fb6ed83-5749-4766-be6e-bf70ab84d04c {{(pid=92323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:37:07.651696 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:07.666835 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Transition to ACTIVE for port object 3fb6ed83-5749-4766-be6e-bf70ab84d04c will not be triggered until provisioned by entity L2. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:37:07.712438 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-8f41678d-af9e-4129-af48-30bb480c4e7a req-7cdfe304-8618-4b9d-9512-68ab43cbe445 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Unset dirty status for tenant:9769d84061ea436ab7b7d97278110278 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:37:07.713611 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8f41678d-af9e-4129-af48-30bb480c4e7a req-7cdfe304-8618-4b9d-9512-68ab43cbe445 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/ports?device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 935 time: 0.3534787
Jun 03 08:37:07.757826 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-8f41678d-af9e-4129-af48-30bb480c4e7a req-df3cfbf7-f5a7-4c26-b426-cc7040296f1a tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Synchronizing usage tracker for tenant:9769d84061ea436ab7b7d97278110278 on resource:security_group {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:37:07.766792 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14211294'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:07.771998 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:07.929845 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Pushing event updated for resources: {'Port': ['ID=3fb6ed83-5749-4766-be6e-bf70ab84d04c,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:07.938343 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:07.940172 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-8f41678d-af9e-4129-af48-30bb480c4e7a req-df3cfbf7-f5a7-4c26-b426-cc7040296f1a tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Unset dirty status for tenant:9769d84061ea436ab7b7d97278110278 on resource:security_group {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:37:07.947065 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8f41678d-af9e-4129-af48-30bb480c4e7a req-df3cfbf7-f5a7-4c26-b426-cc7040296f1a tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/security-groups?id=ed308533-9177-43f2-a03c-e71760884d5c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2277873
Jun 03 08:37:08.023537 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Attempting to bind port 3fb6ed83-5749-4766-be6e-bf70ab84d04c on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:37:08.024042 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Attempting to bind port 3fb6ed83-5749-4766-be6e-bf70ab84d04c by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '3ec38b89-b78f-4968-8e7e-3fd7750417e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 520, 'network_id': 'ab8445d9-ca0f-4f8d-a3a6-879278f29bef'}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:37:08.024334 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Attempting to bind port 3fb6ed83-5749-4766-be6e-bf70ab84d04c on network ab8445d9-ca0f-4f8d-a3a6-879278f29bef {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:37:08.029373 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Port 3fb6ed83-5749-4766-be6e-bf70ab84d04c on network ab8445d9-ca0f-4f8d-a3a6-879278f29bef not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 03 08:37:08.029694 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Attempting to bind port 3fb6ed83-5749-4766-be6e-bf70ab84d04c on network ab8445d9-ca0f-4f8d-a3a6-879278f29bef {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:37:08.036587 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Checking agent: {'id': '181c5753-100b-4f03-bda8-e34279b057f4', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'started_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 36, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:37:08.036923 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Checking segment: {'id': '3ec38b89-b78f-4968-8e7e-3fd7750417e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 520, 'network_id': 'ab8445d9-ca0f-4f8d-a3a6-879278f29bef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:37:08.037362 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Bound using segment: {'id': '3ec38b89-b78f-4968-8e7e-3fd7750417e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 520, 'network_id': 'ab8445d9-ca0f-4f8d-a3a6-879278f29bef'} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:37:08.037757 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Bound port: 3fb6ed83-5749-4766-be6e-bf70ab84d04c, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3ec38b89-b78f-4968-8e7e-3fd7750417e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 520, 'network_id': 'ab8445d9-ca0f-4f8d-a3a6-879278f29bef'}}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:37:08.038103 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:08.041152 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:08.135290 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] For port 3fb6ed83-5749-4766-be6e-bf70ab84d04c, host hv-cinder-78726, cleared binding levels {{(pid=92323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:37:08.138609 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] For port 3fb6ed83-5749-4766-be6e-bf70ab84d04c, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=3fb6ed83-5749-4766-be6e-bf70ab84d04c,segment=NetworkSegment(3ec38b89-b78f-4968-8e7e-3fd7750417e4),segment_id=3ec38b89-b78f-4968-8e7e-3fd7750417e4)] {{(pid=92323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:37:08.244996 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14211294'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:08.250057 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:08.308875 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:08.309474 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:08.310858 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] 10.222.0.55 "PUT /v2.0/ports/3fb6ed83-5749-4766-be6e-bf70ab84d04c HTTP/1.1" status: 200  len: 1097 time: 1.3230751
Jun 03 08:37:08.311350 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6e8db443-b118-4bb2-a065-1fdddf99a4dc', 'tag': '3fb6ed83-5749-4766-be6e-bf70ab84d04c'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:37:08.313663 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5bfab087-e273-4e72-98a8-d583468872dc" -d '{"events": [{"name": "network-changed", "server_uuid": "6e8db443-b118-4bb2-a065-1fdddf99a4dc", "tag": "3fb6ed83-5749-4766-be6e-bf70ab84d04c"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:37:08.334352 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Pushing event updated for resources: {'Port': ['ID=3fb6ed83-5749-4766-be6e-bf70ab84d04c,revision_number=3']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:08.337464 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:11.123601 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:37:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cb22850c-4de0-48c2-a251-4bd8e11bce53 x-openstack-request-id: req-cb22850c-4de0-48c2-a251-4bd8e11bce53 {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:37:11.124617 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6e8db443-b118-4bb2-a065-1fdddf99a4dc", "tag": "3fb6ed83-5749-4766-be6e-bf70ab84d04c", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:37:11.125085 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-cb22850c-4de0-48c2-a251-4bd8e11bce53 {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:37:11.125716 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6e8db443-b118-4bb2-a065-1fdddf99a4dc', 'tag': '3fb6ed83-5749-4766-be6e-bf70ab84d04c', 'status': 'completed', 'code': 200}
Jun 03 08:37:11.283579 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bfab087-e273-4e72-98a8-d583468872dc req-52aa3b0b-5db8-43a2-afbf-0a9d8fbf1eca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:11.285105 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5bfab087-e273-4e72-98a8-d583468872dc req-52aa3b0b-5db8-43a2-afbf-0a9d8fbf1eca service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=9769d84061ea436ab7b7d97278110278&device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 1100 time: 0.1384203
Jun 03 08:37:11.300994 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d863b213-e640-4f17-8395-5d9c62172655 req-8d63eeca-7f9a-4f73-ae64-66532a9e970e tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:11.302411 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d863b213-e640-4f17-8395-5d9c62172655 req-8d63eeca-7f9a-4f73-ae64-66532a9e970e tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/ports?device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 947 time: 0.1096106
Jun 03 08:37:11.342357 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5bfab087-e273-4e72-98a8-d583468872dc req-e5b32bca-f281-4eac-801a-ccf8b7975c23 service neutron] 10.222.0.55 "GET /v2.0/networks?tenant_id=9769d84061ea436ab7b7d97278110278&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0388772
Jun 03 08:37:11.401761 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d863b213-e640-4f17-8395-5d9c62172655 req-d588081e-56f2-4112-a14d-cfc323dae5df tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/security-groups?id=ed308533-9177-43f2-a03c-e71760884d5c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0791798
Jun 03 08:37:11.494881 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bfab087-e273-4e72-98a8-d583468872dc req-de7b34ff-c724-42b3-81ed-904275b85a12 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:11.496354 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5bfab087-e273-4e72-98a8-d583468872dc req-de7b34ff-c724-42b3-81ed-904275b85a12 service neutron] 10.222.0.55 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1408358
Jun 03 08:37:11.609715 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-0348493f-28c3-4b14-b78f-cd2f95927a39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:11.611719 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-0348493f-28c3-4b14-b78f-cd2f95927a39 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=9769d84061ea436ab7b7d97278110278&device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 1100 time: 0.0734220
Jun 03 08:37:11.685881 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-03b33a0b-355b-4427-ab6b-30848ccc682c service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.46&port_id=3fb6ed83-5749-4766-be6e-bf70ab84d04c HTTP/1.1" status: 200  len: 217 time: 0.0639193
Jun 03 08:37:11.874985 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ede62b8c-7221-4dfb-addc-9278a8392c13 req-480a6cdd-d0bf-4f65-8e0c-4a9d82b69ebf tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-447492865&fields=id&tenant_id=96a989a900784d61a1475d86dd209c5f HTTP/1.1" status: 200  len: 267 time: 0.0425711
Jun 03 08:37:11.964611 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ede62b8c-7221-4dfb-addc-9278a8392c13 req-e8546d36-56ca-4abb-9f3f-b00efe14f5b4 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:11.966048 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ede62b8c-7221-4dfb-addc-9278a8392c13 req-e8546d36-56ca-4abb-9f3f-b00efe14f5b4 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 984 time: 0.0853631
Jun 03 08:37:11.977682 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [req-ede62b8c-7221-4dfb-addc-9278a8392c13 req-67c0a694-4ce3-459b-9e72-b5584205bb35 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Request body: {'port': {'security_groups': ['f03c63c9-82ad-4a26-aba6-7f507d2ecc01']}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:37:12.099997 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-ede62b8c-7221-4dfb-addc-9278a8392c13 req-67c0a694-4ce3-459b-9e72-b5584205bb35 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:12.443762 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.db [req-ede62b8c-7221-4dfb-addc-9278a8392c13 req-67c0a694-4ce3-459b-9e72-b5584205bb35 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] For port 37525065-c740-4aee-a826-af098f4b7727, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=37525065-c740-4aee-a826-af098f4b7727,segment=NetworkSegment(3151dd7e-a009-433b-ae5e-c81299e42bfb),segment_id=3151dd7e-a009-433b-ae5e-c81299e42bfb)] {{(pid=92324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:37:12.467872 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-ede62b8c-7221-4dfb-addc-9278a8392c13 req-67c0a694-4ce3-459b-9e72-b5584205bb35 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for port, precommit_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:12.569977 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-ede62b8c-7221-4dfb-addc-9278a8392c13 req-67c0a694-4ce3-459b-9e72-b5584205bb35 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15641369'] for port, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:12.578086 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:12.643128 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ede62b8c-7221-4dfb-addc-9278a8392c13 req-67c0a694-4ce3-459b-9e72-b5584205bb35 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:12.643760 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [req-ede62b8c-7221-4dfb-addc-9278a8392c13 req-67c0a694-4ce3-459b-9e72-b5584205bb35 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:12.645712 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ede62b8c-7221-4dfb-addc-9278a8392c13 req-67c0a694-4ce3-459b-9e72-b5584205bb35 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "PUT /v2.0/ports/37525065-c740-4aee-a826-af098f4b7727 HTTP/1.1" status: 200  len: 942 time: 0.6726065
Jun 03 08:37:12.646237 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '529b1368-4218-45b2-ac64-62f1d985b8b2', 'tag': '37525065-c740-4aee-a826-af098f4b7727'}] {{(pid=92324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:37:12.648626 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}25ad023063ed160b339e2d2d51ef3e5c51250aece1f4db0a35843dff1b64291a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5f05975f-0569-4efa-a0d6-006ad51e3d10" -d '{"events": [{"name": "network-changed", "server_uuid": "529b1368-4218-45b2-ac64-62f1d985b8b2", "tag": "37525065-c740-4aee-a826-af098f4b7727"}]}' {{(pid=92324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:37:12.650958 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 54016) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:12.677484 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67c0a694-4ce3-459b-9e72-b5584205bb35 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Pushing event updated for resources: {'Port': ['ID=37525065-c740-4aee-a826-af098f4b7727,revision_number=7']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:12.681663 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-67c0a694-4ce3-459b-9e72-b5584205bb35 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:12.735590 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-0e20512a-ed21-438b-9784-4e9b5c363922 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:12.772275 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-0e20512a-ed21-438b-9784-4e9b5c363922 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:12.820608 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-247b880e-8352-45c5-9223-c79791d68e5f None None] Provisioning complete for port 37525065-c740-4aee-a826-af098f4b7727 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:37:12.820608 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-247b880e-8352-45c5-9223-c79791d68e5f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:12.981516 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-0e20512a-ed21-438b-9784-4e9b5c363922 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:12.985427 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-ab6e2ecf-d40c-4881-867d-2256fefa7b7f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:12.999350 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e20512a-ed21-438b-9784-4e9b5c363922 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:13.003155 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-0e20512a-ed21-438b-9784-4e9b5c363922 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:13.066510 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-0e20512a-ed21-438b-9784-4e9b5c363922 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:13.067638 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-0e20512a-ed21-438b-9784-4e9b5c363922 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "DELETE /v2.0/security-groups/47ffcc99-d3ba-4004-9fe5-a5ba87fd4c9b HTTP/1.1" status: 204  len: 168 time: 0.4155853
Jun 03 08:37:13.070269 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 54020) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:13.342250 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-c0f10e1c-4eab-4658-adf6-234f7d54e671 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Deleting port a2571afe-f3a7-4d03-9f54-1dfe658f3762 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:37:13.342617 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c0f10e1c-4eab-4658-adf6-234f7d54e671 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:13.458593 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c0f10e1c-4eab-4658-adf6-234f7d54e671 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:13.458918 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c0f10e1c-4eab-4658-adf6-234f7d54e671 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:13.660097 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-c0f10e1c-4eab-4658-adf6-234f7d54e671 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Calling delete_port for a2571afe-f3a7-4d03-9f54-1dfe658f3762 owned by network:floatingip {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:37:13.870248 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c0f10e1c-4eab-4658-adf6-234f7d54e671 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:13.874020 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:13.916445 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0f10e1c-4eab-4658-adf6-234f7d54e671 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Pushing event deleted for resources: {'Port': ['ID=a2571afe-f3a7-4d03-9f54-1dfe658f3762,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:13.919443 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c0f10e1c-4eab-4658-adf6-234f7d54e671 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:14.008290 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c0f10e1c-4eab-4658-adf6-234f7d54e671 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks [] for floatingip, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:14.008625 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.db.l3_db [None req-c0f10e1c-4eab-4658-adf6-234f7d54e671 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Floating IP c207f89e-adc3-4f5d-93a8-fb726b6913e9 disassociated (deleted). External IP: 172.27.0.6, port: 37525065-c740-4aee-a826-af098f4b7727.
Jun 03 08:37:14.351831 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c0f10e1c-4eab-4658-adf6-234f7d54e671 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Router b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:37:14.529531 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c0f10e1c-4eab-4658-adf6-234f7d54e671 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:37:14.540436 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d049aa43-8585-46d2-9f89-48fffb81db51 None None] Sync routers for ids ['b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:37:14.550750 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d049aa43-8585-46d2-9f89-48fffb81db51 None None] Routers {'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:37:14.556874 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-d049aa43-8585-46d2-9f89-48fffb81db51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae85f1e970>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:37:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:14.622959 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-f9312124-6fad-4b7f-a75e-6bfb93516a9e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:14.624423 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-f9312124-6fad-4b7f-a75e-6bfb93516a9e service neutron] 10.222.0.55 "GET /v2.0/subnets?id=88f9612e-eb31-4bd0-847f-97b1f6d84cd0 HTTP/1.1" status: 200  len: 843 time: 0.0690312
Jun 03 08:37:14.635356 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['37525065-c740-4aee-a826-af098f4b7727'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:37:14.668065 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c0f10e1c-4eab-4658-adf6-234f7d54e671 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for floatingip, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:14.768578 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['37525065-c740-4aee-a826-af098f4b7727'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:37:14.797963 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-c0f10e1c-4eab-4658-adf6-234f7d54e671 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "DELETE /v2.0/floatingips/c207f89e-adc3-4f5d-93a8-fb726b6913e9 HTTP/1.1" status: 204  len: 168 time: 1.7266526
Jun 03 08:37:14.801241 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '529b1368-4218-45b2-ac64-62f1d985b8b2', 'tag': '37525065-c740-4aee-a826-af098f4b7727'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:37:14.803656 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9d378865-d1da-461c-8ddf-673d82edb052" -d '{"events": [{"name": "network-changed", "server_uuid": "529b1368-4218-45b2-ac64-62f1d985b8b2", "tag": "37525065-c740-4aee-a826-af098f4b7727"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:37:14.819629 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:37:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6a994be8-dbf2-41e7-bf02-45bc5e8df78b x-openstack-request-id: req-6a994be8-dbf2-41e7-bf02-45bc5e8df78b {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:37:14.826332 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "529b1368-4218-45b2-ac64-62f1d985b8b2", "tag": "37525065-c740-4aee-a826-af098f4b7727", "status": "completed", "code": 200}]} {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:37:14.826332 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-6a994be8-dbf2-41e7-bf02-45bc5e8df78b {{(pid=92324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:37:14.826332 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '529b1368-4218-45b2-ac64-62f1d985b8b2', 'tag': '37525065-c740-4aee-a826-af098f4b7727', 'status': 'completed', 'code': 200}
Jun 03 08:37:14.828411 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-4c35c4ed-4f53-4d09-9ae2-7ebba019070e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:14.830432 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-4c35c4ed-4f53-4d09-9ae2-7ebba019070e service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=ab8445d9-ca0f-4f8d-a3a6-879278f29bef&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1178 time: 0.1991212
Jun 03 08:37:14.866707 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b4b8884-8aa6-4a35-b9e2-d58ac5f87d3f req-b6b133aa-e6b0-4196-b0d1-154497f534d8 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:14.873429 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2b4b8884-8aa6-4a35-b9e2-d58ac5f87d3f req-b6b133aa-e6b0-4196-b0d1-154497f534d8 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/ports?device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 947 time: 0.1660368
Jun 03 08:37:14.974856 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-d049aa43-8585-46d2-9f89-48fffb81db51 None None] Set router b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:37:15.062956 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2b4b8884-8aa6-4a35-b9e2-d58ac5f87d3f req-9e099791-af8e-4349-ae12-1b5542d03c9a tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/security-groups?id=ed308533-9177-43f2-a03c-e71760884d5c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1883266
Jun 03 08:37:15.124928 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-d3c71937-1a3b-47f3-a1a6-c7142921b50f service neutron] 10.222.0.55 "GET /v2.0/networks/ab8445d9-ca0f-4f8d-a3a6-879278f29bef?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2851996
Jun 03 08:37:15.149752 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:37:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-66cd9a26-1570-42bf-8c5a-e459a18c2e2a x-openstack-request-id: req-66cd9a26-1570-42bf-8c5a-e459a18c2e2a {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:37:15.150092 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "529b1368-4218-45b2-ac64-62f1d985b8b2", "tag": "37525065-c740-4aee-a826-af098f4b7727", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:37:15.150370 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-66cd9a26-1570-42bf-8c5a-e459a18c2e2a {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:37:15.150840 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '529b1368-4218-45b2-ac64-62f1d985b8b2', 'tag': '37525065-c740-4aee-a826-af098f4b7727', 'status': 'completed', 'code': 200}
Jun 03 08:37:15.156898 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f05975f-0569-4efa-a0d6-006ad51e3d10 req-8cf43f70-41cf-4179-9d69-96d160465924 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:15.159405 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5f05975f-0569-4efa-a0d6-006ad51e3d10 req-8cf43f70-41cf-4179-9d69-96d160465924 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=96a989a900784d61a1475d86dd209c5f&device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 1098 time: 0.2807422
Jun 03 08:37:15.499521 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-d049aa43-8585-46d2-9f89-48fffb81db51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae85f1e970>, [{'id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'name': 'tempest-TestMinimumBasicScenario-825399230-router', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:52Z', 'updated_at': '2021-06-03T08:33:03Z', 'revision_number': 4, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'gw_port': {'id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:59:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 358, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:54Z', 'updated_at': '2021-06-03T08:33:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '67b7325f-861c-41e6-b770-4814b84aebba', 'name': '', 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'mac_address': 'fa:16:3e:22:e2:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 376, 'fixed_ips': [{'subnet_id': '159409d9-9245-4f6d-adbe-4aa8aad78d07', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:01Z', 'updated_at': '2021-06-03T08:33:15Z', 'revision_number': 5, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'subnets': [{'id': '159409d9-9245-4f6d-adbe-4aa8aad78d07', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:15.504042 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d049aa43-8585-46d2-9f89-48fffb81db51 None None] Checking router: b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:37:15.512319 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d049aa43-8585-46d2-9f89-48fffb81db51 None None] Routers {'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:37:15.512919 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-d049aa43-8585-46d2-9f89-48fffb81db51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae85f1e970>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:37:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:15.719261 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-d049aa43-8585-46d2-9f89-48fffb81db51 None None] Set router b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:37:16.034903 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-d049aa43-8585-46d2-9f89-48fffb81db51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae85f1e970>, [{'id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'name': 'tempest-TestMinimumBasicScenario-825399230-router', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:52Z', 'updated_at': '2021-06-03T08:33:03Z', 'revision_number': 4, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'gw_port': {'id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:59:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 358, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:54Z', 'updated_at': '2021-06-03T08:33:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '67b7325f-861c-41e6-b770-4814b84aebba', 'name': '', 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'mac_address': 'fa:16:3e:22:e2:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 376, 'fixed_ips': [{'subnet_id': '159409d9-9245-4f6d-adbe-4aa8aad78d07', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:01Z', 'updated_at': '2021-06-03T08:33:15Z', 'revision_number': 5, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'subnets': [{'id': '159409d9-9245-4f6d-adbe-4aa8aad78d07', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:16.038893 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d049aa43-8585-46d2-9f89-48fffb81db51 None None] The sync data for ids ['b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'] in dv-cinder-787262-5-iscsi is: [{'id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'name': 'tempest-TestMinimumBasicScenario-825399230-router', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:52Z', 'updated_at': '2021-06-03T08:33:03Z', 'revision_number': 4, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'gw_port': {'id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:59:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 358, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:54Z', 'updated_at': '2021-06-03T08:33:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '67b7325f-861c-41e6-b770-4814b84aebba', 'name': '', 'network_id': '113ded30-096c-4860-8773-fb717f3ea4c6', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'mac_address': 'fa:16:3e:22:e2:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 376, 'fixed_ips': [{'subnet_id': '159409d9-9245-4f6d-adbe-4aa8aad78d07', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:01Z', 'updated_at': '2021-06-03T08:33:15Z', 'revision_number': 5, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'subnets': [{'id': '159409d9-9245-4f6d-adbe-4aa8aad78d07', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:37:16.248347 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6978b17e-20bc-4cad-8cc5-5c7330a6a4b9 None None] New status for floating IP c207f89e-adc3-4f5d-93a8-fb726b6913e9: DOWN {{(pid=92326) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 03 08:37:18.280254 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1237763d-8f2f-4729-93d1-b75d7c2a7246 req-4f0830ff-55f2-414f-a3e1-a8f1c760ef12 service neutron] 10.222.0.55 "GET /v2.0/networks/ab8445d9-ca0f-4f8d-a3a6-879278f29bef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4185495
Jun 03 08:37:18.287388 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f05975f-0569-4efa-a0d6-006ad51e3d10 req-17c381ef-2941-4196-9fc6-55430055eb5f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:18.288703 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5f05975f-0569-4efa-a0d6-006ad51e3d10 req-17c381ef-2941-4196-9fc6-55430055eb5f service neutron] 10.222.0.55 "GET /v2.0/networks?id=113ded30-096c-4860-8773-fb717f3ea4c6 HTTP/1.1" status: 200  len: 915 time: 0.4022543
Jun 03 08:37:18.300810 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37ff1357-16ca-4ec6-920e-58a74668c2ea req-b900432c-55b0-423f-9b5f-6b876cc9a6f2 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:18.302248 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-37ff1357-16ca-4ec6-920e-58a74668c2ea req-b900432c-55b0-423f-9b5f-6b876cc9a6f2 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/ports?device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 947 time: 0.2587190
Jun 03 08:37:18.379407 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5f05975f-0569-4efa-a0d6-006ad51e3d10 req-e81b01fc-c88d-4712-a7e5-91f57989a495 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=37525065-c740-4aee-a826-af098f4b7727 HTTP/1.1" status: 200  len: 217 time: 0.0762138
Jun 03 08:37:18.403537 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-37ff1357-16ca-4ec6-920e-58a74668c2ea req-22c17867-89f4-4d2f-974b-03a7f4144d14 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/security-groups?id=ed308533-9177-43f2-a03c-e71760884d5c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0453944
Jun 03 08:37:18.462650 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f05975f-0569-4efa-a0d6-006ad51e3d10 req-52bc6ef5-59fb-4fc7-9018-a2a4e20f21a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:18.464075 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5f05975f-0569-4efa-a0d6-006ad51e3d10 req-52bc6ef5-59fb-4fc7-9018-a2a4e20f21a2 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=159409d9-9245-4f6d-adbe-4aa8aad78d07 HTTP/1.1" status: 200  len: 853 time: 0.0577750
Jun 03 08:37:18.549642 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f05975f-0569-4efa-a0d6-006ad51e3d10 req-9b458e25-873a-4653-9016-d6b5ce2cb423 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:18.550769 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5f05975f-0569-4efa-a0d6-006ad51e3d10 req-9b458e25-873a-4653-9016-d6b5ce2cb423 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=113ded30-096c-4860-8773-fb717f3ea4c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0788133
Jun 03 08:37:18.708628 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5f05975f-0569-4efa-a0d6-006ad51e3d10 req-9c4d47f4-6475-4ed8-bda8-6ff2cd28eac3 service neutron] 10.222.0.55 "GET /v2.0/networks/113ded30-096c-4860-8773-fb717f3ea4c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1370277
Jun 03 08:37:18.849843 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5f05975f-0569-4efa-a0d6-006ad51e3d10 req-6a4ca456-7f3d-4ee8-b40a-996999a1ae7a service neutron] 10.222.0.55 "GET /v2.0/networks/113ded30-096c-4860-8773-fb717f3ea4c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1291933
Jun 03 08:37:19.081972 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d378865-d1da-461c-8ddf-673d82edb052 req-c7826b45-958a-494f-bf76-bab5262fb578 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:19.083534 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9d378865-d1da-461c-8ddf-673d82edb052 req-c7826b45-958a-494f-bf76-bab5262fb578 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=96a989a900784d61a1475d86dd209c5f&device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 1098 time: 0.0798082
Jun 03 08:37:19.221341 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d378865-d1da-461c-8ddf-673d82edb052 req-c9d2845d-7338-4222-8db4-fb4721e036b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:19.222829 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9d378865-d1da-461c-8ddf-673d82edb052 req-c9d2845d-7338-4222-8db4-fb4721e036b4 service neutron] 10.222.0.55 "GET /v2.0/networks?id=113ded30-096c-4860-8773-fb717f3ea4c6 HTTP/1.1" status: 200  len: 915 time: 0.1318662
Jun 03 08:37:19.304814 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9d378865-d1da-461c-8ddf-673d82edb052 req-fa658796-9c60-4d37-8a06-4ab7fea281c7 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=37525065-c740-4aee-a826-af098f4b7727 HTTP/1.1" status: 200  len: 217 time: 0.0641553
Jun 03 08:37:19.380419 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d378865-d1da-461c-8ddf-673d82edb052 req-56a1de5e-5212-48fa-9f94-aff251e1b8a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:19.381891 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9d378865-d1da-461c-8ddf-673d82edb052 req-56a1de5e-5212-48fa-9f94-aff251e1b8a1 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=159409d9-9245-4f6d-adbe-4aa8aad78d07 HTTP/1.1" status: 200  len: 853 time: 0.0687613
Jun 03 08:37:19.468278 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d378865-d1da-461c-8ddf-673d82edb052 req-7485a69a-07e5-461d-a8e0-5b888a2f2dbc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:19.470197 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9d378865-d1da-461c-8ddf-673d82edb052 req-7485a69a-07e5-461d-a8e0-5b888a2f2dbc service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=113ded30-096c-4860-8773-fb717f3ea4c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0767753
Jun 03 08:37:19.664591 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9d378865-d1da-461c-8ddf-673d82edb052 req-84c6db2d-cc1d-4e49-bdc4-53dd506150f9 service neutron] 10.222.0.55 "GET /v2.0/networks/113ded30-096c-4860-8773-fb717f3ea4c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1871164
Jun 03 08:37:19.709755 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fbc0a28-068f-4f0e-8d93-2ad2e40e58ba req-e8745a1e-728c-4e55-a11c-f2386797b4f6 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:19.712004 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4fbc0a28-068f-4f0e-8d93-2ad2e40e58ba req-e8745a1e-728c-4e55-a11c-f2386797b4f6 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/ports?device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 947 time: 0.1955881
Jun 03 08:37:19.935766 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4fbc0a28-068f-4f0e-8d93-2ad2e40e58ba req-d0424d3f-bf5e-4394-aa18-efbfdf8cf5ce tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/security-groups?id=ed308533-9177-43f2-a03c-e71760884d5c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2170088
Jun 03 08:37:19.958118 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9d378865-d1da-461c-8ddf-673d82edb052 req-09d87ec8-7215-4a60-a3cd-d07f48fb1976 service neutron] 10.222.0.55 "GET /v2.0/networks/113ded30-096c-4860-8773-fb717f3ea4c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2848971
Jun 03 08:37:21.123852 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8c8649e-4fc6-40d0-8d5f-08e247be4ff5 req-8121d242-6bd1-46ca-b308-f352a5ede1e9 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:21.127809 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b8c8649e-4fc6-40d0-8d5f-08e247be4ff5 req-8121d242-6bd1-46ca-b308-f352a5ede1e9 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/ports?device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 947 time: 0.0825582
Jun 03 08:37:21.170474 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b8c8649e-4fc6-40d0-8d5f-08e247be4ff5 req-bcbf5536-e3d7-4599-9284-2b188200edea tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/security-groups?id=ed308533-9177-43f2-a03c-e71760884d5c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0388427
Jun 03 08:37:21.895805 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 3fb6ed83-5749-4766-be6e-bf70ab84d04c details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:37:22.060873 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 3fb6ed83-5749-4766-be6e-bf70ab84d04c, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=3fb6ed83-5749-4766-be6e-bf70ab84d04c,segment=NetworkSegment(3ec38b89-b78f-4968-8e7e-3fd7750417e4),segment_id=3ec38b89-b78f-4968-8e7e-3fd7750417e4)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:37:22.077741 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': '3fb6ed83-5749-4766-be6e-bf70ab84d04c', 'network_id': 'ab8445d9-ca0f-4f8d-a3a6-879278f29bef', 'port_id': '3fb6ed83-5749-4766-be6e-bf70ab84d04c', 'mac_address': 'fa:16:3e:11:8b:a0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 520, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '88f9612e-eb31-4bd0-847f-97b1f6d84cd0', 'ip_address': '192.168.233.46'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:37:22.144545 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:22.162897 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3fb6ed83-5749-4766-be6e-bf70ab84d04c {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:37:22.180163 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 3fb6ed83-5749-4766-be6e-bf70ab84d04c, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=3fb6ed83-5749-4766-be6e-bf70ab84d04c,segment=NetworkSegment(3ec38b89-b78f-4968-8e7e-3fd7750417e4),segment_id=3ec38b89-b78f-4968-8e7e-3fd7750417e4)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:37:22.301361 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:22.303217 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:22.377057 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=3fb6ed83-5749-4766-be6e-bf70ab84d04c,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:22.384722 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:22.385071 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:22.385409 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:22.385745 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:22.386075 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:22.386403 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:22.386751 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:22.387075 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:22.387396 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:22.387720 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:22.388039 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:22.388354 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:22.392282 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:22.538125 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8800cec-95c7-4662-91f1-7a766f3a45a7 req-6431eaf0-ebc5-4c33-b1e6-83eb49623f5b tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:22.539623 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b8800cec-95c7-4662-91f1-7a766f3a45a7 req-6431eaf0-ebc5-4c33-b1e6-83eb49623f5b tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/ports?device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 948 time: 0.0864956
Jun 03 08:37:22.567456 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['3fb6ed83-5749-4766-be6e-bf70ab84d04c'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:37:22.598890 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b8800cec-95c7-4662-91f1-7a766f3a45a7 req-ddd582a3-8be5-4e40-aa26-dd1cbd5e717f tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/security-groups?id=ed308533-9177-43f2-a03c-e71760884d5c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0522239
Jun 03 08:37:22.836825 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a477e4f7-e0fa-4e1d-acec-7cc32e02d3bc req-b5713119-5226-4543-85f9-9e41b3ff9720 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:22.837489 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-a477e4f7-e0fa-4e1d-acec-7cc32e02d3bc req-b5713119-5226-4543-85f9-9e41b3ff9720 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Synchronizing usage tracker for tenant:96a989a900784d61a1475d86dd209c5f on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:37:22.935126 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-a477e4f7-e0fa-4e1d-acec-7cc32e02d3bc req-b5713119-5226-4543-85f9-9e41b3ff9720 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Unset dirty status for tenant:96a989a900784d61a1475d86dd209c5f on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:37:22.936194 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a477e4f7-e0fa-4e1d-acec-7cc32e02d3bc req-b5713119-5226-4543-85f9-9e41b3ff9720 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 945 time: 0.1824257
Jun 03 08:37:22.981600 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-a477e4f7-e0fa-4e1d-acec-7cc32e02d3bc req-79ace81d-9531-4bff-a60b-669e95c451f7 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Synchronizing usage tracker for tenant:96a989a900784d61a1475d86dd209c5f on resource:security_group {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:37:23.055402 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-a477e4f7-e0fa-4e1d-acec-7cc32e02d3bc req-79ace81d-9531-4bff-a60b-669e95c451f7 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Unset dirty status for tenant:96a989a900784d61a1475d86dd209c5f on resource:security_group {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:37:23.056855 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a477e4f7-e0fa-4e1d-acec-7cc32e02d3bc req-79ace81d-9531-4bff-a60b-669e95c451f7 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1145704
Jun 03 08:37:23.786231 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dfe56b3-868e-4feb-a637-6a9c4a432240 req-75d800ea-f632-4725-88ca-e83865071da6 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:23.787748 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-4dfe56b3-868e-4feb-a637-6a9c4a432240 req-75d800ea-f632-4725-88ca-e83865071da6 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/ports?device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 948 time: 0.0827723
Jun 03 08:37:23.834674 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-4dfe56b3-868e-4feb-a637-6a9c4a432240 req-f2f572a8-cf7a-4f5b-96f5-274a43ca9160 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/security-groups?id=ed308533-9177-43f2-a03c-e71760884d5c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0412254
Jun 03 08:37:23.910486 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 3fb6ed83-5749-4766-be6e-bf70ab84d04c up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:37:24.124258 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning for port 3fb6ed83-5749-4766-be6e-bf70ab84d04c completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:37:24.129975 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port 3fb6ed83-5749-4766-be6e-bf70ab84d04c triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:37:24.130415 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:24.248203 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:24.251224 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c5577f1-4a1e-4f3c-bab0-83ed25c3e97b req-d351ac8b-4a3e-4bc1-a22e-a5c730d3e1b2 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:24.253368 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6c5577f1-4a1e-4f3c-bab0-83ed25c3e97b req-d351ac8b-4a3e-4bc1-a22e-a5c730d3e1b2 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 945 time: 0.0841942
Jun 03 08:37:24.276198 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6e8db443-b118-4bb2-a065-1fdddf99a4dc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3fb6ed83-5749-4766-be6e-bf70ab84d04c'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:37:24.278407 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3e6fa3c6-7f02-4501-9f6c-7a028d8bc842" -d '{"events": [{"server_uuid": "6e8db443-b118-4bb2-a065-1fdddf99a4dc", "name": "network-vif-plugged", "status": "completed", "tag": "3fb6ed83-5749-4766-be6e-bf70ab84d04c"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:37:24.285827 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 3fb6ed83-5749-4766-be6e-bf70ab84d04c, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=3fb6ed83-5749-4766-be6e-bf70ab84d04c,segment=NetworkSegment(3ec38b89-b78f-4968-8e7e-3fd7750417e4),segment_id=3ec38b89-b78f-4968-8e7e-3fd7750417e4)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:37:24.304089 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6c5577f1-4a1e-4f3c-bab0-83ed25c3e97b req-26f79cb8-a044-4b3f-9355-907b7b38fede tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0429602
Jun 03 08:37:24.330824 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:37:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cccce9ef-b04b-4fa6-baca-8d6d4e655e11 x-openstack-request-id: req-cccce9ef-b04b-4fa6-baca-8d6d4e655e11 {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:37:24.330824 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6e8db443-b118-4bb2-a065-1fdddf99a4dc", "name": "network-vif-plugged", "status": "completed", "tag": "3fb6ed83-5749-4766-be6e-bf70ab84d04c", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:37:24.330824 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-cccce9ef-b04b-4fa6-baca-8d6d4e655e11 {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:37:24.330824 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6e8db443-b118-4bb2-a065-1fdddf99a4dc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3fb6ed83-5749-4766-be6e-bf70ab84d04c', 'code': 200}
Jun 03 08:37:24.364001 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:24.367191 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:24.436124 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=3fb6ed83-5749-4766-be6e-bf70ab84d04c,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:24.439717 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:25.022201 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca20493-bae2-4951-a3e1-4d07a8abeffe req-557939f0-baf2-44d6-b419-a2304819caf7 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:25.024203 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-cca20493-bae2-4951-a3e1-4d07a8abeffe req-557939f0-baf2-44d6-b419-a2304819caf7 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/ports?device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 949 time: 0.0803671
Jun 03 08:37:25.073489 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-cca20493-bae2-4951-a3e1-4d07a8abeffe req-5eddbe9b-32ce-4938-9b7b-fd56f69a83bf tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/security-groups?id=ed308533-9177-43f2-a03c-e71760884d5c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0436046
Jun 03 08:37:26.089488 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:27.457798 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fd5365f-b8ae-4478-95f8-018d6f0d6781 req-2cd02f13-7584-49b3-8f89-29a4fabd6b7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:27.459645 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7fd5365f-b8ae-4478-95f8-018d6f0d6781 req-2cd02f13-7584-49b3-8f89-29a4fabd6b7a service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 1102 time: 0.0852058
Jun 03 08:37:27.502641 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7fd5365f-b8ae-4478-95f8-018d6f0d6781 req-2d5828a5-bbef-4172-9dd7-58228771556f service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=ed308533-9177-43f2-a03c-e71760884d5c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0349634
Jun 03 08:37:27.608040 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2930bc4f-d460-4376-ac8b-8459e1869c7d req-6575f55a-3484-4719-968b-4b9033b24a23 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:27.609519 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2930bc4f-d460-4376-ac8b-8459e1869c7d req-6575f55a-3484-4719-968b-4b9033b24a23 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/ports?device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 949 time: 0.0819421
Jun 03 08:37:27.659390 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2930bc4f-d460-4376-ac8b-8459e1869c7d req-0f1e401e-f1ad-466c-9aef-12246b0fec6b tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/security-groups?id=ed308533-9177-43f2-a03c-e71760884d5c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0432053
Jun 03 08:37:27.666007 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2061e4df-79f1-4a59-be37-4a050997368a req-edd02aed-ba51-47a0-a3ba-54cbb5c46675 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:27.667505 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2061e4df-79f1-4a59-be37-4a050997368a req-edd02aed-ba51-47a0-a3ba-54cbb5c46675 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 945 time: 0.1437900
Jun 03 08:37:27.675506 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbe1b15b-5cc2-4cd6-98a8-cc3cd275ac77 req-7d31ce72-ebd5-4432-87a5-52f32bcb1679 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:27.676954 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-dbe1b15b-5cc2-4cd6-98a8-cc3cd275ac77 req-7d31ce72-ebd5-4432-87a5-52f32bcb1679 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.55 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 945 time: 0.1084716
Jun 03 08:37:27.775103 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2061e4df-79f1-4a59-be37-4a050997368a req-4fdc3d18-5a9b-443e-8015-9d49d3b18386 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/security-groups?id=f03c63c9-82ad-4a26-aba6-7f507d2ecc01&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0969872
Jun 03 08:37:27.845354 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-dbe1b15b-5cc2-4cd6-98a8-cc3cd275ac77 req-4f7c322f-36ce-4cab-bd21-6109fcef42ed tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Deleting port 37525065-c740-4aee-a826-af098f4b7727 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:37:27.845692 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-dbe1b15b-5cc2-4cd6-98a8-cc3cd275ac77 req-4f7c322f-36ce-4cab-bd21-6109fcef42ed tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:27.979830 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-dbe1b15b-5cc2-4cd6-98a8-cc3cd275ac77 req-4f7c322f-36ce-4cab-bd21-6109fcef42ed tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] For port 37525065-c740-4aee-a826-af098f4b7727, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=37525065-c740-4aee-a826-af098f4b7727,segment=NetworkSegment(3151dd7e-a009-433b-ae5e-c81299e42bfb),segment_id=3151dd7e-a009-433b-ae5e-c81299e42bfb)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:37:27.982866 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-dbe1b15b-5cc2-4cd6-98a8-cc3cd275ac77 req-4f7c322f-36ce-4cab-bd21-6109fcef42ed tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:28.104466 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-dbe1b15b-5cc2-4cd6-98a8-cc3cd275ac77 req-4f7c322f-36ce-4cab-bd21-6109fcef42ed tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Calling delete_port for 37525065-c740-4aee-a826-af098f4b7727 owned by compute:nova {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:37:28.301244 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-dbe1b15b-5cc2-4cd6-98a8-cc3cd275ac77 req-4f7c322f-36ce-4cab-bd21-6109fcef42ed tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:28.307840 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:28.355360 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f7c322f-36ce-4cab-bd21-6109fcef42ed tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Pushing event deleted for resources: {'Port': ['ID=37525065-c740-4aee-a826-af098f4b7727,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:28.358580 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-4f7c322f-36ce-4cab-bd21-6109fcef42ed tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:28.433765 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-dbe1b15b-5cc2-4cd6-98a8-cc3cd275ac77 req-4f7c322f-36ce-4cab-bd21-6109fcef42ed tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] No DVR routers for this DVR port 37525065-c740-4aee-a826-af098f4b7727 on host hv-cinder-78726 {{(pid=92323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:37:28.436136 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-dbe1b15b-5cc2-4cd6-98a8-cc3cd275ac77 req-4f7c322f-36ce-4cab-bd21-6109fcef42ed tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:28.438843 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '529b1368-4218-45b2-ac64-62f1d985b8b2', 'name': 'network-vif-deleted', 'tag': '37525065-c740-4aee-a826-af098f4b7727'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:37:28.441152 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5eea3a79-9f10-4489-8cf1-67a5404715dd" -d '{"events": [{"server_uuid": "529b1368-4218-45b2-ac64-62f1d985b8b2", "name": "network-vif-deleted", "tag": "37525065-c740-4aee-a826-af098f4b7727"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:37:28.501242 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:37:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e4c835a2-1a1a-4058-9907-bdbd1222e2cb x-openstack-request-id: req-e4c835a2-1a1a-4058-9907-bdbd1222e2cb {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:37:28.502259 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "529b1368-4218-45b2-ac64-62f1d985b8b2", "name": "network-vif-deleted", "tag": "37525065-c740-4aee-a826-af098f4b7727", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:37:28.502563 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-e4c835a2-1a1a-4058-9907-bdbd1222e2cb {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:37:28.503202 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '529b1368-4218-45b2-ac64-62f1d985b8b2', 'name': 'network-vif-deleted', 'tag': '37525065-c740-4aee-a826-af098f4b7727', 'status': 'completed', 'code': 200}
Jun 03 08:37:28.542673 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-dbe1b15b-5cc2-4cd6-98a8-cc3cd275ac77 req-4f7c322f-36ce-4cab-bd21-6109fcef42ed tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.55 "DELETE /v2.0/ports/37525065-c740-4aee-a826-af098f4b7727 HTTP/1.1" status: 204  len: 173 time: 0.8497076
Jun 03 08:37:28.892628 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2546de4c-5727-40c9-a508-394b36b14e8f req-5a3d9eaf-4c8e-4209-bb6f-f518af0c5643 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:28.894901 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2546de4c-5727-40c9-a508-394b36b14e8f req-5a3d9eaf-4c8e-4209-bb6f-f518af0c5643 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/ports?device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 949 time: 0.1104901
Jun 03 08:37:28.951284 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2546de4c-5727-40c9-a508-394b36b14e8f req-a9a11ff6-abe8-44a2-9759-6b36a1d08435 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/security-groups?id=ed308533-9177-43f2-a03c-e71760884d5c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0475490
Jun 03 08:37:28.983882 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-71b573bb-0504-4c42-8951-2b7024f7580b req-3866a99d-9761-4022-b978-f51d12c8f6a1 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Synchronizing usage tracker for tenant:96a989a900784d61a1475d86dd209c5f on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:37:29.032696 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-71b573bb-0504-4c42-8951-2b7024f7580b req-3866a99d-9761-4022-b978-f51d12c8f6a1 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Unset dirty status for tenant:96a989a900784d61a1475d86dd209c5f on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:37:29.033853 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-71b573bb-0504-4c42-8951-2b7024f7580b req-3866a99d-9761-4022-b978-f51d12c8f6a1 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] 10.222.0.11 "GET /v2.0/ports?device_id=529b1368-4218-45b2-ac64-62f1d985b8b2 HTTP/1.1" status: 200  len: 210 time: 0.1041653
Jun 03 08:37:29.744819 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6a2a4f3-c928-4b9a-84b0-4d3b9e93c553 req-804a2289-9b98-4414-b10c-9c5a844192bd tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:29.745732 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a6a2a4f3-c928-4b9a-84b0-4d3b9e93c553 req-804a2289-9b98-4414-b10c-9c5a844192bd tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/ports?device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 949 time: 0.0907960
Jun 03 08:37:29.792401 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a6a2a4f3-c928-4b9a-84b0-4d3b9e93c553 req-c7804862-18b6-402c-a550-6e50311424b2 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/security-groups?id=ed308533-9177-43f2-a03c-e71760884d5c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400467
Jun 03 08:37:29.956713 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 37525065-c740-4aee-a826-af098f4b7727 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:37:29.992064 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] No Port match for: 37525065-c740-4aee-a826-af098f4b7727 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:37:29.992413 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 37525065-c740-4aee-a826-af098f4b7727 not bound to the agent host hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:37:31.031102 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06bc08a1-e8fe-45f6-bf6a-f5c341670f89 req-2a924985-1fee-4cb6-a8df-3f1e9af30b71 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:31.032619 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-06bc08a1-e8fe-45f6-bf6a-f5c341670f89 req-2a924985-1fee-4cb6-a8df-3f1e9af30b71 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/ports?device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 949 time: 0.0872233
Jun 03 08:37:31.083981 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-06bc08a1-e8fe-45f6-bf6a-f5c341670f89 req-aa52a43a-8ca5-4fc8-a8e0-f6f2024c182f tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/security-groups?id=ed308533-9177-43f2-a03c-e71760884d5c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0443532
Jun 03 08:37:31.108927 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 54308) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:31.169356 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_v2 [None req-202b0576-d856-485e-8092-0532306fe0a4 admin admin] Deleting subnet 511f126c-ca8b-42fb-80d6-5f4b9a80cf7e {{(pid=92323) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 03 08:37:31.172282 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-202b0576-d856-485e-8092-0532306fe0a4 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:31.227014 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-202b0576-d856-485e-8092-0532306fe0a4 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14518184'] for subnet, precommit_delete_associations {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:31.336096 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-202b0576-d856-485e-8092-0532306fe0a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-862421'] for subnet, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:31.512756 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c6ef262-658e-473b-b600-35bc26f4bd04 req-204e96a0-f1b8-424b-be9a-d749f651163c tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:31.514231 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1c6ef262-658e-473b-b600-35bc26f4bd04 req-204e96a0-f1b8-424b-be9a-d749f651163c tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.55 "GET /v2.0/ports?device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 949 time: 0.2576458
Jun 03 08:37:31.790485 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-1c6ef262-658e-473b-b600-35bc26f4bd04 req-68f8b023-38e6-4cbd-9fe2-985e2995ae92 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Deleting port 3fb6ed83-5749-4766-be6e-bf70ab84d04c {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:37:31.790846 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-1c6ef262-658e-473b-b600-35bc26f4bd04 req-68f8b023-38e6-4cbd-9fe2-985e2995ae92 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:31.826609 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 54316) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:31.901467 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-202b0576-d856-485e-8092-0532306fe0a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-862434', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14211216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14857862'] for subnet, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:31.912467 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:31.952093 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-202b0576-d856-485e-8092-0532306fe0a4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=511f126c-ca8b-42fb-80d6-5f4b9a80cf7e,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:31.955286 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-202b0576-d856-485e-8092-0532306fe0a4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:31.960106 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-202b0576-d856-485e-8092-0532306fe0a4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:31.979420 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-202b0576-d856-485e-8092-0532306fe0a4 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/511f126c-ca8b-42fb-80d6-5f4b9a80cf7e HTTP/1.1" status: 204  len: 168 time: 0.8692708
Jun 03 08:37:31.981691 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 54324) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:32.028301 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-1c6ef262-658e-473b-b600-35bc26f4bd04 req-68f8b023-38e6-4cbd-9fe2-985e2995ae92 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] For port 3fb6ed83-5749-4766-be6e-bf70ab84d04c, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=3fb6ed83-5749-4766-be6e-bf70ab84d04c,segment=NetworkSegment(3ec38b89-b78f-4968-8e7e-3fd7750417e4),segment_id=3ec38b89-b78f-4968-8e7e-3fd7750417e4)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:37:32.028301 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-1c6ef262-658e-473b-b600-35bc26f4bd04 req-68f8b023-38e6-4cbd-9fe2-985e2995ae92 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:32.240902 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-1c6ef262-658e-473b-b600-35bc26f4bd04 req-68f8b023-38e6-4cbd-9fe2-985e2995ae92 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Calling delete_port for 3fb6ed83-5749-4766-be6e-bf70ab84d04c owned by compute:nova {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:37:32.294760 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-77257950-2bfe-4319-ab87-3c609f6e2155 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-529010'] for network, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:32.432178 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0b3776e3-d1a5-411d-b4cf-8be8d83d0284 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-16328733'] for router_interface, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:32.472592 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-77257950-2bfe-4319-ab87-3c609f6e2155 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-862046', 'neutron.services.segments.db._delete_segments_for_network-8774224358894'] for network, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:32.494883 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7463159-e1a4-436d-8cb4-f62381c9aefc req-aaad9179-1283-4aac-931b-0238ce6eb6c3 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:32.495695 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c7463159-e1a4-436d-8cb4-f62381c9aefc req-aaad9179-1283-4aac-931b-0238ce6eb6c3 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/ports?device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 949 time: 0.2626581
Jun 03 08:37:32.497459 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-77257950-2bfe-4319-ab87-3c609f6e2155 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fae857bd790>,) {'filters': {'network_id': ['d6b7a34f-3fa8-4a38-ab72-8c6458a51990']}} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:32.527726 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-77257950-2bfe-4319-ab87-3c609f6e2155 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fae857bd790>, '6978222c-6678-416a-a506-1fa962d91d64') {'for_net_delete': True} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:32.528080 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-77257950-2bfe-4319-ab87-3c609f6e2155 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fae857bd790>, '6978222c-6678-416a-a506-1fa962d91d64') {} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:32.529920 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-f6d74937-84fe-4166-89f6-9633988f8413 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:32.599331 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-77257950-2bfe-4319-ab87-3c609f6e2155 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8774224362253', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14518195'] for segment, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:32.626271 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c7463159-e1a4-436d-8cb4-f62381c9aefc req-a3b71f3e-355a-4a6a-999a-926f911cac95 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/security-groups?id=ed308533-9177-43f2-a03c-e71760884d5c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1205876
Jun 03 08:37:32.638362 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-77257950-2bfe-4319-ab87-3c609f6e2155 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:32.646009 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-77257950-2bfe-4319-ab87-3c609f6e2155 admin admin] Releasing vlan 523 on physical network physnet1 to pool {{(pid=92323) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 03 08:37:32.646467 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-77257950-2bfe-4319-ab87-3c609f6e2155 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14211322'] for segment, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]: Traceback (most recent call last):
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:     timer()
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:     cb(*args, **kw)
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:     return func(*args, **kwargs)
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:     self._notify()
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:     self.callback(batched_events)
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:     event.method(event)
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:     return f(self, *a, **k)
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self._get(url).json()
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self.request(url, 'GET', **kwargs)
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 03 08:37:32.660392 dv-cinder-787262-5-iscsi neutron-server[92323]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 03 08:37:32.730585 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-1c6ef262-658e-473b-b600-35bc26f4bd04 req-68f8b023-38e6-4cbd-9fe2-985e2995ae92 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:32.736153 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-e80e74ec-3c2d-4bb0-9c6f-a29bd2a5fff9 tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:32.781092 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68f8b023-38e6-4cbd-9fe2-985e2995ae92 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Pushing event deleted for resources: {'Port': ['ID=3fb6ed83-5749-4766-be6e-bf70ab84d04c,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:32.785293 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-68f8b023-38e6-4cbd-9fe2-985e2995ae92 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:32.869153 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-1c6ef262-658e-473b-b600-35bc26f4bd04 req-68f8b023-38e6-4cbd-9fe2-985e2995ae92 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] No DVR routers for this DVR port 3fb6ed83-5749-4766-be6e-bf70ab84d04c on host hv-cinder-78726 {{(pid=92323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:37:32.871148 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-77257950-2bfe-4319-ab87-3c609f6e2155 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-862039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16327709'] for network, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:32.872938 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-1c6ef262-658e-473b-b600-35bc26f4bd04 req-68f8b023-38e6-4cbd-9fe2-985e2995ae92 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:32.876032 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6e8db443-b118-4bb2-a065-1fdddf99a4dc', 'name': 'network-vif-deleted', 'tag': '3fb6ed83-5749-4766-be6e-bf70ab84d04c'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:37:32.878320 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f69bd392-ed7f-4b9a-9a7f-a2582e0a4404" -d '{"events": [{"server_uuid": "6e8db443-b118-4bb2-a065-1fdddf99a4dc", "name": "network-vif-deleted", "tag": "3fb6ed83-5749-4766-be6e-bf70ab84d04c"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:37:32.887464 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-165d30f4-edcc-4fd7-ba86-474fd06d0a0b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:32.902841 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-77257950-2bfe-4319-ab87-3c609f6e2155 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:32.914460 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77257950-2bfe-4319-ab87-3c609f6e2155 admin admin] Pushing event deleted for resources: {'Network': ['ID=d6b7a34f-3fa8-4a38-ab72-8c6458a51990,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:32.920070 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-77257950-2bfe-4319-ab87-3c609f6e2155 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:32.949047 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:37:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a0645853-a634-4423-ae8b-0eecc6106bea x-openstack-request-id: req-a0645853-a634-4423-ae8b-0eecc6106bea {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:37:32.949371 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6e8db443-b118-4bb2-a065-1fdddf99a4dc", "name": "network-vif-deleted", "tag": "3fb6ed83-5749-4766-be6e-bf70ab84d04c", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:37:32.949654 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-a0645853-a634-4423-ae8b-0eecc6106bea {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:37:32.950070 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6e8db443-b118-4bb2-a065-1fdddf99a4dc', 'name': 'network-vif-deleted', 'tag': '3fb6ed83-5749-4766-be6e-bf70ab84d04c', 'status': 'completed', 'code': 200}
Jun 03 08:37:32.973132 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1c6ef262-658e-473b-b600-35bc26f4bd04 req-68f8b023-38e6-4cbd-9fe2-985e2995ae92 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.55 "DELETE /v2.0/ports/3fb6ed83-5749-4766-be6e-bf70ab84d04c HTTP/1.1" status: 204  len: 173 time: 1.4063883
Jun 03 08:37:32.974553 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-77257950-2bfe-4319-ab87-3c609f6e2155 admin admin] 10.222.0.11 "DELETE /v2.0/networks/d6b7a34f-3fa8-4a38-ab72-8c6458a51990 HTTP/1.1" status: 204  len: 168 time: 0.9918957
Jun 03 08:37:32.999964 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-0b3776e3-d1a5-411d-b4cf-8be8d83d0284 admin admin] Deleting port 67b7325f-861c-41e6-b770-4814b84aebba {{(pid=92324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:37:33.000573 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0b3776e3-d1a5-411d-b4cf-8be8d83d0284 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:33.136356 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.db [None req-0b3776e3-d1a5-411d-b4cf-8be8d83d0284 admin admin] For port 67b7325f-861c-41e6-b770-4814b84aebba, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=67b7325f-861c-41e6-b770-4814b84aebba,segment=NetworkSegment(3151dd7e-a009-433b-ae5e-c81299e42bfb),segment_id=3151dd7e-a009-433b-ae5e-c81299e42bfb)] {{(pid=92324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:37:33.136806 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0b3776e3-d1a5-411d-b4cf-8be8d83d0284 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:33.272556 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-0b3776e3-d1a5-411d-b4cf-8be8d83d0284 admin admin] Calling delete_port for 67b7325f-861c-41e6-b770-4814b84aebba owned by network:router_interface {{(pid=92324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:37:33.386051 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 54344) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:33.435764 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-83b86f71-05e0-4c1d-9ade-1d2a10fad9e2 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=9a96090cd93b48608ead040676d45129&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0483210
Jun 03 08:37:33.438104 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 54346) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:33.483788 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0b3776e3-d1a5-411d-b4cf-8be8d83d0284 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:33.488598 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:33.505653 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-34a7f030-754f-4228-a656-2a84b54a74be admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:33.535117 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-34a7f030-754f-4228-a656-2a84b54a74be admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:33.538376 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b3776e3-d1a5-411d-b4cf-8be8d83d0284 admin admin] Pushing event deleted for resources: {'Port': ['ID=67b7325f-861c-41e6-b770-4814b84aebba,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:33.541326 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-0b3776e3-d1a5-411d-b4cf-8be8d83d0284 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:33.689854 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-34a7f030-754f-4228-a656-2a84b54a74be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:33.707705 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f062e2a0-2f4e-46e5-a97b-98c38b489eb4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:33.733950 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34a7f030-754f-4228-a656-2a84b54a74be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1455c957-f90c-4cab-a146-6db18bd88bec,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:33.743804 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-34a7f030-754f-4228-a656-2a84b54a74be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:33.894589 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0b3776e3-d1a5-411d-b4cf-8be8d83d0284 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-16344783', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-16328833'] for router_interface, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:33.983610 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 3fb6ed83-5749-4766-be6e-bf70ab84d04c no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:37:33.985394 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-12a37fe7-8cd0-4963-90c7-e0762b2b9cd7 req-75bc608c-dc5f-4c7b-a82e-21bb15cbce8f tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Synchronizing usage tracker for tenant:9769d84061ea436ab7b7d97278110278 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:37:33.990540 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-34a7f030-754f-4228-a656-2a84b54a74be admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:33.991540 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-34a7f030-754f-4228-a656-2a84b54a74be admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/1455c957-f90c-4cab-a146-6db18bd88bec HTTP/1.1" status: 204  len: 168 time: 0.5524967
Jun 03 08:37:34.024814 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] No Port match for: 3fb6ed83-5749-4766-be6e-bf70ab84d04c {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:37:34.025174 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 3fb6ed83-5749-4766-be6e-bf70ab84d04c not bound to the agent host hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:37:34.089709 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-12a37fe7-8cd0-4963-90c7-e0762b2b9cd7 req-75bc608c-dc5f-4c7b-a82e-21bb15cbce8f tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Unset dirty status for tenant:9769d84061ea436ab7b7d97278110278 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:37:34.092317 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-12a37fe7-8cd0-4963-90c7-e0762b2b9cd7 req-75bc608c-dc5f-4c7b-a82e-21bb15cbce8f tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] 10.222.0.11 "GET /v2.0/ports?device_id=6e8db443-b118-4bb2-a065-1fdddf99a4dc HTTP/1.1" status: 200  len: 210 time: 0.2997463
Jun 03 08:37:34.399609 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0b3776e3-d1a5-411d-b4cf-8be8d83d0284 admin admin] Router b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:37:34.399781 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 54370) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:34.608443 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0b3776e3-d1a5-411d-b4cf-8be8d83d0284 admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:37:34.610074 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-fc7c45ea-e2ba-4adb-a6f5-add0b82f2f4e admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:34.617808 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c7e3bd5-8bd7-4a27-83eb-d5ff1610f236 None None] Sync routers for ids ['b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:37:34.626958 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c7e3bd5-8bd7-4a27-83eb-d5ff1610f236 None None] Routers {'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:37:34.628249 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-0c7e3bd5-8bd7-4a27-83eb-d5ff1610f236 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae861759d0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:37:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:34.636579 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-fc7c45ea-e2ba-4adb-a6f5-add0b82f2f4e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:37:34.640449 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-fc7c45ea-e2ba-4adb-a6f5-add0b82f2f4e admin admin] Usage tracker for resource:security_group_rule and tenant:fb773804dc5042588f61ab36ab4c1837 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:37:34.644628 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-fc7c45ea-e2ba-4adb-a6f5-add0b82f2f4e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:37:34.650368 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-fc7c45ea-e2ba-4adb-a6f5-add0b82f2f4e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:37:34.742015 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-fc7c45ea-e2ba-4adb-a6f5-add0b82f2f4e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:34.746485 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-0b3776e3-d1a5-411d-b4cf-8be8d83d0284 admin admin] 10.222.0.11 "PUT /v2.0/routers/b0a93675-90ab-4436-ae4b-fc8b1f1a6c97/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.9184864
Jun 03 08:37:34.748765 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 54376) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:34.824282 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-fc7c45ea-e2ba-4adb-a6f5-add0b82f2f4e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:34.826723 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-0c7e3bd5-8bd7-4a27-83eb-d5ff1610f236 None None] Set router b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:37:34.838740 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-6a186f43-5777-4377-90a7-7652fb7fa28b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:34.880890 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-fc7c45ea-e2ba-4adb-a6f5-add0b82f2f4e admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=fb773804dc5042588f61ab36ab4c1837&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4801247
Jun 03 08:37:34.883927 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 54378) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:34.946909 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a4f5fea0-ac0a-4871-a839-de169f646197 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:34.961777 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc7c45ea-e2ba-4adb-a6f5-add0b82f2f4e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7cb3bd14-b4cd-4a68-a14d-c5a8c4d8106d,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:34.966769 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-fc7c45ea-e2ba-4adb-a6f5-add0b82f2f4e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:34.978815 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a4f5fea0-ac0a-4871-a839-de169f646197 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:34.988661 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-df527344-ce09-446d-8365-e7edf2b6c1b7 admin admin] Notify callbacks [] for router, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:35.035509 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:35.106961 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a4f5fea0-ac0a-4871-a839-de169f646197 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:35.114783 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-6b5a0cbf-c1e7-4563-b186-38a0899fde70 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:35.130717 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4f5fea0-ac0a-4871-a839-de169f646197 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7cb3bd14-b4cd-4a68-a14d-c5a8c4d8106d,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:35.133934 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a4f5fea0-ac0a-4871-a839-de169f646197 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:35.135456 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a4f5fea0-ac0a-4871-a839-de169f646197 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:35.137712 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-a4f5fea0-ac0a-4871-a839-de169f646197 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/7cb3bd14-b4cd-4a68-a14d-c5a8c4d8106d HTTP/1.1" status: 204  len: 168 time: 0.2521026
Jun 03 08:37:35.176913 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-0c7e3bd5-8bd7-4a27-83eb-d5ff1610f236 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae861759d0>, [{'id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'name': 'tempest-TestMinimumBasicScenario-825399230-router', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:52Z', 'updated_at': '2021-06-03T08:37:33Z', 'revision_number': 5, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'gw_port': {'id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:59:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 358, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:54Z', 'updated_at': '2021-06-03T08:33:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:35.184804 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c7e3bd5-8bd7-4a27-83eb-d5ff1610f236 None None] Checking router: b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:37:35.193003 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-df527344-ce09-446d-8365-e7edf2b6c1b7 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:35.204490 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c7e3bd5-8bd7-4a27-83eb-d5ff1610f236 None None] Routers {'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:37:35.205120 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-0c7e3bd5-8bd7-4a27-83eb-d5ff1610f236 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae861759d0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:37:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:35.298243 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-e4d74ee3-7979-41f3-afbd-3abee48408ef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:35.331422 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:37:35.407973 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-df527344-ce09-446d-8365-e7edf2b6c1b7 admin admin] Deleting port 7bd8082c-c1ea-4edf-bafc-03cff8ed0641 {{(pid=92324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:37:35.409478 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-df527344-ce09-446d-8365-e7edf2b6c1b7 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:35.428066 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-0c7e3bd5-8bd7-4a27-83eb-d5ff1610f236 None None] Set router b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:37:35.559900 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.db [None req-df527344-ce09-446d-8365-e7edf2b6c1b7 admin admin] For port 7bd8082c-c1ea-4edf-bafc-03cff8ed0641, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=7bd8082c-c1ea-4edf-bafc-03cff8ed0641,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:37:35.560465 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-df527344-ce09-446d-8365-e7edf2b6c1b7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:35.708507 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-df527344-ce09-446d-8365-e7edf2b6c1b7 admin admin] Calling delete_port for 7bd8082c-c1ea-4edf-bafc-03cff8ed0641 owned by network:router_gateway {{(pid=92324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:37:35.812879 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-0c7e3bd5-8bd7-4a27-83eb-d5ff1610f236 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae861759d0>, [{'id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'name': 'tempest-TestMinimumBasicScenario-825399230-router', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:52Z', 'updated_at': '2021-06-03T08:37:33Z', 'revision_number': 5, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'gw_port': {'id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:59:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 358, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:54Z', 'updated_at': '2021-06-03T08:33:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:35.817763 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c7e3bd5-8bd7-4a27-83eb-d5ff1610f236 None None] The sync data for ids ['b0a93675-90ab-4436-ae4b-fc8b1f1a6c97'] in dv-cinder-787262-5-iscsi is: [{'id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'name': 'tempest-TestMinimumBasicScenario-825399230-router', 'tenant_id': '96a989a900784d61a1475d86dd209c5f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99'}], 'enable_snat': True}, 'gw_port_id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:32:52Z', 'updated_at': '2021-06-03T08:37:33Z', 'revision_number': 5, 'project_id': '96a989a900784d61a1475d86dd209c5f', 'gw_port': {'id': '7bd8082c-c1ea-4edf-bafc-03cff8ed0641', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:59:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0a93675-90ab-4436-ae4b-fc8b1f1a6c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 358, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:32:54Z', 'updated_at': '2021-06-03T08:33:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:37:35.952900 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-df527344-ce09-446d-8365-e7edf2b6c1b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:35.959244 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-67c0a694-4ce3-459b-9e72-b5584205bb35 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:36.005950 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df527344-ce09-446d-8365-e7edf2b6c1b7 admin admin] Pushing event deleted for resources: {'Port': ['ID=7bd8082c-c1ea-4edf-bafc-03cff8ed0641,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:36.031693 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-df527344-ce09-446d-8365-e7edf2b6c1b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:36.100226 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-df527344-ce09-446d-8365-e7edf2b6c1b7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-16327738'] for router_gateway, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:36.228197 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:36.378039 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 67b7325f-861c-41e6-b770-4814b84aebba no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:37:36.416223 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-df527344-ce09-446d-8365-e7edf2b6c1b7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-16388336', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2351'] for router, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:36.419186 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-df527344-ce09-446d-8365-e7edf2b6c1b7 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:36.421739 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: 67b7325f-861c-41e6-b770-4814b84aebba {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:37:36.422100 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 67b7325f-861c-41e6-b770-4814b84aebba not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:37:36.518412 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-df527344-ce09-446d-8365-e7edf2b6c1b7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-16388448'] for router, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:36.519494 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-df527344-ce09-446d-8365-e7edf2b6c1b7 admin admin] Fanout notify agent at l3_agent the message router_deleted on router b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 {{(pid=92324) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 03 08:37:36.540817 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-df527344-ce09-446d-8365-e7edf2b6c1b7 admin admin] Notify callbacks [] for router, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:36.545585 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 54450) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:36.546104 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-df527344-ce09-446d-8365-e7edf2b6c1b7 admin admin] 10.222.0.11 "DELETE /v2.0/routers/b0a93675-90ab-4436-ae4b-fc8b1f1a6c97 HTTP/1.1" status: 204  len: 168 time: 1.7959216
Jun 03 08:37:36.645733 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_v2 [None req-aba765c1-63bb-4d6a-bb4c-273e06c026fe admin admin] Deleting subnet 159409d9-9245-4f6d-adbe-4aa8aad78d07 {{(pid=92323) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 03 08:37:36.650077 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-aba765c1-63bb-4d6a-bb4c-273e06c026fe admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:36.738602 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-aba765c1-63bb-4d6a-bb4c-273e06c026fe admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14518184'] for subnet, precommit_delete_associations {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:36.886915 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-aba765c1-63bb-4d6a-bb4c-273e06c026fe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-862421'] for subnet, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:37.240220 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-aba765c1-63bb-4d6a-bb4c-273e06c026fe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-862434', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14211216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14857862'] for subnet, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:37.244488 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-72136203-9a0a-4b2b-a7ee-f5c68d616d8f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:37.292186 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce18c269-47e0-48aa-bd6f-0410caa0dd78 None None] Network 113ded30-096c-4860-8773-fb717f3ea4c6 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:37:37.297880 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-aba765c1-63bb-4d6a-bb4c-273e06c026fe admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:37.303058 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aba765c1-63bb-4d6a-bb4c-273e06c026fe admin admin] Pushing event deleted for resources: {'Subnet': ['ID=159409d9-9245-4f6d-adbe-4aa8aad78d07,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:37.306689 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-aba765c1-63bb-4d6a-bb4c-273e06c026fe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:37.311888 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-aba765c1-63bb-4d6a-bb4c-273e06c026fe admin admin] 10.222.0.11 "DELETE /v2.0/subnets/159409d9-9245-4f6d-adbe-4aa8aad78d07 HTTP/1.1" status: 204  len: 168 time: 0.7618892
Jun 03 08:37:37.311998 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 54506) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:37.425205 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-529010'] for network, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:37.508252 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] Deleting port 3561fa8f-70de-4286-94db-502955bd7ed0 {{(pid=92324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:37:37.508252 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:37.645751 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.db [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] For port 3561fa8f-70de-4286-94db-502955bd7ed0, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=3561fa8f-70de-4286-94db-502955bd7ed0,segment=NetworkSegment(3151dd7e-a009-433b-ae5e-c81299e42bfb),segment_id=3151dd7e-a009-433b-ae5e-c81299e42bfb)] {{(pid=92324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:37:37.645751 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:37.653146 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a5b7f23-cef4-4d8a-8406-b37a010dca94 None None] DHCP port deletion for 113ded30-096c-4860-8773-fb717f3ea4c6 request from dv-cinder-787262-5-iscsi {{(pid=92325) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 03 08:37:37.786809 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-6a5b7f23-cef4-4d8a-8406-b37a010dca94 None None] Deleting port 3561fa8f-70de-4286-94db-502955bd7ed0 {{(pid=92325) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:37:37.787219 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-6a5b7f23-cef4-4d8a-8406-b37a010dca94 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:37.818726 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] Calling delete_port for 3561fa8f-70de-4286-94db-502955bd7ed0 owned by network:dhcp {{(pid=92324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:37:37.909247 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-6a5b7f23-cef4-4d8a-8406-b37a010dca94 None None] For port 3561fa8f-70de-4286-94db-502955bd7ed0, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=3561fa8f-70de-4286-94db-502955bd7ed0,segment=NetworkSegment(3151dd7e-a009-433b-ae5e-c81299e42bfb),segment_id=3151dd7e-a009-433b-ae5e-c81299e42bfb)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:37:37.909600 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-6a5b7f23-cef4-4d8a-8406-b37a010dca94 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:37.942257 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:37.955119 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:37.996933 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] No DVR routers for this DVR port 3561fa8f-70de-4286-94db-502955bd7ed0 on host dv-cinder-787262-5-iscsi {{(pid=92324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:37:38.031719 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] Pushing event deleted for resources: {'Port': ['ID=3561fa8f-70de-4286-94db-502955bd7ed0,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:38.036815 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:38.054542 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-6a5b7f23-cef4-4d8a-8406-b37a010dca94 None None] Calling delete_port for 3561fa8f-70de-4286-94db-502955bd7ed0 owned by network:dhcp {{(pid=92325) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:37:38.137016 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-862046', 'neutron.services.segments.db._delete_segments_for_network-8774224358894'] for network, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:38.151018 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fae86838f10>,) {'filters': {'network_id': ['113ded30-096c-4860-8773-fb717f3ea4c6']}} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:38.164317 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fae86838f10>, '3151dd7e-a009-433b-ae5e-c81299e42bfb') {'for_net_delete': True} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:38.164699 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fae86838f10>, '3151dd7e-a009-433b-ae5e-c81299e42bfb') {} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:38.165699 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:38.176917 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8774224362253', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-15250406'] for segment, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:38.190839 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-6a5b7f23-cef4-4d8a-8406-b37a010dca94 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151'] for port, after_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:38.194359 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:38.196263 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:38.201673 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] Releasing vlan 525 on physical network physnet1 to pool {{(pid=92324) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 03 08:37:38.202085 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15641405'] for segment, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]: Traceback (most recent call last):
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:     timer()
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:     cb(*args, **kw)
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:     return func(*args, **kwargs)
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:     self._notify()
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:     self.callback(batched_events)
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:     event.method(event)
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:     return f(self, *a, **k)
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self._get(url).json()
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self.request(url, 'GET', **kwargs)
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 03 08:37:38.215557 dv-cinder-787262-5-iscsi neutron-server[92324]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 03 08:37:38.236096 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a5b7f23-cef4-4d8a-8406-b37a010dca94 None None] Pushing event deleted for resources: {'Port': ['ID=3561fa8f-70de-4286-94db-502955bd7ed0,revision_number=None']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:38.240210 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-6a5b7f23-cef4-4d8a-8406-b37a010dca94 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:38.241227 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a5b7f23-cef4-4d8a-8406-b37a010dca94 None None] No DVR routers for this DVR port 3561fa8f-70de-4286-94db-502955bd7ed0 on host dv-cinder-787262-5-iscsi {{(pid=92325) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:37:38.338306 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 3561fa8f-70de-4286-94db-502955bd7ed0 no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:37:38.371188 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-862039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16327709'] for network, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:38.375101 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: 3561fa8f-70de-4286-94db-502955bd7ed0 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:37:38.379540 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 3561fa8f-70de-4286-94db-502955bd7ed0 not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:37:38.379540 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 7bd8082c-c1ea-4edf-bafc-03cff8ed0641 no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:37:38.380451 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:38.386769 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:38.407288 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] Pushing event deleted for resources: {'Network': ['ID=113ded30-096c-4860-8773-fb717f3ea4c6,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:38.410531 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:38.413017 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-0ffecf00-f2f3-4f29-9372-17b3545bfbcb admin admin] 10.222.0.11 "DELETE /v2.0/networks/113ded30-096c-4860-8773-fb717f3ea4c6 HTTP/1.1" status: 204  len: 168 time: 1.1000779
Jun 03 08:37:38.415251 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 54562) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:38.419992 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: 7bd8082c-c1ea-4edf-bafc-03cff8ed0641 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:37:38.420368 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 7bd8082c-c1ea-4edf-bafc-03cff8ed0641 not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:37:38.991240 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b43d331b-3797-4642-9145-ca6026bf2db3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-16328733'] for router_interface, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:39.522137 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-b43d331b-3797-4642-9145-ca6026bf2db3 admin admin] Deleting port d52ae51a-5b28-450c-a58c-aff5122faf14 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:37:39.522739 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b43d331b-3797-4642-9145-ca6026bf2db3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:39.656011 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [None req-b43d331b-3797-4642-9145-ca6026bf2db3 admin admin] For port d52ae51a-5b28-450c-a58c-aff5122faf14, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=d52ae51a-5b28-450c-a58c-aff5122faf14,segment=NetworkSegment(8acb7a59-d9f0-4604-be49-ed0601f465ae),segment_id=8acb7a59-d9f0-4604-be49-ed0601f465ae)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:37:39.656700 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b43d331b-3797-4642-9145-ca6026bf2db3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:39.795188 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-b43d331b-3797-4642-9145-ca6026bf2db3 admin admin] Calling delete_port for d52ae51a-5b28-450c-a58c-aff5122faf14 owned by network:router_interface {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:37:40.141513 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b43d331b-3797-4642-9145-ca6026bf2db3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:40.146280 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:40.193176 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b43d331b-3797-4642-9145-ca6026bf2db3 admin admin] Pushing event deleted for resources: {'Port': ['ID=d52ae51a-5b28-450c-a58c-aff5122faf14,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:40.232316 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b43d331b-3797-4642-9145-ca6026bf2db3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:40.479965 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b43d331b-3797-4642-9145-ca6026bf2db3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-16344783', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-16328833'] for router_interface, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:40.930260 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1c9f313-1d9f-40e0-87e4-4e1e65a9041c req-2e5685d2-c4f9-4066-ad57-2df9ec95da5e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:40.932090 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a1c9f313-1d9f-40e0-87e4-4e1e65a9041c req-2e5685d2-c4f9-4066-ad57-2df9ec95da5e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.2962730
Jun 03 08:37:41.058655 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a1c9f313-1d9f-40e0-87e4-4e1e65a9041c req-c77e4953-cfaa-49d5-8ea1-9db037ab3c91 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0735877
Jun 03 08:37:41.068533 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b43d331b-3797-4642-9145-ca6026bf2db3 admin admin] Router ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3 has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:37:41.246696 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b43d331b-3797-4642-9145-ca6026bf2db3 admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:37:41.257806 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03862079-3c22-433f-9ff7-59c9a1691b3d None None] Sync routers for ids ['ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3'] in dv-cinder-787262-5-iscsi {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:37:41.267315 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03862079-3c22-433f-9ff7-59c9a1691b3d None None] Routers {'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:37:41.267870 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-03862079-3c22-433f-9ff7-59c9a1691b3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86bac400>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:37:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:41.326134 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-b43d331b-3797-4642-9145-ca6026bf2db3 admin admin] 10.222.0.11 "PUT /v2.0/routers/ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.9096725
Jun 03 08:37:41.328583 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 54694) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:41.451111 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-03862079-3c22-433f-9ff7-59c9a1691b3d None None] Set router ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:37:41.521881 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f5598d91-c929-478f-83ef-910ad4b7482e admin admin] Notify callbacks [] for router, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:41.812927 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-03862079-3c22-433f-9ff7-59c9a1691b3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86bac400>, [{'id': 'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3', 'name': 'tempest-TestMinimumBasicScenario-86704573-router', 'tenant_id': '7de719cd894b4eff8d1ebe284e30569b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'ddaa7077-d668-4d3b-a8ec-849e13f8a9cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:14Z', 'updated_at': '2021-06-03T08:37:40Z', 'revision_number': 5, 'project_id': '7de719cd894b4eff8d1ebe284e30569b', 'gw_port': {'id': 'ddaa7077-d668-4d3b-a8ec-849e13f8a9cf', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ac:a7:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:17Z', 'updated_at': '2021-06-03T08:33:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:41.816950 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03862079-3c22-433f-9ff7-59c9a1691b3d None None] Checking router: ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3 for host: dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:37:41.827300 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03862079-3c22-433f-9ff7-59c9a1691b3d None None] Routers {'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:37:41.828021 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-03862079-3c22-433f-9ff7-59c9a1691b3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86bac400>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:37:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:41.863348 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f5598d91-c929-478f-83ef-910ad4b7482e admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:42.009266 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-03862079-3c22-433f-9ff7-59c9a1691b3d None None] Set router ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:37:42.271206 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-f5598d91-c929-478f-83ef-910ad4b7482e admin admin] Deleting port ddaa7077-d668-4d3b-a8ec-849e13f8a9cf {{(pid=92324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:37:42.271720 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f5598d91-c929-478f-83ef-910ad4b7482e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:42.332680 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-03862079-3c22-433f-9ff7-59c9a1691b3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86bac400>, [{'id': 'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3', 'name': 'tempest-TestMinimumBasicScenario-86704573-router', 'tenant_id': '7de719cd894b4eff8d1ebe284e30569b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'ddaa7077-d668-4d3b-a8ec-849e13f8a9cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:14Z', 'updated_at': '2021-06-03T08:37:40Z', 'revision_number': 5, 'project_id': '7de719cd894b4eff8d1ebe284e30569b', 'gw_port': {'id': 'ddaa7077-d668-4d3b-a8ec-849e13f8a9cf', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ac:a7:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:17Z', 'updated_at': '2021-06-03T08:33:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:42.339428 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03862079-3c22-433f-9ff7-59c9a1691b3d None None] The sync data for ids ['ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3'] in dv-cinder-787262-5-iscsi is: [{'id': 'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3', 'name': 'tempest-TestMinimumBasicScenario-86704573-router', 'tenant_id': '7de719cd894b4eff8d1ebe284e30569b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'ddaa7077-d668-4d3b-a8ec-849e13f8a9cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:14Z', 'updated_at': '2021-06-03T08:37:40Z', 'revision_number': 5, 'project_id': '7de719cd894b4eff8d1ebe284e30569b', 'gw_port': {'id': 'ddaa7077-d668-4d3b-a8ec-849e13f8a9cf', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ac:a7:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 400, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:17Z', 'updated_at': '2021-06-03T08:33:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}] {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:37:42.383093 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-909a6776-9f11-46c1-933b-fbbbbfbe63ee req-633988bb-2b90-4c7b-b17e-06e956c74fde tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:42.402084 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-909a6776-9f11-46c1-933b-fbbbbfbe63ee req-633988bb-2b90-4c7b-b17e-06e956c74fde tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.1139276
Jun 03 08:37:42.438273 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.db [None req-f5598d91-c929-478f-83ef-910ad4b7482e admin admin] For port ddaa7077-d668-4d3b-a8ec-849e13f8a9cf, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=ddaa7077-d668-4d3b-a8ec-849e13f8a9cf,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:37:42.438887 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f5598d91-c929-478f-83ef-910ad4b7482e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:42.463214 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-909a6776-9f11-46c1-933b-fbbbbfbe63ee req-a27f46a1-aa0e-4e75-965e-c3db36fa9cb0 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0580127
Jun 03 08:37:42.606560 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-f5598d91-c929-478f-83ef-910ad4b7482e admin admin] Calling delete_port for ddaa7077-d668-4d3b-a8ec-849e13f8a9cf owned by network:router_gateway {{(pid=92324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:37:42.753472 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98d10e40-4900-4978-a73e-8e55e882ab40 req-4667a41d-9976-4bfa-a865-e3c1a07ef968 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:42.753472 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-98d10e40-4900-4978-a73e-8e55e882ab40 req-4667a41d-9976-4bfa-a865-e3c1a07ef968 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 946 time: 0.0939364
Jun 03 08:37:42.803499 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-98d10e40-4900-4978-a73e-8e55e882ab40 req-08d1dbbd-3a9a-4021-8009-15a19cc8fe3d tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0442224
Jun 03 08:37:42.849312 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 54722) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:42.867095 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f5598d91-c929-478f-83ef-910ad4b7482e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:42.872436 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-86606e33-3641-4406-b3f9-a3a0c5e5a148 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:42.920094 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5598d91-c929-478f-83ef-910ad4b7482e admin admin] Pushing event deleted for resources: {'Port': ['ID=ddaa7077-d668-4d3b-a8ec-849e13f8a9cf,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:42.954760 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f5598d91-c929-478f-83ef-910ad4b7482e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:43.057876 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f5598d91-c929-478f-83ef-910ad4b7482e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-16327738'] for router_gateway, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:43.167133 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-595e23fa-5948-425c-ac3b-b29ded42edee admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=9769d84061ea436ab7b7d97278110278&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3169687
Jun 03 08:37:43.169814 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 54734) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:43.233265 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f5598d91-c929-478f-83ef-910ad4b7482e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-16388336', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2351'] for router, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:43.235595 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f5598d91-c929-478f-83ef-910ad4b7482e admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:43.245649 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1e7b404f-eb07-4e23-85ba-984c8aa31213 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:43.272717 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1e7b404f-eb07-4e23-85ba-984c8aa31213 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:43.335718 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f5598d91-c929-478f-83ef-910ad4b7482e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-16388448'] for router, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:43.336214 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f5598d91-c929-478f-83ef-910ad4b7482e admin admin] Fanout notify agent at l3_agent the message router_deleted on router ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3 {{(pid=92324) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 03 08:37:43.351150 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f5598d91-c929-478f-83ef-910ad4b7482e admin admin] Notify callbacks [] for router, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:43.355023 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-f5598d91-c929-478f-83ef-910ad4b7482e admin admin] 10.222.0.11 "DELETE /v2.0/routers/ee7e5233-8c99-4d5a-9d8d-ae91045ff1e3 HTTP/1.1" status: 204  len: 168 time: 2.0226233
Jun 03 08:37:43.355690 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 54740) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:43.417421 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.db_base_plugin_v2 [None req-89302253-322f-4e5e-88d6-6adb48f1e09f admin admin] Deleting subnet 12ddd2af-f3e3-46c1-98f9-a99828fc2abc {{(pid=92324) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 03 08:37:43.420501 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-89302253-322f-4e5e-88d6-6adb48f1e09f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:43.420960 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1e7b404f-eb07-4e23-85ba-984c8aa31213 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:43.426564 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-7c6a4d04-f80b-4af9-b3a0-e4f875a762bf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:43.445827 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e7b404f-eb07-4e23-85ba-984c8aa31213 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed308533-9177-43f2-a03c-e71760884d5c,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:43.447384 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-1e7b404f-eb07-4e23-85ba-984c8aa31213 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:43.482203 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-89302253-322f-4e5e-88d6-6adb48f1e09f admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-15250429'] for subnet, precommit_delete_associations {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:43.520979 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1e7b404f-eb07-4e23-85ba-984c8aa31213 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:43.522315 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-1e7b404f-eb07-4e23-85ba-984c8aa31213 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/ed308533-9177-43f2-a03c-e71760884d5c HTTP/1.1" status: 204  len: 168 time: 0.3513088
Jun 03 08:37:43.734834 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-89302253-322f-4e5e-88d6-6adb48f1e09f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-862421'] for subnet, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:43.822725 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40698186-86e3-42bf-98f2-289dbf2ba800 req-36dd0932-2c5d-4b58-b8ae-0c9d7a79dcf3 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:43.824251 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-40698186-86e3-42bf-98f2-289dbf2ba800 req-36dd0932-2c5d-4b58-b8ae-0c9d7a79dcf3 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.1705031
Jun 03 08:37:43.953714 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-40698186-86e3-42bf-98f2-289dbf2ba800 req-944cee40-b806-412f-926c-9edce26d9b1f tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1167998
Jun 03 08:37:44.256694 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4086d716-93e8-4ffb-ad94-c60254922fcd req-b8487ba7-6417-4a61-8555-9064f5d5fcff tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:44.258168 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-4086d716-93e8-4ffb-ad94-c60254922fcd req-b8487ba7-6417-4a61-8555-9064f5d5fcff tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 946 time: 0.1137574
Jun 03 08:37:44.323630 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-4086d716-93e8-4ffb-ad94-c60254922fcd req-7016f909-d962-4468-8e96-7a7e1a09d542 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0590646
Jun 03 08:37:44.347906 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device d52ae51a-5b28-450c-a58c-aff5122faf14 no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:37:44.383084 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-89302253-322f-4e5e-88d6-6adb48f1e09f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-862434', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15641431', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14870376'] for subnet, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:44.385460 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: d52ae51a-5b28-450c-a58c-aff5122faf14 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:37:44.385875 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device d52ae51a-5b28-450c-a58c-aff5122faf14 not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:37:44.386389 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device ddaa7077-d668-4d3b-a8ec-849e13f8a9cf no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:37:44.388598 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:44.421817 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: ddaa7077-d668-4d3b-a8ec-849e13f8a9cf {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:37:44.422255 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device ddaa7077-d668-4d3b-a8ec-849e13f8a9cf not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:37:44.425067 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89302253-322f-4e5e-88d6-6adb48f1e09f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=12ddd2af-f3e3-46c1-98f9-a99828fc2abc,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:44.428806 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-89302253-322f-4e5e-88d6-6adb48f1e09f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:44.429848 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-89302253-322f-4e5e-88d6-6adb48f1e09f admin admin] Notify callbacks [] for subnet, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:44.439358 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-154719ca-f37d-4596-9f64-31d7579aefc6 None None] Network 15e18fdf-cd32-4b01-8841-c321ea578305 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:37:44.439486 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-89302253-322f-4e5e-88d6-6adb48f1e09f admin admin] 10.222.0.11 "DELETE /v2.0/subnets/12ddd2af-f3e3-46c1-98f9-a99828fc2abc HTTP/1.1" status: 204  len: 168 time: 1.0795314
Jun 03 08:37:44.440273 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 54786) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:44.562793 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-529010'] for network, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:44.634737 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] Deleting port d9c1690f-ea93-4b43-a1b8-643701ef85de {{(pid=92324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:37:44.635084 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:44.791902 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.db [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] For port d9c1690f-ea93-4b43-a1b8-643701ef85de, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=d9c1690f-ea93-4b43-a1b8-643701ef85de,segment=NetworkSegment(8acb7a59-d9f0-4604-be49-ed0601f465ae),segment_id=8acb7a59-d9f0-4604-be49-ed0601f465ae)] {{(pid=92324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:37:44.791902 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:44.811140 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24af0f58-a55f-4509-8eb3-254719e6faaa None None] DHCP port deletion for 15e18fdf-cd32-4b01-8841-c321ea578305 request from dv-cinder-787262-5-iscsi {{(pid=92325) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 03 08:37:44.918871 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-24af0f58-a55f-4509-8eb3-254719e6faaa None None] Deleting port d9c1690f-ea93-4b43-a1b8-643701ef85de {{(pid=92325) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:37:44.919462 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-24af0f58-a55f-4509-8eb3-254719e6faaa None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:45.002162 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] Calling delete_port for d9c1690f-ea93-4b43-a1b8-643701ef85de owned by network:dhcp {{(pid=92324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:37:45.052276 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-24af0f58-a55f-4509-8eb3-254719e6faaa None None] For port d9c1690f-ea93-4b43-a1b8-643701ef85de, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=d9c1690f-ea93-4b43-a1b8-643701ef85de,segment=NetworkSegment(8acb7a59-d9f0-4604-be49-ed0601f465ae),segment_id=8acb7a59-d9f0-4604-be49-ed0601f465ae)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:37:45.053022 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-24af0f58-a55f-4509-8eb3-254719e6faaa None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:45.248547 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 54814) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:45.259700 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:45.275476 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-df527344-ce09-446d-8365-e7edf2b6c1b7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:45.343057 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] Pushing event deleted for resources: {'Port': ['ID=d9c1690f-ea93-4b43-a1b8-643701ef85de,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:45.346816 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] No DVR routers for this DVR port d9c1690f-ea93-4b43-a1b8-643701ef85de on host dv-cinder-787262-5-iscsi {{(pid=92324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:37:45.348652 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:45.386557 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-24af0f58-a55f-4509-8eb3-254719e6faaa None None] Calling delete_port for d9c1690f-ea93-4b43-a1b8-643701ef85de owned by network:dhcp {{(pid=92325) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:37:45.435398 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1897754947-network', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:37:45.443155 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-24af0f58-a55f-4509-8eb3-254719e6faaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151'] for port, after_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:45.446216 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:37:45.448768 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:45.452051 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Usage tracker for resource:network and tenant:db653c0bf0ab42639863b4ea2268a265 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:37:45.460129 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:37:45.473895 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:37:45.501043 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24af0f58-a55f-4509-8eb3-254719e6faaa None None] Pushing event deleted for resources: {'Port': ['ID=d9c1690f-ea93-4b43-a1b8-643701ef85de,revision_number=None']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:45.504340 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-24af0f58-a55f-4509-8eb3-254719e6faaa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:45.507671 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24af0f58-a55f-4509-8eb3-254719e6faaa None None] No DVR routers for this DVR port d9c1690f-ea93-4b43-a1b8-643701ef85de on host dv-cinder-787262-5-iscsi {{(pid=92325) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:37:45.567875 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-862046', 'neutron.services.segments.db._delete_segments_for_network-8774224358894'] for network, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:45.576547 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Made reservation on behalf of db653c0bf0ab42639863b4ea2268a265 for: {'network': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:37:45.579189 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-676039'] for network, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:45.596096 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-386e280b-1058-45c2-a950-da5c5c93cbb7 req-42c2b8b9-a7b2-4381-bdce-911094213258 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:45.598132 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-386e280b-1058-45c2-a950-da5c5c93cbb7 req-42c2b8b9-a7b2-4381-bdce-911094213258 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.4132817
Jun 03 08:37:45.599895 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fae85282df0>,) {'filters': {'network_id': ['15e18fdf-cd32-4b01-8841-c321ea578305']}} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:45.602112 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:45.635030 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cff60874-9b0f-4c71-aef7-1c94406af53e req-ee104df0-83d2-4aba-8713-6c05a02c80bb tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:45.636630 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-cff60874-9b0f-4c71-aef7-1c94406af53e req-ee104df0-83d2-4aba-8713-6c05a02c80bb tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 946 time: 0.1250846
Jun 03 08:37:45.637767 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:37:45.641889 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Usage tracker for resource:security_group_rule and tenant:db653c0bf0ab42639863b4ea2268a265 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:37:45.644213 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fae85282df0>, '8acb7a59-d9f0-4604-be49-ed0601f465ae') {'for_net_delete': True} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:45.644213 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fae85282df0>, '8acb7a59-d9f0-4604-be49-ed0601f465ae') {} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:45.646842 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:37:45.668097 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:37:45.682759 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8774224362253', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-15250406'] for segment, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:45.688563 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-386e280b-1058-45c2-a950-da5c5c93cbb7 req-8ce0a2dd-2efd-453b-93d1-fc845f30b086 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0807652
Jun 03 08:37:45.701429 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:45.710286 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] Releasing vlan 504 on physical network physnet1 to pool {{(pid=92324) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 03 08:37:45.710286 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15641405'] for segment, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:45.712362 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-cff60874-9b0f-4c71-aef7-1c94406af53e req-bfea4647-32fc-4fe6-96bb-090c4e8e462c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0623710
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]: Traceback (most recent call last):
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:     timer()
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:     cb(*args, **kw)
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:     return func(*args, **kwargs)
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:     self._notify()
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:     self.callback(batched_events)
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:     event.method(event)
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:     return f(self, *a, **k)
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self._get(url).json()
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self.request(url, 'GET', **kwargs)
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 03 08:37:45.724132 dv-cinder-787262-5-iscsi neutron-server[92324]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 03 08:37:45.793540 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:45.855015 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:45.859414 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-0e20512a-ed21-438b-9784-4e9b5c363922 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:45.884045 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-862039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16327709'] for network, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:45.887121 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] vlan segment allocate from pool success with {'vlan_id': 506, 'physical_network': 'physnet1'}  {{(pid=92323) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 03 08:37:45.888027 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-62fc1c80-fdff-4e60-a95c-4a841ce68639 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:45.897520 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=110b3102-8777-4870-bec9-05faee9383a6,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:45.901221 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:45.902741 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:45.904029 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:45.904375 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.db.segments_db [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Added segment fd0545c3-e436-4d2f-9d2d-71983702d34f of type vlan for network 7722e8fc-e6a8-422f-8456-a3c594da293a
Jun 03 08:37:45.916647 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] Pushing event deleted for resources: {'Network': ['ID=15e18fdf-cd32-4b01-8841-c321ea578305,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:45.921296 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:45.925297 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] 10.222.0.11 "DELETE /v2.0/networks/15e18fdf-cd32-4b01-8841-c321ea578305 HTTP/1.1" status: 204  len: 168 time: 1.4839272
Jun 03 08:37:45.939007 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8774223827658'] for network, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:46.044465 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820'] for network, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:46.045836 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:46.046417 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:46.050224 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-13ab4f8d-1610-438c-83a9-0f4c75ce6145 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:46.150883 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Pushing event updated for resources: {'Network': ['ID=7722e8fc-e6a8-422f-8456-a3c594da293a,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:46.153547 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:46.160679 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Network 7722e8fc-e6a8-422f-8456-a3c594da293a details requested by agent ovs-agent-dv-cinder-787262-5-iscsi with host dv-cinder-787262-5-iscsi {{(pid=92325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 03 08:37:46.221935 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-9075c519-69d6-479d-9d5c-7c6b38fcb9b6 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201  len: 885 time: 0.9721689
Jun 03 08:37:46.224806 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 54840) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:46.229725 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-47e2132e-bf28-4ccd-aba2-d4874c20d929 admin admin] Request body: {'subnet': {'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1897754947-subnet', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'ip_version': 4}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:37:46.234466 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-47e2132e-bf28-4ccd-aba2-d4874c20d929 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:37:46.239474 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-47e2132e-bf28-4ccd-aba2-d4874c20d929 admin admin] Usage tracker for resource:subnet and tenant:db653c0bf0ab42639863b4ea2268a265 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:37:46.242779 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-47e2132e-bf28-4ccd-aba2-d4874c20d929 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:37:46.248279 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-47e2132e-bf28-4ccd-aba2-d4874c20d929 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:37:46.324714 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-47e2132e-bf28-4ccd-aba2-d4874c20d929 admin admin] Made reservation on behalf of db653c0bf0ab42639863b4ea2268a265 for: {'subnet': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:37:46.329516 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device d9c1690f-ea93-4b43-a1b8-643701ef85de no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:37:46.329778 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-47e2132e-bf28-4ccd-aba2-d4874c20d929 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14870279'] for subnet, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:46.329888 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 54842) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:46.364041 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: d9c1690f-ea93-4b43-a1b8-643701ef85de {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:37:46.364989 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device d9c1690f-ea93-4b43-a1b8-643701ef85de not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:37:46.386447 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-9eb2a8d5-3552-4720-8906-3684d3b925bb admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=96a989a900784d61a1475d86dd209c5f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0550289
Jun 03 08:37:46.395999 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 54844) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:46.468330 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9885b076-a6bd-47e4-b01c-8db4c0c80a27 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:46.500684 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9885b076-a6bd-47e4-b01c-8db4c0c80a27 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:46.649723 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9885b076-a6bd-47e4-b01c-8db4c0c80a27 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:46.654980 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-4fb02862-8faf-4cfd-b331-713924ba4111 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:46.669194 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9885b076-a6bd-47e4-b01c-8db4c0c80a27 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f03c63c9-82ad-4a26-aba6-7f507d2ecc01,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:46.671524 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-9885b076-a6bd-47e4-b01c-8db4c0c80a27 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:46.728006 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-9885b076-a6bd-47e4-b01c-8db4c0c80a27 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:46.729124 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-9885b076-a6bd-47e4-b01c-8db4c0c80a27 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/f03c63c9-82ad-4a26-aba6-7f507d2ecc01 HTTP/1.1" status: 204  len: 168 time: 0.3322330
Jun 03 08:37:46.817140 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-47e2132e-bf28-4ccd-aba2-d4874c20d929 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15641492', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14870385'] for subnet, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:46.823632 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:46.932773 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b7fd0e9-849b-451f-9a7a-926db3d0a8d6 req-c34cb124-b041-4e90-bb1e-15598c8a8296 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:46.934290 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8b7fd0e9-849b-451f-9a7a-926db3d0a8d6 req-c34cb124-b041-4e90-bb1e-15598c8a8296 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 946 time: 0.0870781
Jun 03 08:37:46.983990 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8b7fd0e9-849b-451f-9a7a-926db3d0a8d6 req-b1b1ac6f-26e6-4007-9ef7-9ea080865153 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0434880
Jun 03 08:37:47.069758 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47e2132e-bf28-4ccd-aba2-d4874c20d929 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3eb5b6e1-724c-48ab-a49b-2b1fa5adb401,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:47.079125 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-47e2132e-bf28-4ccd-aba2-d4874c20d929 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.255s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:47.079825 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47e2132e-bf28-4ccd-aba2-d4874c20d929 admin admin] Checking segment: {'id': 'fd0545c3-e436-4d2f-9d2d-71983702d34f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:37:47.081150 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-47e2132e-bf28-4ccd-aba2-d4874c20d929 admin admin] Network hostable DHCP agents. Network: 7722e8fc-e6a8-422f-8456-a3c594da293a, hostable agents: ['07372699-02ac-4239-816f-84b3a5b0eff9'], hosted agents: [] {{(pid=92324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 03 08:37:47.115675 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24beb3b2-7f16-4bdd-8420-7c2458f01e6d req-85d8a75d-6fe0-4726-8872-faeb905b0b23 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:47.117200 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-24beb3b2-7f16-4bdd-8420-7c2458f01e6d req-85d8a75d-6fe0-4726-8872-faeb905b0b23 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.1479192
Jun 03 08:37:47.164829 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-47e2132e-bf28-4ccd-aba2-d4874c20d929 admin admin] Network 7722e8fc-e6a8-422f-8456-a3c594da293a is scheduled to be hosted by DHCP agent 07372699-02ac-4239-816f-84b3a5b0eff9 with binding_index 1 {{(pid=92324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 03 08:37:47.177127 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-24beb3b2-7f16-4bdd-8420-7c2458f01e6d req-58014f15-a902-4bd2-b608-040398cae15d tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0538316
Jun 03 08:37:47.248872 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-47e2132e-bf28-4ccd-aba2-d4874c20d929 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-5-iscsi, 7722e8fc-e6a8-422f-8456-a3c594da293a) {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:37:47.258033 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47e2132e-bf28-4ccd-aba2-d4874c20d929 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:47.258158 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-47e2132e-bf28-4ccd-aba2-d4874c20d929 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:47.258935 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b1cee827-4cc5-474e-afe0-df8d68abddd7 None None] Network 7722e8fc-e6a8-422f-8456-a3c594da293a requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:37:47.370140 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-47e2132e-bf28-4ccd-aba2-d4874c20d929 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 848 time: 1.1442256
Jun 03 08:37:47.372761 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 54858) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:47.377112 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:37:47.382246 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:37:47.386908 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Usage tracker for resource:router and tenant:db653c0bf0ab42639863b4ea2268a265 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:37:47.389695 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:37:47.396461 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:37:47.471224 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp3789a88e-0f76-536c-9507-4ab4ace56879-7722e8fc-e6a8-422f-8456-a3c594da293a', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401'}]}} from dv-cinder-787262-5-iscsi. {{(pid=92325) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 03 08:37:47.472075 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:47.558433 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-16388154', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2397'] for router, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:47.561988 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-16389011', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-16327785', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-16383573', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2340'] for router, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:47.575290 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:47.625324 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 54864) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:47.629532 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.db_base_plugin_common [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Allocated IP 172.20.0.2 (7722e8fc-e6a8-422f-8456-a3c594da293a/3eb5b6e1-724c-48ab-a49b-2b1fa5adb401/e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5) {{(pid=92325) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:37:47.687690 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-04f5cd90-adc1-4d13-b35e-64acbfee2e6d admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=7de719cd894b4eff8d1ebe284e30569b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0611582
Jun 03 08:37:47.691238 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 54866) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:47.753989 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-82098ecf-f97b-4cde-99b3-9452b0f68f96 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:47.783942 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-82098ecf-f97b-4cde-99b3-9452b0f68f96 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:47.855833 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Notify callbacks [] for port, precommit_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:47.907800 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Transition to ACTIVE for port object e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5 will not be triggered until provisioned by entity L2. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:37:47.910205 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-82098ecf-f97b-4cde-99b3-9452b0f68f96 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:47.920338 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-e03e86e8-ba88-4c1d-a082-39744d7d1933 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:47.933761 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Transition to ACTIVE for port object e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5 will not be triggered until provisioned by entity DHCP. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:37:47.938345 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82098ecf-f97b-4cde-99b3-9452b0f68f96 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f7ada93-849a-407a-8d47-5a1db5fd6bdc,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:47.942201 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-82098ecf-f97b-4cde-99b3-9452b0f68f96 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:47.943279 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-82098ecf-f97b-4cde-99b3-9452b0f68f96 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:47.944845 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-82098ecf-f97b-4cde-99b3-9452b0f68f96 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/1f7ada93-849a-407a-8d47-5a1db5fd6bdc HTTP/1.1" status: 204  len: 168 time: 0.2522731
Jun 03 08:37:47.955608 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-16327803', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-16388116', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2358'] for router, precommit_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:48.021609 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:48.026338 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-413fa614-603e-4020-a053-720fef8e9f68 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:48.106396 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Network 7722e8fc-e6a8-422f-8456-a3c594da293a is already hosted by enough agents. {{(pid=92325) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:37:48.110722 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.scheduler.base_scheduler [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Resources bound (agent type, host, resource id):  {{(pid=92325) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:37:48.116922 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Received port after_create {{(pid=92325) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:37:48.167965 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Pushing event updated for resources: {'Port': ['ID=e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5,revision_number=1']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:48.171711 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:48.208344 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-176e900d-7609-49f2-abe0-9341d6957bd4 req-cd1d40d3-afbd-47bd-b2c9-3040c6465e3a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:48.220627 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-176e900d-7609-49f2-abe0-9341d6957bd4 req-cd1d40d3-afbd-47bd-b2c9-3040c6465e3a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 946 time: 0.1219141
Jun 03 08:37:48.264603 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Attempting to bind port e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5 on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:37:48.265330 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Attempting to bind port e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5 by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': 'fd0545c3-e436-4d2f-9d2d-71983702d34f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a'}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:37:48.265745 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Attempting to bind port e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5 on network 7722e8fc-e6a8-422f-8456-a3c594da293a {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:37:48.271496 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 37, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:37:48.271881 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Checking segment: {'id': 'fd0545c3-e436-4d2f-9d2d-71983702d34f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:37:48.272292 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:48.272688 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Bound using segment: {'id': 'fd0545c3-e436-4d2f-9d2d-71983702d34f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a'} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:37:48.273289 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Bound port: e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fd0545c3-e436-4d2f-9d2d-71983702d34f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a'}}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:37:48.273528 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:48.274777 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-176e900d-7609-49f2-abe0-9341d6957bd4 req-c7d962a2-539d-4c4c-9876-38e14ff296a3 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0519981
Jun 03 08:37:48.378083 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] For port e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:37:48.381766 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] For port e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5,segment=NetworkSegment(fd0545c3-e436-4d2f-9d2d-71983702d34f),segment_id=fd0545c3-e436-4d2f-9d2d-71983702d34f)] {{(pid=92325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:37:48.444763 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:48.452095 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-24af0f58-a55f-4509-8eb3-254719e6faaa None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:48.481262 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:48.517117 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:48.552479 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Pushing event updated for resources: {'Port': ['ID=e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5,revision_number=2']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:48.558578 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:48.576411 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2155d560-ee1f-4de8-92d6-832e1f81711e req-a4667eaf-78e9-437f-9663-8f138c13b48b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:48.577907 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2155d560-ee1f-4de8-92d6-832e1f81711e req-a4667eaf-78e9-437f-9663-8f138c13b48b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.2256672
Jun 03 08:37:48.675872 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2155d560-ee1f-4de8-92d6-832e1f81711e req-50e4562c-2a6b-4f8a-8061-cd4335a19c17 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0911365
Jun 03 08:37:48.716528 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.db_base_plugin_common [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Allocated IP 172.27.0.121 (684ef871-89aa-450d-ae0d-e232bfaf51fb/e7b58fba-1ed5-483b-b341-7736b2ffb853/a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36) {{(pid=92324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:37:48.915986 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:49.015025 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:49.019510 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-ce648181-29a7-4981-a99b-bd76479f1c47 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:49.084542 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:37:49.087498 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:37:49.091076 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Received port after_create {{(pid=92324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:37:49.125951 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Pushing event updated for resources: {'Port': ['ID=a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:49.130958 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:49.500279 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-227f78a6-2297-4290-b5c2-7ec933a4f6e6 req-05b09397-1280-4999-889d-e91d5c18f37a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:49.501899 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-227f78a6-2297-4290-b5c2-7ec933a4f6e6 req-05b09397-1280-4999-889d-e91d5c18f37a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 946 time: 0.0854177
Jun 03 08:37:49.548569 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-227f78a6-2297-4290-b5c2-7ec933a4f6e6 req-8850dac2-006b-44ea-b3b9-73fcf1f4cd19 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0402312
Jun 03 08:37:49.575570 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83b5814b-c2e3-4932-baa3-d8c50342406b None None] Network 7722e8fc-e6a8-422f-8456-a3c594da293a requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:37:49.719021 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:49.752212 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-dd6ad229-d9d8-4d57-83e5-c487f41c7ed6 None None] Provisioning for port e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5 completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:37:50.034897 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c019ca01-f259-4afb-b213-4a657227ecd1 req-851fffb6-3994-416b-862e-6b8a2e4bb028 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:50.036369 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c019ca01-f259-4afb-b213-4a657227ecd1 req-851fffb6-3994-416b-862e-6b8a2e4bb028 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.2362928
Jun 03 08:37:50.161618 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c019ca01-f259-4afb-b213-4a657227ecd1 req-bbdb7913-29fa-4b14-a3ff-04272eda2917 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1169426
Jun 03 08:37:50.175154 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-16388099', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-16327774'] for router, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:50.361252 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:37:50.438439 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 is scheduled to L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 with binding_index 1 {{(pid=92324) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 03 08:37:50.507149 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:37:50.513263 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:37:50.513705 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:50.622010 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:37:50.653654 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] Sync routers for ids ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:37:50.678080 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] Routers {'8d6b2faf-68a8-4edd-91ad-352b92d8cf84'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:37:50.678772 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86cf7d00>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:37:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:50.734443 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:50.770242 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Notify callbacks [] for router, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:50.771739 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201  len: 924 time: 3.3979211
Jun 03 08:37:50.774654 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 54898) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:50.858777 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dbe7c29-2b7a-4979-b4ae-7282a61ec5b5 req-4bbbc138-7877-43a9-aa79-438b1cb7eafc tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:50.861031 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7dbe7c29-2b7a-4979-b4ae-7282a61ec5b5 req-4bbbc138-7877-43a9-aa79-438b1cb7eafc tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 946 time: 0.1936281
Jun 03 08:37:50.877657 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5,segment=NetworkSegment(fd0545c3-e436-4d2f-9d2d-71983702d34f),segment_id=fd0545c3-e436-4d2f-9d2d-71983702d34f)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:37:50.912608 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] Set router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:37:50.925232 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7dbe7c29-2b7a-4979-b4ae-7282a61ec5b5 req-a10ec483-a962-41d5-9e0f-4379d8841337 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0535312
Jun 03 08:37:50.987453 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 54902) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:51.017636 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:51.027228 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:51.133002 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a25d5d01-7bc5-4cbe-a3e0-21b2027fd9b3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:51.147913 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-a25d5d01-7bc5-4cbe-a3e0-21b2027fd9b3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:37:51.151860 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-a25d5d01-7bc5-4cbe-a3e0-21b2027fd9b3 admin admin] Usage tracker for resource:security_group_rule and tenant:925de236047e4123aca99aad38460a8f is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:37:51.154716 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-a25d5d01-7bc5-4cbe-a3e0-21b2027fd9b3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:37:51.161298 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-a25d5d01-7bc5-4cbe-a3e0-21b2027fd9b3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:37:51.179948 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5,revision_number=3']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:51.184732 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:51.255147 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a25d5d01-7bc5-4cbe-a3e0-21b2027fd9b3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:51.290101 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86cf7d00>, [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:49Z', 'revision_number': 3, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:48Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:51.294056 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] Checking router: 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:37:51.294570 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] Updating router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 port a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36 binding host dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 03 08:37:51.307129 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a25d5d01-7bc5-4cbe-a3e0-21b2027fd9b3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:51.319074 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-9f3459e6-e0f4-4e3b-b411-a472a35c2d79 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:51.350559 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:51.363071 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-a25d5d01-7bc5-4cbe-a3e0-21b2027fd9b3 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=925de236047e4123aca99aad38460a8f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3718169
Jun 03 08:37:51.363071 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a25d5d01-7bc5-4cbe-a3e0-21b2027fd9b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=81953752-684c-400f-9bd0-d97a85a1c384,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:51.363842 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 54908) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:51.365788 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a25d5d01-7bc5-4cbe-a3e0-21b2027fd9b3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:51.424408 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-09bcb55c-8ebf-470f-ad24-d9eea1c7a947 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:51.451144 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-09bcb55c-8ebf-470f-ad24-d9eea1c7a947 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:51.598581 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3ad6df4-f40f-4302-acc8-047f6c2d7f53 req-54401a3e-3fff-47f9-b8d1-6189028d98fd tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:51.600057 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b3ad6df4-f40f-4302-acc8-047f6c2d7f53 req-54401a3e-3fff-47f9-b8d1-6189028d98fd tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.3009174
Jun 03 08:37:51.610126 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-09bcb55c-8ebf-470f-ad24-d9eea1c7a947 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:51.615225 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-d4f6f634-faf4-4fd5-8dd2-6391e80072a6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:51.631684 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09bcb55c-8ebf-470f-ad24-d9eea1c7a947 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=81953752-684c-400f-9bd0-d97a85a1c384,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:51.634877 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-09bcb55c-8ebf-470f-ad24-d9eea1c7a947 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:51.637914 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-09bcb55c-8ebf-470f-ad24-d9eea1c7a947 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:51.640115 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-09bcb55c-8ebf-470f-ad24-d9eea1c7a947 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/81953752-684c-400f-9bd0-d97a85a1c384 HTTP/1.1" status: 204  len: 168 time: 0.2753651
Jun 03 08:37:51.730707 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b3ad6df4-f40f-4302-acc8-047f6c2d7f53 req-7c4f7d4d-83b8-40e7-9fed-e355de0d0afa tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1233144
Jun 03 08:37:51.740881 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] Notify callbacks [] for port, precommit_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:51.753638 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] Transition to ACTIVE for port object a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36 will not be triggered until provisioned by entity L2. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:37:51.756900 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:51.861883 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:51.865906 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:51.946963 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] Attempting to bind port a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36 on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:37:51.947344 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] Attempting to bind port a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36 by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:37:51.947720 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] Attempting to bind port a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36 on network 684ef871-89aa-450d-ae0d-e232bfaf51fb {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:37:51.951142 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15d7e8ad-2b00-447d-8d05-d55c94af4848 None None] Pushing event updated for resources: {'Port': ['ID=a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36,revision_number=2']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:51.955056 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-15d7e8ad-2b00-447d-8d05-d55c94af4848 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:51.956127 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 37, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:37:51.956386 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] Checking segment: {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:37:51.956802 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:51.957199 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] Bound using segment: {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:37:51.957678 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] Bound port: a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:37:51.958058 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:51.969645 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.db_base_plugin_common [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] Allocated IP 172.20.0.1 (7722e8fc-e6a8-422f-8456-a3c594da293a/3eb5b6e1-724c-48ab-a49b-2b1fa5adb401/1b247c7f-4ca7-44d5-97b2-94031de25c6e) {{(pid=92324) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:37:52.043067 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] For port a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:37:52.047019 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] For port a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:37:52.136684 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:52.143194 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-413fa614-603e-4020-a053-720fef8e9f68 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:52.169561 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c34e9b28-eade-4f73-8d84-9316ac522c7d req-36d0a672-b73f-4f6d-bbed-905d1a960a6c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:52.171801 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c34e9b28-eade-4f73-8d84-9316ac522c7d req-36d0a672-b73f-4f6d-bbed-905d1a960a6c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 946 time: 0.1084578
Jun 03 08:37:52.179795 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:52.199683 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.provisioning_blocks [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] Transition to ACTIVE for port object 1b247c7f-4ca7-44d5-97b2-94031de25c6e will not be triggered until provisioned by entity DHCP. {{(pid=92324) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:37:52.225583 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c34e9b28-eade-4f73-8d84-9316ac522c7d req-7330e881-f555-4b9d-89fe-60482112a001 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0463369
Jun 03 08:37:52.254888 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] Routers {'8d6b2faf-68a8-4edd-91ad-352b92d8cf84'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:37:52.255514 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86cf7d00>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:37:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:52.286241 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:52.291029 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:52.317861 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15d7e8ad-2b00-447d-8d05-d55c94af4848 None None] Pushing event updated for resources: {'Port': ['ID=a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36,revision_number=3']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:52.322398 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-15d7e8ad-2b00-447d-8d05-d55c94af4848 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:52.358849 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] Network 7722e8fc-e6a8-422f-8456-a3c594da293a is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:37:52.362462 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:37:52.366329 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] Received port after_create {{(pid=92324) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:37:52.400979 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] Pushing event updated for resources: {'Port': ['ID=1b247c7f-4ca7-44d5-97b2-94031de25c6e,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:52.401214 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:37:52.405297 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:52.426002 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-16328800'] for router_interface, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:52.561550 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] Set router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:37:52.719582 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:37:52.719582 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:52.780893 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:52.858946 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-c3fda11e-8122-4ef2-8c94-f499d3291db5 None None] Provisioning for port 1b247c7f-4ca7-44d5-97b2-94031de25c6e completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:37:52.906808 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-c3fda11e-8122-4ef2-8c94-f499d3291db5 None None] Provisioning complete for port 1b247c7f-4ca7-44d5-97b2-94031de25c6e triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:37:52.907196 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-c3fda11e-8122-4ef2-8c94-f499d3291db5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:53.031409 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484489eb-0976-46fd-b6c1-39cc77b92b84 req-36facd5f-fb35-4445-abb1-e551a415c887 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:53.033177 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-484489eb-0976-46fd-b6c1-39cc77b92b84 req-36facd5f-fb35-4445-abb1-e551a415c887 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=0e5e096a327f421e9b0a02235740cc36&device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 1099 time: 0.2260458
Jun 03 08:37:53.041328 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-c3fda11e-8122-4ef2-8c94-f499d3291db5 None None] Port 1b247c7f-4ca7-44d5-97b2-94031de25c6e cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:37:53.059083 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-640263f1-c2d0-498d-9cc0-0ff08b4b61f2 req-07d6394c-26dc-455c-8bf7-e7c97906f3b7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:53.060907 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-640263f1-c2d0-498d-9cc0-0ff08b4b61f2 req-07d6394c-26dc-455c-8bf7-e7c97906f3b7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.1244583
Jun 03 08:37:53.070195 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86cf7d00>, [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:49Z', 'revision_number': 3, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:53.074580 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4df0d04-d3ac-4d11-9f0b-3429fc1c6b94 None None] The sync data for ids ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'] in dv-cinder-787262-5-iscsi is: [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:49Z', 'revision_number': 3, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:37:53.135653 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-640263f1-c2d0-498d-9cc0-0ff08b4b61f2 req-1beb82de-5937-4a02-8299-a8d8617cd6a4 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0513308
Jun 03 08:37:53.195933 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:53.247072 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484489eb-0976-46fd-b6c1-39cc77b92b84 req-ce2b2ce6-3f93-4d9c-a524-36cf34f84323 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:53.248552 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-484489eb-0976-46fd-b6c1-39cc77b92b84 req-ce2b2ce6-3f93-4d9c-a524-36cf34f84323 service neutron] 10.222.0.55 "GET /v2.0/networks?id=4a053960-3cf4-4216-b7a5-291ef61e89b7 HTTP/1.1" status: 200  len: 910 time: 0.2050266
Jun 03 08:37:53.289311 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15641369'] for port, after_update {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:53.317318 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:53.381410 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-484489eb-0976-46fd-b6c1-39cc77b92b84 req-8d140ee5-04de-4e03-a710-bb7a759cd693 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4312e3c9-0931-4dd5-ba11-db0d982c2a11 HTTP/1.1" status: 200  len: 1001 time: 0.1263123
Jun 03 08:37:53.464842 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484489eb-0976-46fd-b6c1-39cc77b92b84 req-4eca6ebd-039b-429e-8062-714d6d2fc817 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:53.466296 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-484489eb-0976-46fd-b6c1-39cc77b92b84 req-4eca6ebd-039b-429e-8062-714d6d2fc817 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=fc181126-7c66-44d3-b731-a59036bd562f HTTP/1.1" status: 200  len: 848 time: 0.0728128
Jun 03 08:37:53.495377 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-16344774', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-16328707'] for router_interface, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:53.523978 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] Pushing event updated for resources: {'Port': ['ID=1b247c7f-4ca7-44d5-97b2-94031de25c6e,revision_number=2']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:53.538768 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.221s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:53.558043 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484489eb-0976-46fd-b6c1-39cc77b92b84 req-b5b5d15d-39ad-4877-9186-acd6f0897d62 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:53.559630 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-484489eb-0976-46fd-b6c1-39cc77b92b84 req-b5b5d15d-39ad-4877-9186-acd6f0897d62 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=4a053960-3cf4-4216-b7a5-291ef61e89b7&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0868483
Jun 03 08:37:53.651578 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e8937d5-004f-43a8-b731-74284eece89a req-57890907-f1e4-4507-b2f4-36192edee622 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:53.653107 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0e8937d5-004f-43a8-b731-74284eece89a req-57890907-f1e4-4507-b2f4-36192edee622 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 946 time: 0.2535486
Jun 03 08:37:53.700478 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-484489eb-0976-46fd-b6c1-39cc77b92b84 req-357320c8-f66a-4a83-85ae-2e7eb5dd5ddb service neutron] 10.222.0.55 "GET /v2.0/networks/4a053960-3cf4-4216-b7a5-291ef61e89b7?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1342599
Jun 03 08:37:53.720035 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] Network 7722e8fc-e6a8-422f-8456-a3c594da293a is already hosted by enough agents. {{(pid=92324) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:37:53.724054 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:37:53.914259 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0e8937d5-004f-43a8-b731-74284eece89a req-49fd6301-5655-42fa-a26c-2a6f981cd6b2 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2506630
Jun 03 08:37:53.920380 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-484489eb-0976-46fd-b6c1-39cc77b92b84 req-2c4fef0f-90a4-4305-b198-868e0967d8f6 service neutron] 10.222.0.55 "GET /v2.0/networks/4a053960-3cf4-4216-b7a5-291ef61e89b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2121713
Jun 03 08:37:54.038946 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] Router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:37:54.068991 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-e999fd01-89df-4647-b330-b01ab9e9a486 None None] Provisioning complete for port 1b247c7f-4ca7-44d5-97b2-94031de25c6e triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:37:54.070063 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-e999fd01-89df-4647-b330-b01ab9e9a486 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:54.132924 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-e999fd01-89df-4647-b330-b01ab9e9a486 None None] Port 1b247c7f-4ca7-44d5-97b2-94031de25c6e cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:37:54.241640 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:37:54.250648 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] 10.222.0.11 "PUT /v2.0/routers/8d6b2faf-68a8-4edd-91ad-352b92d8cf84/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.4746709
Jun 03 08:37:54.349069 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-936f87d6-581a-4ab4-bc96-5a7bef1b0d74 req-f22cb5b3-e2f7-448a-b744-d6b016a87e84 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:54.355038 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-936f87d6-581a-4ab4-bc96-5a7bef1b0d74 req-f22cb5b3-e2f7-448a-b744-d6b016a87e84 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.1044817
Jun 03 08:37:54.383087 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:37:54.405155 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-936f87d6-581a-4ab4-bc96-5a7bef1b0d74 req-3195f132-69fd-4905-bc5c-8d73dc52889d tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0471730
Jun 03 08:37:54.512748 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:37:54.518323 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:37:54.518771 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:54.646663 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:54.663635 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:37:54.729568 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:54.732393 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-6520bd9c-89fc-429f-867c-6fcc84cb6eb8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:54.806371 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:54.815569 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:54.849997 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] Sync routers for ids ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'] in dv-cinder-787262-5-iscsi {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:37:54.860246 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] Routers {'8d6b2faf-68a8-4edd-91ad-352b92d8cf84'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:37:54.860860 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae87a059a0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:37:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:55.071527 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] Set router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:37:55.106120 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 54956) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:55.118670 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-547033604-network', 'tenant_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:37:55.129354 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:37:55.141336 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Usage tracker for resource:network and tenant:b51f5fefb5f6423fa63fde3f8d7c6b71 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:37:55.144803 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:37:55.152307 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:37:55.152699 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2de45a7-99d8-4e55-bb78-c713aa519b17 req-8a283c7d-6b3f-4264-bf56-535cdd535ae3 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:55.155168 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d2de45a7-99d8-4e55-bb78-c713aa519b17 req-8a283c7d-6b3f-4264-bf56-535cdd535ae3 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 946 time: 0.1257236
Jun 03 08:37:55.203437 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d2de45a7-99d8-4e55-bb78-c713aa519b17 req-b69f1dcb-dfc8-4866-9c5d-1468f54a4545 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0422289
Jun 03 08:37:55.232653 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Made reservation on behalf of b51f5fefb5f6423fa63fde3f8d7c6b71 for: {'network': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:37:55.234994 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-676039'] for network, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:55.250005 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:55.266682 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:37:55.271297 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Usage tracker for resource:security_group_rule and tenant:b51f5fefb5f6423fa63fde3f8d7c6b71 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:37:55.274179 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:37:55.280069 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:37:55.367702 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:55.407725 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae87a059a0>, [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '1b247c7f-4ca7-44d5-97b2-94031de25c6e', 'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'mac_address': 'fa:16:3e:f4:70:c8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:51Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 2, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'subnets': [{'id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:55.412085 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] Checking router: 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 for host: dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:37:55.412469 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] Updating router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 port 1b247c7f-4ca7-44d5-97b2-94031de25c6e binding host dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 03 08:37:55.444314 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:55.459047 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] vlan segment allocate from pool success with {'vlan_id': 528, 'physical_network': 'physnet1'}  {{(pid=92323) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 03 08:37:55.467352 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:55.467704 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.db.segments_db [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Added segment 70d8683e-3f23-44dc-9902-dc5fa4f11976 of type vlan for network 2108ca94-1a9c-41e5-9409-225af0444c35
Jun 03 08:37:55.471440 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:55.488263 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-521fec0c-2c14-4edd-8324-13e6db7162b9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:55.503950 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8774223827658'] for network, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:55.526193 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cd98479b-8e87-4fc9-9027-5357fe68b6c0,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:55.529909 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:55.638413 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820'] for network, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:55.639793 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:55.640827 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:55.645602 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:55.653529 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6a47da5-f3e4-457e-86d4-7b53e5a3316e req-3db137e8-3873-434c-acde-1423ebb19b25 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:55.655273 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f6a47da5-f3e4-457e-86d4-7b53e5a3316e req-3db137e8-3873-434c-acde-1423ebb19b25 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.0966752
Jun 03 08:37:55.733251 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f6a47da5-f3e4-457e-86d4-7b53e5a3316e req-3d1108e2-638c-4ec8-adb4-ffd335aa0e54 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0707405
Jun 03 08:37:55.760838 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Pushing event updated for resources: {'Network': ['ID=2108ca94-1a9c-41e5-9409-225af0444c35,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:55.763874 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:55.772647 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Network 2108ca94-1a9c-41e5-9409-225af0444c35 details requested by agent ovs-agent-dv-cinder-787262-5-iscsi with host dv-cinder-787262-5-iscsi {{(pid=92325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 03 08:37:55.810312 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 0.6986275
Jun 03 08:37:55.812893 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 54964) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:55.818733 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-7da85139-c7b2-4010-bc7f-29f32b6c06c3 admin admin] Request body: {'subnet': {'network_id': '2108ca94-1a9c-41e5-9409-225af0444c35', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-547033604-subnet', 'tenant_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'ip_version': 4}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:37:55.823954 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-7da85139-c7b2-4010-bc7f-29f32b6c06c3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:37:55.828037 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-7da85139-c7b2-4010-bc7f-29f32b6c06c3 admin admin] Usage tracker for resource:subnet and tenant:b51f5fefb5f6423fa63fde3f8d7c6b71 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:37:55.831148 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-7da85139-c7b2-4010-bc7f-29f32b6c06c3 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:37:55.839688 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-7da85139-c7b2-4010-bc7f-29f32b6c06c3 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:37:55.881983 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] Notify callbacks [] for port, precommit_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:55.893510 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.provisioning_blocks [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] Transition to ACTIVE for port object 1b247c7f-4ca7-44d5-97b2-94031de25c6e will not be triggered until provisioned by entity L2. {{(pid=92326) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:37:55.969554 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7da85139-c7b2-4010-bc7f-29f32b6c06c3 admin admin] Made reservation on behalf of b51f5fefb5f6423fa63fde3f8d7c6b71 for: {'subnet': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:37:55.969862 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:55.972978 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7da85139-c7b2-4010-bc7f-29f32b6c06c3 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14857961'] for subnet, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:55.977927 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-75025a32-eee3-4f40-ba9c-e34ed7ac2bd0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:56.125688 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:56.159261 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a4a3bb7-b4c4-4e37-b4fe-6d7e0a7f611b None None] Pushing event updated for resources: {'Port': ['ID=1b247c7f-4ca7-44d5-97b2-94031de25c6e,revision_number=3']} {{(pid=92326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:56.218448 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a4a3bb7-b4c4-4e37-b4fe-6d7e0a7f611b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:56.218814 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a4a3bb7-b4c4-4e37-b4fe-6d7e0a7f611b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:56.219327 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a4a3bb7-b4c4-4e37-b4fe-6d7e0a7f611b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:56.219656 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a4a3bb7-b4c4-4e37-b4fe-6d7e0a7f611b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:56.219980 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a4a3bb7-b4c4-4e37-b4fe-6d7e0a7f611b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:56.220303 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a4a3bb7-b4c4-4e37-b4fe-6d7e0a7f611b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:56.220618 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a4a3bb7-b4c4-4e37-b4fe-6d7e0a7f611b None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:56.221649 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a4a3bb7-b4c4-4e37-b4fe-6d7e0a7f611b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:56.221991 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a4a3bb7-b4c4-4e37-b4fe-6d7e0a7f611b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:56.222315 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a4a3bb7-b4c4-4e37-b4fe-6d7e0a7f611b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:56.223094 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a4a3bb7-b4c4-4e37-b4fe-6d7e0a7f611b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:56.223415 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a4a3bb7-b4c4-4e37-b4fe-6d7e0a7f611b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92326) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:37:56.229005 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-2a4a3bb7-b4c4-4e37-b4fe-6d7e0a7f611b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.251s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:56.301244 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] Attempting to bind port 1b247c7f-4ca7-44d5-97b2-94031de25c6e on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:37:56.307381 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] Attempting to bind port 1b247c7f-4ca7-44d5-97b2-94031de25c6e by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': 'fd0545c3-e436-4d2f-9d2d-71983702d34f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a'}] {{(pid=92326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:37:56.307381 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] Attempting to bind port 1b247c7f-4ca7-44d5-97b2-94031de25c6e on network 7722e8fc-e6a8-422f-8456-a3c594da293a {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:37:56.311192 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 37, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:37:56.311516 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] Checking segment: {'id': 'fd0545c3-e436-4d2f-9d2d-71983702d34f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92326) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:37:56.314630 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:56.315121 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] Bound using segment: {'id': 'fd0545c3-e436-4d2f-9d2d-71983702d34f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a'} {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:37:56.316040 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] Bound port: 1b247c7f-4ca7-44d5-97b2-94031de25c6e, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fd0545c3-e436-4d2f-9d2d-71983702d34f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a'}}] {{(pid=92326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:37:56.316040 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:56.413522 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:37:56.425762 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.db [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] For port 1b247c7f-4ca7-44d5-97b2-94031de25c6e, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92326) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:37:56.429083 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.db [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] For port 1b247c7f-4ca7-44d5-97b2-94031de25c6e, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=1b247c7f-4ca7-44d5-97b2-94031de25c6e,segment=NetworkSegment(fd0545c3-e436-4d2f-9d2d-71983702d34f),segment_id=fd0545c3-e436-4d2f-9d2d-71983702d34f)] {{(pid=92326) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:37:56.453514 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6230450c-6601-4b63-bd90-187bfae4b80c req-0357b3e8-9b30-493c-b10c-ceea07c59f59 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:56.455789 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6230450c-6601-4b63-bd90-187bfae4b80c req-0357b3e8-9b30-493c-b10c-ceea07c59f59 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 946 time: 0.0900638
Jun 03 08:37:56.496069 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:37:56.496707 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:56.502659 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6230450c-6601-4b63-bd90-187bfae4b80c req-f8295aa5-17f7-4c4f-b9e0-ef19c4cf6c62 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0407922
Jun 03 08:37:56.541773 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:56.545764 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:56.622290 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] Routers {'8d6b2faf-68a8-4edd-91ad-352b92d8cf84'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:37:56.623218 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae87a059a0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:37:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:56.697674 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a4a3bb7-b4c4-4e37-b4fe-6d7e0a7f611b None None] Pushing event updated for resources: {'Port': ['ID=1b247c7f-4ca7-44d5-97b2-94031de25c6e,revision_number=4']} {{(pid=92326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:56.707765 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-2a4a3bb7-b4c4-4e37-b4fe-6d7e0a7f611b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:56.724248 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7da85139-c7b2-4010-bc7f-29f32b6c06c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-14211155', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14857887'] for subnet, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:56.729737 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-5755aaff-bd55-46ef-a558-24a691beb528 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:56.809274 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7da85139-c7b2-4010-bc7f-29f32b6c06c3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6b0564e9-f803-4af7-9957-04aa3130c69c,revision_number=0']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:56.813322 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-7da85139-c7b2-4010-bc7f-29f32b6c06c3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:56.819800 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7da85139-c7b2-4010-bc7f-29f32b6c06c3 admin admin] Checking segment: {'id': '70d8683e-3f23-44dc-9902-dc5fa4f11976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 528, 'network_id': '2108ca94-1a9c-41e5-9409-225af0444c35'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:37:56.824230 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7da85139-c7b2-4010-bc7f-29f32b6c06c3 admin admin] Network hostable DHCP agents. Network: 2108ca94-1a9c-41e5-9409-225af0444c35, hostable agents: ['07372699-02ac-4239-816f-84b3a5b0eff9'], hosted agents: [] {{(pid=92323) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 03 08:37:56.847309 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] Set router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:37:56.938955 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7da85139-c7b2-4010-bc7f-29f32b6c06c3 admin admin] Network 2108ca94-1a9c-41e5-9409-225af0444c35 is scheduled to be hosted by DHCP agent 07372699-02ac-4239-816f-84b3a5b0eff9 with binding_index 1 {{(pid=92323) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 03 08:37:56.966599 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71c56eff-eff4-4247-af79-38c89fc72d35 req-e3b7ff1d-1674-41f2-98a4-44443bf9cc62 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:56.970023 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-71c56eff-eff4-4247-af79-38c89fc72d35 req-e3b7ff1d-1674-41f2-98a4-44443bf9cc62 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.0915985
Jun 03 08:37:57.027032 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-71c56eff-eff4-4247-af79-38c89fc72d35 req-c796d261-7b85-43d0-bc2e-e3f4f811074c tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0518746
Jun 03 08:37:57.028487 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-7da85139-c7b2-4010-bc7f-29f32b6c06c3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-5-iscsi, 2108ca94-1a9c-41e5-9409-225af0444c35) {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:37:57.039830 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7da85139-c7b2-4010-bc7f-29f32b6c06c3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:57.040820 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7da85139-c7b2-4010-bc7f-29f32b6c06c3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:57.041451 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6263327d-11ba-4b8a-9450-03ade7e27e39 None None] Network 2108ca94-1a9c-41e5-9409-225af0444c35 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:37:57.176854 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-7da85139-c7b2-4010-bc7f-29f32b6c06c3 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 847 time: 1.3626537
Jun 03 08:37:57.179337 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 54974) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:57.183597 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae87a059a0>, [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '1b247c7f-4ca7-44d5-97b2-94031de25c6e', 'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'mac_address': 'fa:16:3e:f4:70:c8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:51Z', 'updated_at': '2021-06-03T08:37:56Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'subnets': [{'id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:37:57.184264 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-547033604-router', 'tenant_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:37:57.188105 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-431db00e-4473-4ce0-b9ed-d583e4a83d05 None None] The sync data for ids ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'] in dv-cinder-787262-5-iscsi is: [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '1b247c7f-4ca7-44d5-97b2-94031de25c6e', 'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'mac_address': 'fa:16:3e:f4:70:c8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:51Z', 'updated_at': '2021-06-03T08:37:56Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'subnets': [{'id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:37:57.189659 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:37:57.194650 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Usage tracker for resource:router and tenant:b51f5fefb5f6423fa63fde3f8d7c6b71 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:37:57.197639 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:37:57.207324 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:37:57.285577 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-16388154', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2397'] for router, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:57.294948 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-16389011', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-16327785', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-16383573', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2340'] for router, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:57.311142 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:57.335146 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp3789a88e-0f76-536c-9507-4ab4ace56879-2108ca94-1a9c-41e5-9409-225af0444c35', 'network_id': '2108ca94-1a9c-41e5-9409-225af0444c35', 'tenant_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'fixed_ips': [{'subnet_id': '6b0564e9-f803-4af7-9957-04aa3130c69c'}]}} from dv-cinder-787262-5-iscsi. {{(pid=92325) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 03 08:37:57.336269 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:57.515893 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.db_base_plugin_common [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Allocated IP 172.20.0.2 (2108ca94-1a9c-41e5-9409-225af0444c35/6b0564e9-f803-4af7-9957-04aa3130c69c/8396de25-d3bc-4d29-80fd-33743e76bc92) {{(pid=92325) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:37:57.693311 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-16327803', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-16388116', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2358'] for router, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:57.753261 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79ff6c50-8bd7-4480-905b-cf0f10084a34 req-57e463a1-7cb0-4e4d-aedb-5fdb108f652c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:57.756086 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-79ff6c50-8bd7-4480-905b-cf0f10084a34 req-57e463a1-7cb0-4e4d-aedb-5fdb108f652c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 946 time: 0.1212618
Jun 03 08:37:57.806678 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Notify callbacks [] for port, precommit_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:57.810915 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-79ff6c50-8bd7-4480-905b-cf0f10084a34 req-fc61a997-03ec-465f-9125-91f4ebf55d5e tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0470386
Jun 03 08:37:57.834745 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Transition to ACTIVE for port object 8396de25-d3bc-4d29-80fd-33743e76bc92 will not be triggered until provisioned by entity L2. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:37:57.848996 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Transition to ACTIVE for port object 8396de25-d3bc-4d29-80fd-33743e76bc92 will not be triggered until provisioned by entity DHCP. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:37:57.909776 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142'] for port, after_create {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:57.914752 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-52728fea-a257-4d4c-beb6-a303e864a57b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:57.982589 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Network 2108ca94-1a9c-41e5-9409-225af0444c35 is already hosted by enough agents. {{(pid=92325) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:37:57.987212 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.scheduler.base_scheduler [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Resources bound (agent type, host, resource id):  {{(pid=92325) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:37:57.991369 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Received port after_create {{(pid=92325) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:37:58.027829 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Pushing event updated for resources: {'Port': ['ID=8396de25-d3bc-4d29-80fd-33743e76bc92,revision_number=1']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:58.037988 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:58.099709 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Attempting to bind port 8396de25-d3bc-4d29-80fd-33743e76bc92 on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:37:58.100519 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Attempting to bind port 8396de25-d3bc-4d29-80fd-33743e76bc92 by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '70d8683e-3f23-44dc-9902-dc5fa4f11976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 528, 'network_id': '2108ca94-1a9c-41e5-9409-225af0444c35'}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:37:58.100651 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Attempting to bind port 8396de25-d3bc-4d29-80fd-33743e76bc92 on network 2108ca94-1a9c-41e5-9409-225af0444c35 {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:37:58.113341 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 37, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:37:58.113341 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Checking segment: {'id': '70d8683e-3f23-44dc-9902-dc5fa4f11976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 528, 'network_id': '2108ca94-1a9c-41e5-9409-225af0444c35'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:37:58.113341 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:58.113341 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Bound using segment: {'id': '70d8683e-3f23-44dc-9902-dc5fa4f11976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 528, 'network_id': '2108ca94-1a9c-41e5-9409-225af0444c35'} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:37:58.113341 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Bound port: 8396de25-d3bc-4d29-80fd-33743e76bc92, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '70d8683e-3f23-44dc-9902-dc5fa4f11976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 528, 'network_id': '2108ca94-1a9c-41e5-9409-225af0444c35'}}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:37:58.113341 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:58.165177 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 1837d7d5-12fa-4414-9722-e593f5ed4c48 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:37:58.169229 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 4312e3c9-0931-4dd5-ba11-db0d982c2a11 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:37:58.193866 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:58.246145 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:58.374838 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7113af9-59fa-43cd-b1fd-24d81215e23b req-6066e751-ddb6-401e-ad75-647ce278953b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:58.385791 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d7113af9-59fa-43cd-b1fd-24d81215e23b req-6066e751-ddb6-401e-ad75-647ce278953b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.1447685
Jun 03 08:37:58.490535 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d7113af9-59fa-43cd-b1fd-24d81215e23b req-7f8de3b7-9df7-44a8-a124-192b92b21ed6 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0992396
Jun 03 08:37:58.585666 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 1b247c7f-4ca7-44d5-97b2-94031de25c6e up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:37:58.623937 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Allocated IP 172.27.0.120 (684ef871-89aa-450d-ae0d-e232bfaf51fb/e7b58fba-1ed5-483b-b341-7736b2ffb853/be25e631-c897-43d4-a1a3-8e5bc9176a7d) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:37:58.645892 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] For port 8396de25-d3bc-4d29-80fd-33743e76bc92, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:37:58.663550 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 54998) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:37:58.693388 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d3aa000-1ddd-49f8-abd1-ada28add0ae5 req-393bcf20-c7b3-469f-8cb9-02f54a59c8de tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:58.696947 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] For port 8396de25-d3bc-4d29-80fd-33743e76bc92, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=8396de25-d3bc-4d29-80fd-33743e76bc92,segment=NetworkSegment(70d8683e-3f23-44dc-9902-dc5fa4f11976),segment_id=70d8683e-3f23-44dc-9902-dc5fa4f11976)] {{(pid=92325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:37:58.696947 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:58.699781 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6d3aa000-1ddd-49f8-abd1-ada28add0ae5 req-393bcf20-c7b3-469f-8cb9-02f54a59c8de tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 946 time: 0.1587121
Jun 03 08:37:58.750859 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 1837d7d5-12fa-4414-9722-e593f5ed4c48, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=1837d7d5-12fa-4414-9722-e593f5ed4c48,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:37:58.764277 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '80cea05e-57d7-4393-818e-b7a621e986ec', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4312e3c9-0931-4dd5-ba11-db0d982c2a11'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:37:58.766790 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c754a09a-0623-44a6-8c30-366a18912891" -d '{"events": [{"server_uuid": "80cea05e-57d7-4393-818e-b7a621e986ec", "name": "network-vif-unplugged", "status": "completed", "tag": "4312e3c9-0931-4dd5-ba11-db0d982c2a11"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:37:58.784068 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 4312e3c9-0931-4dd5-ba11-db0d982c2a11, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=4312e3c9-0931-4dd5-ba11-db0d982c2a11,segment=NetworkSegment(aaa5b128-9aff-431e-b567-4ca42a016de6),segment_id=aaa5b128-9aff-431e-b567-4ca42a016de6)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:37:58.786435 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': '1837d7d5-12fa-4414-9722-e593f5ed4c48', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'port_id': '1837d7d5-12fa-4414-9722-e593f5ed4c48', 'mac_address': 'fa:16:3e:ee:f3:ae', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 526, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:37:58.850956 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Thu, 03 Jun 2021 08:37:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4653b91f-1fec-420a-92e3-5e6ec872a16e x-openstack-request-id: req-4653b91f-1fec-420a-92e3-5e6ec872a16e {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:37:58.852435 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "80cea05e-57d7-4393-818e-b7a621e986ec", "name": "network-vif-unplugged", "status": "failed", "tag": "4312e3c9-0931-4dd5-ba11-db0d982c2a11", "code": 422}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:37:58.853372 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-4653b91f-1fec-420a-92e3-5e6ec872a16e {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:37:58.854655 dv-cinder-787262-5-iscsi neutron-server[92325]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '80cea05e-57d7-4393-818e-b7a621e986ec', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '4312e3c9-0931-4dd5-ba11-db0d982c2a11', 'code': 422} returned with failed status
Jun 03 08:37:58.855157 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0e712dda-e607-4416-8658-8986ae306ab2 req-d978cca9-4971-45a7-9a5f-7195a876cd00 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1903985
Jun 03 08:37:58.864935 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:58.871942 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-5870201c-2736-4432-bf70-cadae54eb17d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:58.928285 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:58.950952 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port 1b247c7f-4ca7-44d5-97b2-94031de25c6e completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:37:58.962581 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6d3aa000-1ddd-49f8-abd1-ada28add0ae5 req-f786a397-f476-4a30-8289-5cf4d5e1b588 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2572026
Jun 03 08:37:58.973065 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 1b247c7f-4ca7-44d5-97b2-94031de25c6e triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:37:58.973456 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:59.029732 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:59.039420 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:59.103677 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 1837d7d5-12fa-4414-9722-e593f5ed4c48 {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:37:59.128689 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Pushing event updated for resources: {'Port': ['ID=8396de25-d3bc-4d29-80fd-33743e76bc92,revision_number=2']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:59.131690 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:59.132028 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.260s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:59.135508 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.185s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:59.152389 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b43d331b-3797-4642-9145-ca6026bf2db3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:59.181488 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 1837d7d5-12fa-4414-9722-e593f5ed4c48, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=1837d7d5-12fa-4414-9722-e593f5ed4c48,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:37:59.265839 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:59.283750 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=4312e3c9-0931-4dd5-ba11-db0d982c2a11,revision_number=6']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:59.289033 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:59.290183 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.018s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:59.350211 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:59.358397 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Pushing event updated for resources: {'Port': ['ID=be25e631-c897-43d4-a1a3-8e5bc9176a7d,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:59.370615 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:37:59.375084 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.221s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:59.380902 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:37:59.384016 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:37:59.415580 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['1837d7d5-12fa-4414-9722-e593f5ed4c48'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:37:59.585241 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=1837d7d5-12fa-4414-9722-e593f5ed4c48,revision_number=6']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:59.605439 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.315s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:37:59.650375 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port 1b247c7f-4ca7-44d5-97b2-94031de25c6e, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=1b247c7f-4ca7-44d5-97b2-94031de25c6e,segment=NetworkSegment(fd0545c3-e436-4d2f-9d2d-71983702d34f),segment_id=fd0545c3-e436-4d2f-9d2d-71983702d34f)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:37:59.742797 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:37:59.750011 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-6a5b7f23-cef4-4d8a-8406-b37a010dca94 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:37:59.871402 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=1b247c7f-4ca7-44d5-97b2-94031de25c6e,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:37:59.929915 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e87bda9a-02de-46c7-84fa-047d1e6ae160 req-9e518cd1-1292-4e06-b028-19fdb680ab51 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:37:59.933298 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e87bda9a-02de-46c7-84fa-047d1e6ae160 req-9e518cd1-1292-4e06-b028-19fdb680ab51 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 945 time: 0.2283430
Jun 03 08:37:59.933973 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:00.028479 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92c03d98-d0fb-4af4-a4d9-74ac72606a06 req-1150f0f3-838e-413d-8555-fd066814ac53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:00.030113 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-92c03d98-d0fb-4af4-a4d9-74ac72606a06 req-1150f0f3-838e-413d-8555-fd066814ac53 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=36c42f532cd14f19811ffbee3a39a208&device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 1098 time: 0.4038081
Jun 03 08:38:00.031213 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e87bda9a-02de-46c7-84fa-047d1e6ae160 req-66377f03-aba8-484d-a34e-5dc410827deb tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0879045
Jun 03 08:38:00.246968 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 1837d7d5-12fa-4414-9722-e593f5ed4c48 up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:38:00.602967 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:00.623847 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port 1837d7d5-12fa-4414-9722-e593f5ed4c48 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:38:00.626724 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:00.684862 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 8396de25-d3bc-4d29-80fd-33743e76bc92 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:38:00.801406 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92c03d98-d0fb-4af4-a4d9-74ac72606a06 req-b17a5a98-de97-4599-a84f-612c563a960e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:00.802917 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-92c03d98-d0fb-4af4-a4d9-74ac72606a06 req-b17a5a98-de97-4599-a84f-612c563a960e service neutron] 10.222.0.55 "GET /v2.0/networks?id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba HTTP/1.1" status: 200  len: 918 time: 0.7457218
Jun 03 08:38:00.804506 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b27d026-7f7f-4663-9496-5dff3113a8f4 None None] Network 2108ca94-1a9c-41e5-9409-225af0444c35 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:38:01.036319 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-92c03d98-d0fb-4af4-a4d9-74ac72606a06 req-29451457-1ac9-44b1-b4a9-0ce7ccee4ee0 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=1837d7d5-12fa-4414-9722-e593f5ed4c48 HTTP/1.1" status: 200  len: 1001 time: 0.2192972
Jun 03 08:38:01.085157 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-7df6c5a0-5df1-4de0-aca0-7097a75b6f6c None None] Provisioning for port 8396de25-d3bc-4d29-80fd-33743e76bc92 completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:38:01.095285 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:01.146633 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port 8396de25-d3bc-4d29-80fd-33743e76bc92 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:38:01.185772 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 8396de25-d3bc-4d29-80fd-33743e76bc92 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:38:01.186364 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:01.200708 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bb7d4a4-96ef-480d-819e-56fbde84ed3c req-d1488f23-83eb-4874-ae37-1dc70127c64f tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:01.202183 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3bb7d4a4-96ef-480d-819e-56fbde84ed3c req-d1488f23-83eb-4874-ae37-1dc70127c64f tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 944 time: 0.9447424
Jun 03 08:38:01.209111 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92c03d98-d0fb-4af4-a4d9-74ac72606a06 req-4988988d-44ce-4373-9eb5-96d05ec76306 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:01.210597 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-92c03d98-d0fb-4af4-a4d9-74ac72606a06 req-4988988d-44ce-4373-9eb5-96d05ec76306 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=cff67a13-bc33-4d3e-a796-5829103ca25c HTTP/1.1" status: 200  len: 856 time: 0.1661184
Jun 03 08:38:01.294191 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '41d57543-e5c8-45b5-8eef-2f829250eec3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1837d7d5-12fa-4414-9722-e593f5ed4c48'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:38:01.296686 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8a8361b4-7a77-4a72-8936-5e90eb1cd0f4" -d '{"events": [{"server_uuid": "41d57543-e5c8-45b5-8eef-2f829250eec3", "name": "network-vif-plugged", "status": "completed", "tag": "1837d7d5-12fa-4414-9722-e593f5ed4c48"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:38:01.317057 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 1837d7d5-12fa-4414-9722-e593f5ed4c48, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=1837d7d5-12fa-4414-9722-e593f5ed4c48,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:38:01.388843 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:01.399508 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:01.404374 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:01.475636 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=1837d7d5-12fa-4414-9722-e593f5ed4c48,revision_number=7']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:01.482533 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:01.507258 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1bb96ba-8bb0-444b-a829-dc2963ec1b2d req-1e493418-df8c-4ea7-9dc0-7d64488abce0 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:01.509954 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c1bb96ba-8bb0-444b-a829-dc2963ec1b2d req-1e493418-df8c-4ea7-9dc0-7d64488abce0 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.2599142
Jun 03 08:38:01.511826 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port 8396de25-d3bc-4d29-80fd-33743e76bc92, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=8396de25-d3bc-4d29-80fd-33743e76bc92,segment=NetworkSegment(70d8683e-3f23-44dc-9902-dc5fa4f11976),segment_id=70d8683e-3f23-44dc-9902-dc5fa4f11976)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:38:01.538450 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3bb7d4a4-96ef-480d-819e-56fbde84ed3c req-b2fa0b0d-c37a-46f5-861e-2fe3aff030ce tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.3195329
Jun 03 08:38:01.586670 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-16388099', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-16327774'] for router, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:01.617618 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c1bb96ba-8bb0-444b-a829-dc2963ec1b2d req-5695e5d2-a14d-426d-b474-4acf3f6994e2 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1003587
Jun 03 08:38:01.627275 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:01.628297 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 1b247c7f-4ca7-44d5-97b2-94031de25c6e up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:38:01.666414 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:38:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2f6721dc-e525-4179-b9db-237bc0b1877b x-openstack-request-id: req-2f6721dc-e525-4179-b9db-237bc0b1877b {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:38:01.666591 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "41d57543-e5c8-45b5-8eef-2f829250eec3", "name": "network-vif-plugged", "status": "completed", "tag": "1837d7d5-12fa-4414-9722-e593f5ed4c48", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:38:01.666908 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-2f6721dc-e525-4179-b9db-237bc0b1877b {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:38:01.668165 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '41d57543-e5c8-45b5-8eef-2f829250eec3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1837d7d5-12fa-4414-9722-e593f5ed4c48', 'code': 200}
Jun 03 08:38:01.668165 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-2167b111-be68-4808-9dec-4c5f45ff8146 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:01.684478 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92c03d98-d0fb-4af4-a4d9-74ac72606a06 req-2f1ff89b-92e4-429f-b382-06c026478ebd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:01.685985 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-92c03d98-d0fb-4af4-a4d9-74ac72606a06 req-2f1ff89b-92e4-429f-b382-06c026478ebd service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.4636109
Jun 03 08:38:01.804991 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=8396de25-d3bc-4d29-80fd-33743e76bc92,revision_number=3']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:01.809537 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:01.828935 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 1b247c7f-4ca7-44d5-97b2-94031de25c6e triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:38:01.829447 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:01.962328 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-92c03d98-d0fb-4af4-a4d9-74ac72606a06 req-80820ade-a0a3-4725-8a79-34f65fc032bc service neutron] 10.222.0.55 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2669585
Jun 03 08:38:02.007999 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-5d36a1de-89a4-4091-a4cb-2f3ec862e3fc None None] Provisioning complete for port 8396de25-d3bc-4d29-80fd-33743e76bc92 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:38:02.008645 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5d36a1de-89a4-4091-a4cb-2f3ec862e3fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:02.157767 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-92c03d98-d0fb-4af4-a4d9-74ac72606a06 req-286f096d-e75a-4bcc-8805-9da0a8628037 service neutron] 10.222.0.55 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1860125
Jun 03 08:38:02.204115 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Router d0b46164-c766-44a8-ab69-459f2a5ccff8 is scheduled to L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 with binding_index 1 {{(pid=92323) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 03 08:38:02.403654 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 8396de25-d3bc-4d29-80fd-33743e76bc92 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:38:02.413976 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:38:02.449352 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] Sync routers for ids ['d0b46164-c766-44a8-ab69-459f2a5ccff8'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:38:02.491308 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] Routers {'d0b46164-c766-44a8-ab69-459f2a5ccff8'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:38:02.491947 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86008f70>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:37:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['d0b46164-c766-44a8-ab69-459f2a5ccff8'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:38:02.518167 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Notify callbacks [] for router, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:02.522593 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] 10.222.0.11 "POST /v2.0/routers HTTP/1.1" status: 201  len: 923 time: 5.3396435
Jun 03 08:38:02.524973 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 55038) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:02.681079 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-655fa3b7-4ab4-4e0f-9aa9-7a9399662474 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:02.756944 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port 8396de25-d3bc-4d29-80fd-33743e76bc92 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:38:02.757330 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:02.842316 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] Set router d0b46164-c766-44a8-ab69-459f2a5ccff8 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:38:02.887925 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f552962a-6aa9-4268-a6db-a9b9168fae86 req-842c3a24-5491-4f3d-8e42-8f4ee4ced5b3 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:02.898857 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f552962a-6aa9-4268-a6db-a9b9168fae86 req-842c3a24-5491-4f3d-8e42-8f4ee4ced5b3 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.1281252
Jun 03 08:38:02.938173 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45bd8f7d-6614-4a65-bd18-71ac6c9a9a5c req-2b9adf19-628a-49f8-94c5-6d299cf107bc tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:02.940195 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-45bd8f7d-6614-4a65-bd18-71ac6c9a9a5c req-2b9adf19-628a-49f8-94c5-6d299cf107bc tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 944 time: 0.1483603
Jun 03 08:38:02.967578 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-f552962a-6aa9-4268-a6db-a9b9168fae86 req-7b0c63e7-b4dd-456c-948a-0fabad6e7e5f tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0673609
Jun 03 08:38:03.061532 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-45bd8f7d-6614-4a65-bd18-71ac6c9a9a5c req-36ce3277-54a0-41de-a838-76a4e8fc3785 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0605583
Jun 03 08:38:03.417592 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86008f70>, [{'id': 'd0b46164-c766-44a8-ab69-459f2a5ccff8', 'name': 'tempest-TestVolumeBootPattern-547033604-router', 'tenant_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.120'}], 'enable_snat': True}, 'gw_port_id': 'be25e631-c897-43d4-a1a3-8e5bc9176a7d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:57Z', 'updated_at': '2021-06-03T08:38:00Z', 'revision_number': 3, 'project_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'gw_port': {'id': 'be25e631-c897-43d4-a1a3-8e5bc9176a7d', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:a9:80', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd0b46164-c766-44a8-ab69-459f2a5ccff8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 571, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:58Z', 'updated_at': '2021-06-03T08:37:58Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:38:03.442436 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] Checking router: d0b46164-c766-44a8-ab69-459f2a5ccff8 for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:38:03.442436 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] Updating router d0b46164-c766-44a8-ab69-459f2a5ccff8 port be25e631-c897-43d4-a1a3-8e5bc9176a7d binding host dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 03 08:38:03.488100 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:03.804765 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:03.971933 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] Notify callbacks [] for port, precommit_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:03.988226 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] Transition to ACTIVE for port object be25e631-c897-43d4-a1a3-8e5bc9176a7d will not be triggered until provisioned by entity L2. {{(pid=92325) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:38:04.106187 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Allocated IP 172.20.0.1 (2108ca94-1a9c-41e5-9409-225af0444c35/6b0564e9-f803-4af7-9957-04aa3130c69c/fff590ab-c371-42b9-8c37-d90f872164d1) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:38:04.194863 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-667690e8-5e33-455b-b7bd-95fa82a33589 req-6be8187b-3684-4057-b145-813f549aaa7f tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:04.197939 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-667690e8-5e33-455b-b7bd-95fa82a33589 req-6be8187b-3684-4057-b145-813f549aaa7f tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.1090300
Jun 03 08:38:04.252809 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-667690e8-5e33-455b-b7bd-95fa82a33589 req-8f1a7694-edb2-4b17-81f3-b297b3f68df3 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0486314
Jun 03 08:38:04.350786 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:04.379151 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f47583c7-583a-46a9-a4df-9d347833e20e req-8174ec75-9532-45c1-8cfa-e7acede08188 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:04.380635 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f47583c7-583a-46a9-a4df-9d347833e20e req-8174ec75-9532-45c1-8cfa-e7acede08188 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 944 time: 0.1508102
Jun 03 08:38:04.381651 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Transition to ACTIVE for port object fff590ab-c371-42b9-8c37-d90f872164d1 will not be triggered until provisioned by entity DHCP. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:38:04.435058 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f47583c7-583a-46a9-a4df-9d347833e20e req-8ab3e0b4-773f-4718-a7b3-2cef886ceed4 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0487094
Jun 03 08:38:04.506050 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:04.509855 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:04.583742 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] Attempting to bind port be25e631-c897-43d4-a1a3-8e5bc9176a7d on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:38:04.588677 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] Attempting to bind port be25e631-c897-43d4-a1a3-8e5bc9176a7d by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:38:04.588677 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] Attempting to bind port be25e631-c897-43d4-a1a3-8e5bc9176a7d on network 684ef871-89aa-450d-ae0d-e232bfaf51fb {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:38:04.591505 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc769d0a-abcb-46b4-a3f3-6406d47bc5db None None] Pushing event updated for resources: {'Port': ['ID=be25e631-c897-43d4-a1a3-8e5bc9176a7d,revision_number=2']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:04.599549 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-cc769d0a-abcb-46b4-a3f3-6406d47bc5db None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:04.600960 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 37, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:38:04.601382 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] Checking segment: {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92325) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:38:04.601796 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:04.602192 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] Bound using segment: {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'} {{(pid=92325) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:38:04.602726 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.managers [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] Bound port: be25e631-c897-43d4-a1a3-8e5bc9176a7d, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '746be0df-b9f5-40e2-acc1-2d2d9b9e7d06', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb'}}] {{(pid=92325) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:38:04.603108 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:04.684016 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] For port be25e631-c897-43d4-a1a3-8e5bc9176a7d, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92325) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:38:04.687214 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] For port be25e631-c897-43d4-a1a3-8e5bc9176a7d, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=be25e631-c897-43d4-a1a3-8e5bc9176a7d,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92325) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:38:04.690846 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:04.695893 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f06829cd-aebb-4714-8d20-666f3d275084 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:04.761142 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Network 2108ca94-1a9c-41e5-9409-225af0444c35 is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:38:04.762189 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:38:04.764789 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:38:04.828412 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Pushing event updated for resources: {'Port': ['ID=fff590ab-c371-42b9-8c37-d90f872164d1,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:04.833381 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:04.839292 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:04.840855 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:04.841234 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:04.841594 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:04.841945 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:04.842291 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:04.842935 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:04.843052 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:04.843386 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:04.843787 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:04.844058 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:04.844393 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:04.844782 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:04.849596 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:04.850912 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-16328800'] for router_interface, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:04.987178 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc769d0a-abcb-46b4-a3f3-6406d47bc5db None None] Pushing event updated for resources: {'Port': ['ID=be25e631-c897-43d4-a1a3-8e5bc9176a7d,revision_number=3']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:04.992440 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:05.025035 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-cc769d0a-abcb-46b4-a3f3-6406d47bc5db None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:05.075263 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] Routers {'d0b46164-c766-44a8-ab69-459f2a5ccff8'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:38:05.082859 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86008f70>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:37:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['d0b46164-c766-44a8-ab69-459f2a5ccff8'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:38:05.308224 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:05.333565 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5878d88e-6a95-4b54-9061-cc7ffd093fbd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:05.337583 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-8a755782-3987-4c99-8cef-0ba34e3af0ce None None] Provisioning for port fff590ab-c371-42b9-8c37-d90f872164d1 completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:38:05.348077 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-8a755782-3987-4c99-8cef-0ba34e3af0ce None None] Provisioning complete for port fff590ab-c371-42b9-8c37-d90f872164d1 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:38:05.348747 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-8a755782-3987-4c99-8cef-0ba34e3af0ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:05.440225 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-8a755782-3987-4c99-8cef-0ba34e3af0ce None None] Port fff590ab-c371-42b9-8c37-d90f872164d1 cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:38:05.449990 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] Set router d0b46164-c766-44a8-ab69-459f2a5ccff8 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:38:05.578280 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac7a8db0-34dd-470b-abf6-c46d0839350b req-a7e825f8-86b4-4270-83c7-55a76ca25ad2 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:05.587232 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ac7a8db0-34dd-470b-abf6-c46d0839350b req-a7e825f8-86b4-4270-83c7-55a76ca25ad2 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.1079881
Jun 03 08:38:05.666278 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ac7a8db0-34dd-470b-abf6-c46d0839350b req-7289d8cc-6328-4bf4-b9d7-7533d185714a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0777607
Jun 03 08:38:05.800877 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:05.823603 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8065b45-29d2-4bc1-8371-ed5a684b3683 req-12804181-556b-41aa-9910-275b4da521a0 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:05.831796 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f8065b45-29d2-4bc1-8371-ed5a684b3683 req-12804181-556b-41aa-9910-275b4da521a0 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 944 time: 0.1627607
Jun 03 08:38:05.882246 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14211294'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:05.920184 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-193fad95-fe7b-45ee-b04f-662eed462090 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:06.021537 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f8065b45-29d2-4bc1-8371-ed5a684b3683 req-b7c64cde-0b65-40a4-9d7c-9261806ed82b tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1885829
Jun 03 08:38:06.033531 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86008f70>, [{'id': 'd0b46164-c766-44a8-ab69-459f2a5ccff8', 'name': 'tempest-TestVolumeBootPattern-547033604-router', 'tenant_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.120'}], 'enable_snat': True}, 'gw_port_id': 'be25e631-c897-43d4-a1a3-8e5bc9176a7d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:57Z', 'updated_at': '2021-06-03T08:38:00Z', 'revision_number': 3, 'project_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'gw_port': {'id': 'be25e631-c897-43d4-a1a3-8e5bc9176a7d', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:a9:80', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd0b46164-c766-44a8-ab69-459f2a5ccff8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 571, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:58Z', 'updated_at': '2021-06-03T08:38:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:38:06.039554 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eeba3c2f-52c2-4c75-b473-3b52d3cf5b1a None None] The sync data for ids ['d0b46164-c766-44a8-ab69-459f2a5ccff8'] in dv-cinder-787262-5-iscsi is: [{'id': 'd0b46164-c766-44a8-ab69-459f2a5ccff8', 'name': 'tempest-TestVolumeBootPattern-547033604-router', 'tenant_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.120'}], 'enable_snat': True}, 'gw_port_id': 'be25e631-c897-43d4-a1a3-8e5bc9176a7d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:57Z', 'updated_at': '2021-06-03T08:38:00Z', 'revision_number': 3, 'project_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'gw_port': {'id': 'be25e631-c897-43d4-a1a3-8e5bc9176a7d', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:a9:80', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd0b46164-c766-44a8-ab69-459f2a5ccff8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 571, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:58Z', 'updated_at': '2021-06-03T08:38:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:38:06.049790 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Pushing event updated for resources: {'Port': ['ID=fff590ab-c371-42b9-8c37-d90f872164d1,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:06.052938 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:06.059771 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-16344774', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-16328707'] for router_interface, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:06.285467 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:06.388888 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Network 2108ca94-1a9c-41e5-9409-225af0444c35 is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:38:06.392818 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:38:06.722748 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e712dda-e607-4416-8658-8986ae306ab2 req-5b25158a-52bb-4513-8e8f-cb74ce3c5cc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:06.724884 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0e712dda-e607-4416-8658-8986ae306ab2 req-5b25158a-52bb-4513-8e8f-cb74ce3c5cc1 service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec&tenant_id=0e5e096a327f421e9b0a02235740cc36 HTTP/1.1" status: 200  len: 1097 time: 0.3339748
Jun 03 08:38:06.727675 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Router d0b46164-c766-44a8-ab69-459f2a5ccff8 has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:38:06.795334 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-f84915f5-b8b8-4947-bc54-7c45bb5fc856 None None] Provisioning complete for port fff590ab-c371-42b9-8c37-d90f872164d1 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:38:06.802121 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-f84915f5-b8b8-4947-bc54-7c45bb5fc856 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:06.875043 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-f84915f5-b8b8-4947-bc54-7c45bb5fc856 None None] Port fff590ab-c371-42b9-8c37-d90f872164d1 cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:38:06.993805 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4046ccce-d655-4bf5-9f41-df8c91bce448 req-67c78f5c-b552-44d5-9838-eafaeaa5d6a8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:06.999251 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-4046ccce-d655-4bf5-9f41-df8c91bce448 req-67c78f5c-b552-44d5-9838-eafaeaa5d6a8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.1496646
Jun 03 08:38:07.004724 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:38:07.029266 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] 10.222.0.11 "PUT /v2.0/routers/d0b46164-c766-44a8-ab69-459f2a5ccff8/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.5030904
Jun 03 08:38:07.089256 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-4046ccce-d655-4bf5-9f41-df8c91bce448 req-afed1214-2f0c-481f-a560-d142ef85d9e2 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0855258
Jun 03 08:38:07.118660 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e712dda-e607-4416-8658-8986ae306ab2 req-3d965560-f741-4dba-b1ba-954fb15102b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:07.120423 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0e712dda-e607-4416-8658-8986ae306ab2 req-3d965560-f741-4dba-b1ba-954fb15102b6 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=0e5e096a327f421e9b0a02235740cc36&device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 1097 time: 0.3678312
Jun 03 08:38:07.373509 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13522f98-f7b0-400e-9995-66aad707a2d2 req-9e18f01e-e38b-43da-bffe-1bef7cc39eab tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:07.375114 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-13522f98-f7b0-400e-9995-66aad707a2d2 req-9e18f01e-e38b-43da-bffe-1bef7cc39eab tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 944 time: 0.1646943
Jun 03 08:38:07.420045 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e712dda-e607-4416-8658-8986ae306ab2 req-160894e0-6cd9-4519-bdbe-fb105b4c24d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:07.421490 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0e712dda-e607-4416-8658-8986ae306ab2 req-160894e0-6cd9-4519-bdbe-fb105b4c24d8 service neutron] 10.222.0.55 "GET /v2.0/networks?id=4a053960-3cf4-4216-b7a5-291ef61e89b7 HTTP/1.1" status: 200  len: 910 time: 0.2912331
Jun 03 08:38:07.521405 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-13522f98-f7b0-400e-9995-66aad707a2d2 req-33ebfa8b-94c6-4abb-8fff-fc298880df8e tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1357443
Jun 03 08:38:07.556937 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0e712dda-e607-4416-8658-8986ae306ab2 req-b69482cb-86e8-48a3-9a70-5b34d3645e0e service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4312e3c9-0931-4dd5-ba11-db0d982c2a11 HTTP/1.1" status: 200  len: 999 time: 0.1227498
Jun 03 08:38:07.628024 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e712dda-e607-4416-8658-8986ae306ab2 req-2a528104-c3c1-4a73-a276-311147eaa83c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:07.629224 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0e712dda-e607-4416-8658-8986ae306ab2 req-2a528104-c3c1-4a73-a276-311147eaa83c service neutron] 10.222.0.55 "GET /v2.0/subnets?id=fc181126-7c66-44d3-b731-a59036bd562f HTTP/1.1" status: 200  len: 848 time: 0.0641911
Jun 03 08:38:07.729644 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e712dda-e607-4416-8658-8986ae306ab2 req-8be43253-2093-4252-ad49-4f2303a408fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:07.731645 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0e712dda-e607-4416-8658-8986ae306ab2 req-8be43253-2093-4252-ad49-4f2303a408fc service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=4a053960-3cf4-4216-b7a5-291ef61e89b7&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0938590
Jun 03 08:38:07.909773 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 55092) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:07.918842 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-ecf7001a-9c10-446a-973d-e3ea69f73210 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1108931873', 'description': 'tempest-secgroup-smoke-1108931873 description', 'project_id': 'db653c0bf0ab42639863b4ea2268a265'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:38:07.942250 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-ecf7001a-9c10-446a-973d-e3ea69f73210 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:38:07.951475 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-ecf7001a-9c10-446a-973d-e3ea69f73210 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Usage tracker for resource:security_group and tenant:db653c0bf0ab42639863b4ea2268a265 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:38:07.964385 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-ecf7001a-9c10-446a-973d-e3ea69f73210 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:38:07.972395 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-ecf7001a-9c10-446a-973d-e3ea69f73210 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:38:07.976767 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0e712dda-e607-4416-8658-8986ae306ab2 req-511047ef-d6af-48b7-803a-8c88f43bb0ec service neutron] 10.222.0.55 "GET /v2.0/networks/4a053960-3cf4-4216-b7a5-291ef61e89b7?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2372141
Jun 03 08:38:08.089717 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:08.136108 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-ecf7001a-9c10-446a-973d-e3ea69f73210 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:08.179341 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-ecf7001a-9c10-446a-973d-e3ea69f73210 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:38:08.194650 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-ecf7001a-9c10-446a-973d-e3ea69f73210 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Usage tracker for resource:security_group_rule and tenant:db653c0bf0ab42639863b4ea2268a265 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:38:08.200660 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-ecf7001a-9c10-446a-973d-e3ea69f73210 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:38:08.210505 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-ecf7001a-9c10-446a-973d-e3ea69f73210 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:38:08.214146 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0e712dda-e607-4416-8658-8986ae306ab2 req-824a4cf9-18b2-4d5d-9f72-66b5392b2e62 service neutron] 10.222.0.55 "GET /v2.0/networks/4a053960-3cf4-4216-b7a5-291ef61e89b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2244773
Jun 03 08:38:08.456095 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device be25e631-c897-43d4-a1a3-8e5bc9176a7d up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:38:08.485096 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] Sync routers for ids ['d0b46164-c766-44a8-ab69-459f2a5ccff8'] in dv-cinder-787262-5-iscsi {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:38:08.500109 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] Routers {'d0b46164-c766-44a8-ab69-459f2a5ccff8'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:38:08.501131 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae87019610>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:38:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['d0b46164-c766-44a8-ab69-459f2a5ccff8'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:38:08.663627 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-ecf7001a-9c10-446a-973d-e3ea69f73210 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:08.690534 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ec1d9e9-b65e-4a91-91ea-0178a49c4d38 req-0284485a-e061-4025-a336-8e7134885ea0 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:08.698471 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3ec1d9e9-b65e-4a91-91ea-0178a49c4d38 req-0284485a-e061-4025-a336-8e7134885ea0 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.4123018
Jun 03 08:38:08.741620 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port be25e631-c897-43d4-a1a3-8e5bc9176a7d completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:38:08.746909 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port be25e631-c897-43d4-a1a3-8e5bc9176a7d triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:38:08.747351 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:08.777431 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3ec1d9e9-b65e-4a91-91ea-0178a49c4d38 req-982c80fd-410f-453a-b0a3-45cfe81c26f8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0767612
Jun 03 08:38:08.782805 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-ecf7001a-9c10-446a-973d-e3ea69f73210 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:08.795040 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] Set router d0b46164-c766-44a8-ab69-459f2a5ccff8 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:38:08.795513 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a4f5fea0-ac0a-4871-a839-de169f646197 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:08.898238 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecf7001a-9c10-446a-973d-e3ea69f73210 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fe784a5d-57d4-414f-8feb-b263c44efaf6,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:08.909258 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-ecf7001a-9c10-446a-973d-e3ea69f73210 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:08.963370 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:09.005962 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port be25e631-c897-43d4-a1a3-8e5bc9176a7d, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=be25e631-c897-43d4-a1a3-8e5bc9176a7d,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:38:09.116326 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-ecf7001a-9c10-446a-973d-e3ea69f73210 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:09.120567 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 55106) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:09.125468 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Request body: {'security_group_rule': {'security_group_id': 'fe784a5d-57d4-414f-8feb-b263c44efaf6', 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:38:09.130033 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:09.133061 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:09.134754 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:38:09.140178 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-ecf7001a-9c10-446a-973d-e3ea69f73210 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 1.2081864
Jun 03 08:38:09.146157 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Usage tracker for resource:security_group_rule and tenant:db653c0bf0ab42639863b4ea2268a265 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:38:09.159826 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:38:09.188597 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:38:09.234630 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa675d0c-44b6-4532-a858-cd4bf5f80c18 req-5862f863-3516-406b-9681-1a3fbda4938a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:09.236387 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-aa675d0c-44b6-4532-a858-cd4bf5f80c18 req-5862f863-3516-406b-9681-1a3fbda4938a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 944 time: 0.2280676
Jun 03 08:38:09.260927 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae87019610>, [{'id': 'd0b46164-c766-44a8-ab69-459f2a5ccff8', 'name': 'tempest-TestVolumeBootPattern-547033604-router', 'tenant_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.120'}], 'enable_snat': True}, 'gw_port_id': 'be25e631-c897-43d4-a1a3-8e5bc9176a7d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:57Z', 'updated_at': '2021-06-03T08:38:05Z', 'revision_number': 4, 'project_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'gw_port': {'id': 'be25e631-c897-43d4-a1a3-8e5bc9176a7d', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:a9:80', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd0b46164-c766-44a8-ab69-459f2a5ccff8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 571, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:58Z', 'updated_at': '2021-06-03T08:38:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': 'fff590ab-c371-42b9-8c37-d90f872164d1', 'name': '', 'network_id': '2108ca94-1a9c-41e5-9409-225af0444c35', 'tenant_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'mac_address': 'fa:16:3e:31:42:5d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd0b46164-c766-44a8-ab69-459f2a5ccff8', 'device_owner': 'network:router_interface', 'standard_attr_id': 572, 'fixed_ips': [{'subnet_id': '6b0564e9-f803-4af7-9957-04aa3130c69c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:38:03Z', 'updated_at': '2021-06-03T08:38:05Z', 'revision_number': 2, 'project_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'subnets': [{'id': '6b0564e9-f803-4af7-9957-04aa3130c69c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:38:09.265416 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] Checking router: d0b46164-c766-44a8-ab69-459f2a5ccff8 for host: dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:38:09.265859 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] Updating router d0b46164-c766-44a8-ab69-459f2a5ccff8 port fff590ab-c371-42b9-8c37-d90f872164d1 binding host dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 03 08:38:09.278086 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=be25e631-c897-43d4-a1a3-8e5bc9176a7d,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:09.287983 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:09.311475 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-aa675d0c-44b6-4532-a858-cd4bf5f80c18 req-48d34abc-8f64-477f-aeef-cadf5245a0de tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0640538
Jun 03 08:38:09.318439 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:09.329009 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:09.390769 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:09.519242 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:09.526461 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-d9b22a8f-c595-4645-b425-37710d168de5 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:09.552205 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0a778458-697d-40b2-acc7-42572d7eb624,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:09.565262 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:09.565740 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:09.566120 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:09.566511 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:09.567216 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:09.567765 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:09.568395 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:09.568940 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:09.569313 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:09.569678 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:09.570041 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:09.570600 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:09.580794 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:09.638912 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:09.640601 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.5190020
Jun 03 08:38:09.644156 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 55108) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:09.649333 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-cd15cad5-6e61-4907-b6e8-c001eec363aa tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Request body: {'security_group_rule': {'security_group_id': 'fe784a5d-57d4-414f-8feb-b263c44efaf6', 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:38:09.655965 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-cd15cad5-6e61-4907-b6e8-c001eec363aa tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:38:09.660404 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-cd15cad5-6e61-4907-b6e8-c001eec363aa tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Usage tracker for resource:security_group_rule and tenant:db653c0bf0ab42639863b4ea2268a265 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:38:09.664908 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-cd15cad5-6e61-4907-b6e8-c001eec363aa tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:38:09.672289 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-cd15cad5-6e61-4907-b6e8-c001eec363aa tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:38:09.697891 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] Notify callbacks [] for port, precommit_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:09.710208 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.provisioning_blocks [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] Transition to ACTIVE for port object fff590ab-c371-42b9-8c37-d90f872164d1 will not be triggered until provisioned by entity L2. {{(pid=92326) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:38:10.010564 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-014b8aea-ff29-4d63-a147-2d6d0aaabe3e req-119fa78d-a832-40bb-8198-0c85bd804b90 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:10.012287 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-014b8aea-ff29-4d63-a147-2d6d0aaabe3e req-119fa78d-a832-40bb-8198-0c85bd804b90 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.0965354
Jun 03 08:38:10.042920 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cd15cad5-6e61-4907-b6e8-c001eec363aa tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:10.060950 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:10.066915 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:10.084972 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-014b8aea-ff29-4d63-a147-2d6d0aaabe3e req-6cbd665c-affd-4ad3-b27b-57d2d769b30f tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0665264
Jun 03 08:38:10.140619 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cd15cad5-6e61-4907-b6e8-c001eec363aa tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:10.250850 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9573f75a-5b2b-42fe-a9c2-c086884a6a07 None None] Pushing event updated for resources: {'Port': ['ID=fff590ab-c371-42b9-8c37-d90f872164d1,revision_number=3']} {{(pid=92326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:10.283419 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-9573f75a-5b2b-42fe-a9c2-c086884a6a07 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.216s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:10.311897 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] Attempting to bind port fff590ab-c371-42b9-8c37-d90f872164d1 on host dv-cinder-787262-5-iscsi for vnic_type normal with profile  {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:38:10.312355 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] Attempting to bind port fff590ab-c371-42b9-8c37-d90f872164d1 by drivers openvswitch,hyperv on host dv-cinder-787262-5-iscsi at level 0 using segments [{'id': '70d8683e-3f23-44dc-9902-dc5fa4f11976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 528, 'network_id': '2108ca94-1a9c-41e5-9409-225af0444c35'}] {{(pid=92326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:38:10.312746 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] Attempting to bind port fff590ab-c371-42b9-8c37-d90f872164d1 on network 2108ca94-1a9c-41e5-9409-225af0444c35 {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:38:10.321927 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] Checking agent: {'id': 'fa2ce4ef-04ce-4509-8cd5-946b85fbe868', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 22, 35), 'started_at': datetime.datetime(2021, 6, 3, 8, 23, 5), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 38, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:38:10.322310 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] Checking segment: {'id': '70d8683e-3f23-44dc-9902-dc5fa4f11976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 528, 'network_id': '2108ca94-1a9c-41e5-9409-225af0444c35'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92326) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:38:10.322765 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:10.323163 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] Bound using segment: {'id': '70d8683e-3f23-44dc-9902-dc5fa4f11976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 528, 'network_id': '2108ca94-1a9c-41e5-9409-225af0444c35'} {{(pid=92326) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:38:10.323644 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.managers [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] Bound port: fff590ab-c371-42b9-8c37-d90f872164d1, host: dv-cinder-787262-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '70d8683e-3f23-44dc-9902-dc5fa4f11976', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 528, 'network_id': '2108ca94-1a9c-41e5-9409-225af0444c35'}}] {{(pid=92326) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:38:10.324022 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:10.364042 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cd15cad5-6e61-4907-b6e8-c001eec363aa tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:10.366386 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-62c9e840-e2b8-48d3-a7cf-503dc82c764c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:10.397345 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device be25e631-c897-43d4-a1a3-8e5bc9176a7d up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:38:10.428305 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd15cad5-6e61-4907-b6e8-c001eec363aa tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=73518cc6-4d9c-4c5b-b796-932810e1f35a,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:10.448542 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-cd15cad5-6e61-4907-b6e8-c001eec363aa tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:10.531277 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.db [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] For port fff590ab-c371-42b9-8c37-d90f872164d1, host dv-cinder-787262-5-iscsi, cleared binding levels {{(pid=92326) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:38:10.542079 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.plugins.ml2.db [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] For port fff590ab-c371-42b9-8c37-d90f872164d1, host dv-cinder-787262-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=fff590ab-c371-42b9-8c37-d90f872164d1,segment=NetworkSegment(70d8683e-3f23-44dc-9902-dc5fa4f11976),segment_id=70d8683e-3f23-44dc-9902-dc5fa4f11976)] {{(pid=92326) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:38:10.546881 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port be25e631-c897-43d4-a1a3-8e5bc9176a7d triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:38:10.547531 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:10.569964 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-cd15cad5-6e61-4907-b6e8-c001eec363aa tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:10.571210 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-cd15cad5-6e61-4907-b6e8-c001eec363aa tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.9258537
Jun 03 08:38:10.573800 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 55120) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:10.578663 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-903b1fb3-013f-45dc-87bd-d6629d98aeeb tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Request body: {'security_group_rule': {'security_group_id': 'fe784a5d-57d4-414f-8feb-b263c44efaf6', 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:38:10.590830 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-903b1fb3-013f-45dc-87bd-d6629d98aeeb tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:38:10.602068 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-903b1fb3-013f-45dc-87bd-d6629d98aeeb tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Usage tracker for resource:security_group_rule and tenant:db653c0bf0ab42639863b4ea2268a265 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:38:10.607096 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-903b1fb3-013f-45dc-87bd-d6629d98aeeb tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:38:10.610053 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c4d7293-68e7-4a2d-8421-9bcc596e3b11 req-2894c787-303c-4ec1-8a24-7350d1e40268 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:10.612437 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2c4d7293-68e7-4a2d-8421-9bcc596e3b11 req-2894c787-303c-4ec1-8a24-7350d1e40268 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 944 time: 0.0992575
Jun 03 08:38:10.625540 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-903b1fb3-013f-45dc-87bd-d6629d98aeeb tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:38:10.661783 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron_lib.callbacks.manager [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92326) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:10.678308 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-f4606a4e-37e4-4641-88dd-ceff1af5ca43 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:10.687182 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2c4d7293-68e7-4a2d-8421-9bcc596e3b11 req-6b7496d4-e57f-4204-aba9-a90b733e6d2a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0659409
Jun 03 08:38:10.793244 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-903b1fb3-013f-45dc-87bd-d6629d98aeeb tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:10.823874 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9573f75a-5b2b-42fe-a9c2-c086884a6a07 None None] Pushing event updated for resources: {'Port': ['ID=fff590ab-c371-42b9-8c37-d90f872164d1,revision_number=4']} {{(pid=92326) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:10.839398 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG oslo_concurrency.lockutils [None req-9573f75a-5b2b-42fe-a9c2-c086884a6a07 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=92326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:10.841393 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] Routers {'d0b46164-c766-44a8-ab69-459f2a5ccff8'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:38:10.842422 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae87019610>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:38:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['d0b46164-c766-44a8-ab69-459f2a5ccff8'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:38:10.922710 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-903b1fb3-013f-45dc-87bd-d6629d98aeeb tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:11.061206 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-903b1fb3-013f-45dc-87bd-d6629d98aeeb tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:11.063523 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:11.087925 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] Set router d0b46164-c766-44a8-ab69-459f2a5ccff8 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:38:11.111715 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-903b1fb3-013f-45dc-87bd-d6629d98aeeb tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=07668d3a-4a47-4c2d-85ce-8285354ca3d6,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:11.114480 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-903b1fb3-013f-45dc-87bd-d6629d98aeeb tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:11.181060 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-903b1fb3-013f-45dc-87bd-d6629d98aeeb tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:11.183488 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-903b1fb3-013f-45dc-87bd-d6629d98aeeb tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.6085587
Jun 03 08:38:11.189708 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 55124) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:11.196596 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-d3fcf05b-506c-4c95-a5c9-ddeea39bb59e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Request body: {'security_group_rule': {'security_group_id': 'fe784a5d-57d4-414f-8feb-b263c44efaf6', 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:38:11.204320 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-d3fcf05b-506c-4c95-a5c9-ddeea39bb59e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:38:11.209943 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-d3fcf05b-506c-4c95-a5c9-ddeea39bb59e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Usage tracker for resource:security_group_rule and tenant:db653c0bf0ab42639863b4ea2268a265 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:38:11.213814 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-d3fcf05b-506c-4c95-a5c9-ddeea39bb59e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:38:11.221105 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-d3fcf05b-506c-4c95-a5c9-ddeea39bb59e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:38:11.383521 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae1e7610-7895-45ad-b023-7a1dc60962a5 req-63b0e9ee-0b55-4fda-bb3a-57d5c19f9554 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:11.386063 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ae1e7610-7895-45ad-b023-7a1dc60962a5 req-63b0e9ee-0b55-4fda-bb3a-57d5c19f9554 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.1407549
Jun 03 08:38:11.450324 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ae1e7610-7895-45ad-b023-7a1dc60962a5 req-8d0d4f8c-6b1c-40fe-8d6d-6764e6a35548 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0567808
Jun 03 08:38:11.451092 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d3fcf05b-506c-4c95-a5c9-ddeea39bb59e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:11.571722 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae87019610>, [{'id': 'd0b46164-c766-44a8-ab69-459f2a5ccff8', 'name': 'tempest-TestVolumeBootPattern-547033604-router', 'tenant_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.120'}], 'enable_snat': True}, 'gw_port_id': 'be25e631-c897-43d4-a1a3-8e5bc9176a7d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:57Z', 'updated_at': '2021-06-03T08:38:05Z', 'revision_number': 4, 'project_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'gw_port': {'id': 'be25e631-c897-43d4-a1a3-8e5bc9176a7d', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:a9:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0b46164-c766-44a8-ab69-459f2a5ccff8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 571, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:58Z', 'updated_at': '2021-06-03T08:38:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': 'fff590ab-c371-42b9-8c37-d90f872164d1', 'name': '', 'network_id': '2108ca94-1a9c-41e5-9409-225af0444c35', 'tenant_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'mac_address': 'fa:16:3e:31:42:5d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd0b46164-c766-44a8-ab69-459f2a5ccff8', 'device_owner': 'network:router_interface', 'standard_attr_id': 572, 'fixed_ips': [{'subnet_id': '6b0564e9-f803-4af7-9957-04aa3130c69c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:38:03Z', 'updated_at': '2021-06-03T08:38:10Z', 'revision_number': 4, 'project_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'subnets': [{'id': '6b0564e9-f803-4af7-9957-04aa3130c69c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:38:11.582993 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e2594ed-e04f-4790-914b-1d81a539017f None None] The sync data for ids ['d0b46164-c766-44a8-ab69-459f2a5ccff8'] in dv-cinder-787262-5-iscsi is: [{'id': 'd0b46164-c766-44a8-ab69-459f2a5ccff8', 'name': 'tempest-TestVolumeBootPattern-547033604-router', 'tenant_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.120'}], 'enable_snat': True}, 'gw_port_id': 'be25e631-c897-43d4-a1a3-8e5bc9176a7d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:57Z', 'updated_at': '2021-06-03T08:38:05Z', 'revision_number': 4, 'project_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'gw_port': {'id': 'be25e631-c897-43d4-a1a3-8e5bc9176a7d', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:a9:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0b46164-c766-44a8-ab69-459f2a5ccff8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 571, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:58Z', 'updated_at': '2021-06-03T08:38:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': 'fff590ab-c371-42b9-8c37-d90f872164d1', 'name': '', 'network_id': '2108ca94-1a9c-41e5-9409-225af0444c35', 'tenant_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'mac_address': 'fa:16:3e:31:42:5d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd0b46164-c766-44a8-ab69-459f2a5ccff8', 'device_owner': 'network:router_interface', 'standard_attr_id': 572, 'fixed_ips': [{'subnet_id': '6b0564e9-f803-4af7-9957-04aa3130c69c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:38:03Z', 'updated_at': '2021-06-03T08:38:10Z', 'revision_number': 4, 'project_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'subnets': [{'id': '6b0564e9-f803-4af7-9957-04aa3130c69c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:38:11.586721 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d3fcf05b-506c-4c95-a5c9-ddeea39bb59e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:11.684434 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d3fcf05b-506c-4c95-a5c9-ddeea39bb59e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:11.693708 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:11.723566 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3fcf05b-506c-4c95-a5c9-ddeea39bb59e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=049db05c-1ec7-47ed-99a3-4bb3a2f97f41,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:11.733129 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-d3fcf05b-506c-4c95-a5c9-ddeea39bb59e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:11.832736 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d3fcf05b-506c-4c95-a5c9-ddeea39bb59e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:11.836556 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-d3fcf05b-506c-4c95-a5c9-ddeea39bb59e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.6431489
Jun 03 08:38:11.836904 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 55138) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:11.842104 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-9641daef-733f-48cf-a8f3-0e1cc8d250c1 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Request body: {'security_group_rule': {'security_group_id': 'fe784a5d-57d4-414f-8feb-b263c44efaf6', 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:38:11.866900 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-9641daef-733f-48cf-a8f3-0e1cc8d250c1 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:38:11.876876 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-9641daef-733f-48cf-a8f3-0e1cc8d250c1 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Usage tracker for resource:security_group_rule and tenant:db653c0bf0ab42639863b4ea2268a265 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:38:11.884186 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-9641daef-733f-48cf-a8f3-0e1cc8d250c1 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:38:11.894324 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-9641daef-733f-48cf-a8f3-0e1cc8d250c1 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:38:11.957368 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91ce69e3-1499-4a1f-887e-0674d55fe860 req-68ae34cf-8d41-47d3-8de1-541682d45b5a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:11.963231 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-91ce69e3-1499-4a1f-887e-0674d55fe860 req-68ae34cf-8d41-47d3-8de1-541682d45b5a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 944 time: 0.1255383
Jun 03 08:38:11.970955 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.securitygroups_db [None req-9641daef-733f-48cf-a8f3-0e1cc8d250c1 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Project db653c0bf0ab42639863b4ea2268a265 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 03 08:38:11.978814 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9641daef-733f-48cf-a8f3-0e1cc8d250c1 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:12.027602 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-91ce69e3-1499-4a1f-887e-0674d55fe860 req-68336195-00c0-44b5-bfe7-536f1f123fac tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0599976
Jun 03 08:38:12.081856 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9641daef-733f-48cf-a8f3-0e1cc8d250c1 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:12.221068 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9641daef-733f-48cf-a8f3-0e1cc8d250c1 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:12.224300 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-8ee641ab-55c0-4cb6-9d59-77e37c6377d2 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:12.262040 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9641daef-733f-48cf-a8f3-0e1cc8d250c1 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0c9d14c1-0c8d-4db6-af9d-6d96e6788e50,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:12.270164 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9641daef-733f-48cf-a8f3-0e1cc8d250c1 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:12.331796 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:38:12.398096 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9641daef-733f-48cf-a8f3-0e1cc8d250c1 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:12.399387 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-9641daef-733f-48cf-a8f3-0e1cc8d250c1 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.5613401
Jun 03 08:38:12.402567 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 55142) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:12.407622 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-c921ccdb-7987-4e65-8a29-0b9e42bd03dd tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Request body: {'security_group_rule': {'security_group_id': 'fe784a5d-57d4-414f-8feb-b263c44efaf6', 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:38:12.420737 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-c921ccdb-7987-4e65-8a29-0b9e42bd03dd tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:38:12.427005 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-c921ccdb-7987-4e65-8a29-0b9e42bd03dd tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Usage tracker for resource:security_group_rule and tenant:db653c0bf0ab42639863b4ea2268a265 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:38:12.430709 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device fff590ab-c371-42b9-8c37-d90f872164d1 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:38:12.432401 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-c921ccdb-7987-4e65-8a29-0b9e42bd03dd tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:38:12.446968 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-c921ccdb-7987-4e65-8a29-0b9e42bd03dd tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:38:12.612051 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.securitygroups_db [None req-c921ccdb-7987-4e65-8a29-0b9e42bd03dd tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Project db653c0bf0ab42639863b4ea2268a265 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 03 08:38:12.620996 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-c921ccdb-7987-4e65-8a29-0b9e42bd03dd tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:12.667015 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning for port fff590ab-c371-42b9-8c37-d90f872164d1 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:38:12.672407 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port fff590ab-c371-42b9-8c37-d90f872164d1 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:38:12.672836 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:12.747093 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-c921ccdb-7987-4e65-8a29-0b9e42bd03dd tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:12.849402 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68ccac1e-98fd-4755-b563-dc94c98afe8a req-a04050df-0fd2-40dd-be81-f8a6bcc53266 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:12.850973 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-68ccac1e-98fd-4755-b563-dc94c98afe8a req-a04050df-0fd2-40dd-be81-f8a6bcc53266 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.2018580
Jun 03 08:38:12.865823 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-c921ccdb-7987-4e65-8a29-0b9e42bd03dd tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375373'] for security_group_rule, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:12.879049 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-92fb22a0-2a4e-4c7c-990c-99311954165b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:12.883844 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:12.931561 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-158451c6-6729-4259-9765-082b44ee0938 None None] For port fff590ab-c371-42b9-8c37-d90f872164d1, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=fff590ab-c371-42b9-8c37-d90f872164d1,segment=NetworkSegment(70d8683e-3f23-44dc-9902-dc5fa4f11976),segment_id=70d8683e-3f23-44dc-9902-dc5fa4f11976)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:38:12.934305 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-68ccac1e-98fd-4755-b563-dc94c98afe8a req-8a13dcb6-3f1d-4e90-9dd8-a383b574f404 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0720365
Jun 03 08:38:12.935947 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c921ccdb-7987-4e65-8a29-0b9e42bd03dd tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=097bf319-69a8-4079-9c5e-3b8fb55aa1c3,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:12.948597 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-c921ccdb-7987-4e65-8a29-0b9e42bd03dd tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:12.988244 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfa69e39-4a79-468f-8e13-97e18d7b3085 req-ec74b4b3-f1d3-49bb-a321-8a5c0c1b2840 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:12.989948 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-bfa69e39-4a79-468f-8e13-97e18d7b3085 req-ec74b4b3-f1d3-49bb-a321-8a5c0c1b2840 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 946 time: 0.1771903
Jun 03 08:38:13.012840 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-c921ccdb-7987-4e65-8a29-0b9e42bd03dd tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:13.014019 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-c921ccdb-7987-4e65-8a29-0b9e42bd03dd tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.6103022
Jun 03 08:38:13.047242 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-bfa69e39-4a79-468f-8e13-97e18d7b3085 req-e58512ed-874a-4f84-bff5-2e750c176a65 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=f7460adc-d3b2-4e2f-9865-c9faf88a2da7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0514567
Jun 03 08:38:13.054169 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:13.055633 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:13.200604 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Pushing event updated for resources: {'Port': ['ID=fff590ab-c371-42b9-8c37-d90f872164d1,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:13.204172 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:13.324865 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b367fa24-c88e-4450-aef3-cb854d3b5064 req-a5dfa178-be24-4cec-a026-60e61131d173 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:13.326476 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b367fa24-c88e-4450-aef3-cb854d3b5064 req-a5dfa178-be24-4cec-a026-60e61131d173 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 944 time: 0.1311660
Jun 03 08:38:13.380748 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b367fa24-c88e-4450-aef3-cb854d3b5064 req-5d03657d-bf0b-43e9-be82-6ba1acdf2c97 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0470839
Jun 03 08:38:14.162205 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b859942f-69c3-4718-98d6-b09152b9c5e1 req-7d69c53e-e4ae-4442-be09-ef8784f9b7b5 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:14.163778 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b859942f-69c3-4718-98d6-b09152b9c5e1 req-7d69c53e-e4ae-4442-be09-ef8784f9b7b5 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.0941863
Jun 03 08:38:14.214219 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-b859942f-69c3-4718-98d6-b09152b9c5e1 req-90756507-e77a-4b5e-9ef7-36d96e9f2af3 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0446088
Jun 03 08:38:14.269561 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53579436-7725-4da1-958c-285073aa0700 req-539a92b2-b09e-4c18-b102-e03c267ea96e tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:14.271168 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-53579436-7725-4da1-958c-285073aa0700 req-539a92b2-b09e-4c18-b102-e03c267ea96e tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 946 time: 0.0952728
Jun 03 08:38:14.318230 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-53579436-7725-4da1-958c-285073aa0700 req-9490e0af-cc94-4e5e-b50c-78767fb15f10 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups?id=f7460adc-d3b2-4e2f-9865-c9faf88a2da7&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0413671
Jun 03 08:38:14.353773 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device fff590ab-c371-42b9-8c37-d90f872164d1 up at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:38:14.427428 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Provisioning complete for port fff590ab-c371-42b9-8c37-d90f872164d1 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:38:14.427818 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:14.505028 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3989b74-f19c-4232-9ad0-6df109ca9911 req-9ea2a2fe-788d-43f0-a38d-b2a7fb44f9a3 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:14.507029 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c3989b74-f19c-4232-9ad0-6df109ca9911 req-9ea2a2fe-788d-43f0-a38d-b2a7fb44f9a3 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.55 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 946 time: 0.1052499
Jun 03 08:38:14.628580 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c21d5c9e-4f21-450a-b785-7791ff32bc30 req-801da0a0-2d83-4fc2-a54a-66079fd94306 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:14.630099 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c21d5c9e-4f21-450a-b785-7791ff32bc30 req-801da0a0-2d83-4fc2-a54a-66079fd94306 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 944 time: 0.1269796
Jun 03 08:38:14.691088 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c21d5c9e-4f21-450a-b785-7791ff32bc30 req-da9d8dd1-a221-4cb4-b52a-56ab0aec3dde tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0537717
Jun 03 08:38:14.718910 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-c3989b74-f19c-4232-9ad0-6df109ca9911 req-c96a7e06-3b97-40f6-b969-3f45b2ab5588 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Deleting port 9b84dcd4-a96a-49e0-9102-07b3ed50b805 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:38:14.719255 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-c3989b74-f19c-4232-9ad0-6df109ca9911 req-c96a7e06-3b97-40f6-b969-3f45b2ab5588 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:14.873042 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-c3989b74-f19c-4232-9ad0-6df109ca9911 req-c96a7e06-3b97-40f6-b969-3f45b2ab5588 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] For port 9b84dcd4-a96a-49e0-9102-07b3ed50b805, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=9b84dcd4-a96a-49e0-9102-07b3ed50b805,segment=NetworkSegment(56366949-8cc8-4cf3-b3eb-d458d3515059),segment_id=56366949-8cc8-4cf3-b3eb-d458d3515059)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:38:14.873489 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-c3989b74-f19c-4232-9ad0-6df109ca9911 req-c96a7e06-3b97-40f6-b969-3f45b2ab5588 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:15.193130 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-c3989b74-f19c-4232-9ad0-6df109ca9911 req-c96a7e06-3b97-40f6-b969-3f45b2ab5588 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:15.193496 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-c3989b74-f19c-4232-9ad0-6df109ca9911 req-c96a7e06-3b97-40f6-b969-3f45b2ab5588 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16327919'] for floatingip, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:15.193845 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.db.l3_db [req-c3989b74-f19c-4232-9ad0-6df109ca9911 req-c96a7e06-3b97-40f6-b969-3f45b2ab5588 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Floating IP 0cf1b680-7278-499d-96d6-d63af807b96f disassociated. External IP: 172.27.0.151, port: 9b84dcd4-a96a-49e0-9102-07b3ed50b805.
Jun 03 08:38:15.194191 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-c3989b74-f19c-4232-9ad0-6df109ca9911 req-c96a7e06-3b97-40f6-b969-3f45b2ab5588 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Calling delete_port for 9b84dcd4-a96a-49e0-9102-07b3ed50b805 owned by compute:nova {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:38:15.442066 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62b57c16-0299-41bc-9562-dcf55cda2092 req-ef6c6621-c302-46c3-8966-38f7da4c3a64 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:15.443631 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-62b57c16-0299-41bc-9562-dcf55cda2092 req-ef6c6621-c302-46c3-8966-38f7da4c3a64 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.0936227
Jun 03 08:38:15.471195 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-c3989b74-f19c-4232-9ad0-6df109ca9911 req-c96a7e06-3b97-40f6-b969-3f45b2ab5588 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:15.479833 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-156e4f36-13ba-459d-bf1c-0c0d79816bcb tempest-VolumesSnapshotTestJSON-219109043 tempest-VolumesSnapshotTestJSON-219109043-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:15.482077 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-375a01e6-cb47-46b5-82a1-139aca6578e8 req-22a0308f-b7ce-4109-bf1b-41f4b88bc7e2 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 210 time: 0.0542731
Jun 03 08:38:15.528953 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c96a7e06-3b97-40f6-b969-3f45b2ab5588 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Pushing event deleted for resources: {'Port': ['ID=9b84dcd4-a96a-49e0-9102-07b3ed50b805,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:15.538246 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c96a7e06-3b97-40f6-b969-3f45b2ab5588 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:15.712259 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-62b57c16-0299-41bc-9562-dcf55cda2092 req-03e34ca7-18fb-4109-a7d7-aeda868d8223 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2625065
Jun 03 08:38:15.856742 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [req-c3989b74-f19c-4232-9ad0-6df109ca9911 req-c96a7e06-3b97-40f6-b969-3f45b2ab5588 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Router a4b01ad1-d952-4deb-88df-6930ad4824db has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:38:15.916978 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d8ab962-86ad-469d-8618-6e4fd9e0cf26 req-fe77cc3c-289f-4a94-8d17-6b90716aaa2f tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:15.919307 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2d8ab962-86ad-469d-8618-6e4fd9e0cf26 req-fe77cc3c-289f-4a94-8d17-6b90716aaa2f tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 944 time: 0.0924301
Jun 03 08:38:15.974991 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2d8ab962-86ad-469d-8618-6e4fd9e0cf26 req-2fefbd4e-a3b5-443a-a093-bba1bdd5ad4e tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0489471
Jun 03 08:38:16.061123 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-c3989b74-f19c-4232-9ad0-6df109ca9911 req-c96a7e06-3b97-40f6-b969-3f45b2ab5588 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:38:16.070616 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71cee251-bd04-4683-8c7d-48f1219a9027 None None] Sync routers for ids ['a4b01ad1-d952-4deb-88df-6930ad4824db'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:38:16.080920 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71cee251-bd04-4683-8c7d-48f1219a9027 None None] Routers {'a4b01ad1-d952-4deb-88df-6930ad4824db'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:38:16.081567 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-71cee251-bd04-4683-8c7d-48f1219a9027 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86bd3490>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:38:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['a4b01ad1-d952-4deb-88df-6930ad4824db'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:38:16.134463 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-c3989b74-f19c-4232-9ad0-6df109ca9911 req-c96a7e06-3b97-40f6-b969-3f45b2ab5588 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] No DVR routers for this DVR port 9b84dcd4-a96a-49e0-9102-07b3ed50b805 on host hv-cinder-78726 {{(pid=92323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:38:16.137034 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-c3989b74-f19c-4232-9ad0-6df109ca9911 req-c96a7e06-3b97-40f6-b969-3f45b2ab5588 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:16.140952 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '02b21c4a-5207-45ed-b0dd-42675e4322a8', 'name': 'network-vif-deleted', 'tag': '9b84dcd4-a96a-49e0-9102-07b3ed50b805'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:38:16.144112 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a8131964-42d6-495b-a5e0-774b4f1374e2" -d '{"events": [{"server_uuid": "02b21c4a-5207-45ed-b0dd-42675e4322a8", "name": "network-vif-deleted", "tag": "9b84dcd4-a96a-49e0-9102-07b3ed50b805"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:38:16.190858 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:38:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8a7a9ce1-5e8f-4780-96fa-3b4bc7ff3cdc x-openstack-request-id: req-8a7a9ce1-5e8f-4780-96fa-3b4bc7ff3cdc {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:38:16.191197 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "02b21c4a-5207-45ed-b0dd-42675e4322a8", "name": "network-vif-deleted", "tag": "9b84dcd4-a96a-49e0-9102-07b3ed50b805", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:38:16.191479 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-8a7a9ce1-5e8f-4780-96fa-3b4bc7ff3cdc {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:38:16.191920 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '02b21c4a-5207-45ed-b0dd-42675e4322a8', 'name': 'network-vif-deleted', 'tag': '9b84dcd4-a96a-49e0-9102-07b3ed50b805', 'status': 'completed', 'code': 200}
Jun 03 08:38:16.234922 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c3989b74-f19c-4232-9ad0-6df109ca9911 req-c96a7e06-3b97-40f6-b969-3f45b2ab5588 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.55 "DELETE /v2.0/ports/9b84dcd4-a96a-49e0-9102-07b3ed50b805 HTTP/1.1" status: 204  len: 173 time: 1.7214870
Jun 03 08:38:16.256561 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 4312e3c9-0931-4dd5-ba11-db0d982c2a11 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:38:16.271334 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-71cee251-bd04-4683-8c7d-48f1219a9027 None None] Set router a4b01ad1-d952-4deb-88df-6930ad4824db gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:38:16.656217 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 4312e3c9-0931-4dd5-ba11-db0d982c2a11, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=4312e3c9-0931-4dd5-ba11-db0d982c2a11,segment=NetworkSegment(aaa5b128-9aff-431e-b567-4ca42a016de6),segment_id=aaa5b128-9aff-431e-b567-4ca42a016de6)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:38:16.659325 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-fde300cb-1b07-410a-868a-6fda462d2338 req-01a65397-3190-48b8-b85a-99b4316b04b1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/ports?device_id=02b21c4a-5207-45ed-b0dd-42675e4322a8 HTTP/1.1" status: 200  len: 210 time: 0.0590987
Jun 03 08:38:16.690378 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': '4312e3c9-0931-4dd5-ba11-db0d982c2a11', 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7', 'port_id': '4312e3c9-0931-4dd5-ba11-db0d982c2a11', 'mac_address': 'fa:16:3e:72:a1:e6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 503, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fc181126-7c66-44d3-b731-a59036bd562f', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:38:16.755868 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1b7b2aa-b526-4b93-9543-d2070454dda5 req-44e584d6-022f-4b50-a13c-f7219e869913 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:16.758121 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a1b7b2aa-b526-4b93-9543-d2070454dda5 req-44e584d6-022f-4b50-a13c-f7219e869913 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=36c42f532cd14f19811ffbee3a39a208&device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 1099 time: 0.0935483
Jun 03 08:38:16.801984 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:16.823797 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4312e3c9-0931-4dd5-ba11-db0d982c2a11 {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:38:16.849501 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-71cee251-bd04-4683-8c7d-48f1219a9027 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86bd3490>, [{'id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'name': 'tempest-AttachVolumeTestJSON-1767133114-router', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241'}], 'enable_snat': True}, 'gw_port_id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:38Z', 'updated_at': '2021-06-03T08:30:51Z', 'revision_number': 4, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'gw_port': {'id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:65:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '09aff824-d423-4557-8913-463e6f53d3e5', 'name': '', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'mac_address': 'fa:16:3e:c4:92:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_interface', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:47Z', 'updated_at': '2021-06-03T08:31:05Z', 'revision_number': 5, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'subnets': [{'id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:38:16.854775 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 4312e3c9-0931-4dd5-ba11-db0d982c2a11, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=4312e3c9-0931-4dd5-ba11-db0d982c2a11,segment=NetworkSegment(aaa5b128-9aff-431e-b567-4ca42a016de6),segment_id=aaa5b128-9aff-431e-b567-4ca42a016de6)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:38:16.855848 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71cee251-bd04-4683-8c7d-48f1219a9027 None None] Checking router: a4b01ad1-d952-4deb-88df-6930ad4824db for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:38:16.869283 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71cee251-bd04-4683-8c7d-48f1219a9027 None None] Routers {'a4b01ad1-d952-4deb-88df-6930ad4824db'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:38:16.869923 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-71cee251-bd04-4683-8c7d-48f1219a9027 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86bd3490>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:38:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['a4b01ad1-d952-4deb-88df-6930ad4824db'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:38:16.952517 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:16.957820 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:16.975951 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1b7b2aa-b526-4b93-9543-d2070454dda5 req-702ba094-1507-4954-8b34-1c7a5ed52811 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:16.977442 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a1b7b2aa-b526-4b93-9543-d2070454dda5 req-702ba094-1507-4954-8b34-1c7a5ed52811 service neutron] 10.222.0.55 "GET /v2.0/networks?id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba HTTP/1.1" status: 200  len: 918 time: 0.2116637
Jun 03 08:38:17.098059 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c4c8dbf-518b-4ee0-8da6-86508fd8c0ce req-7bebe500-5c14-49b3-b873-cdc6be742102 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:17.100386 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9c4c8dbf-518b-4ee0-8da6-86508fd8c0ce req-7bebe500-5c14-49b3-b873-cdc6be742102 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.2093980
Jun 03 08:38:17.123876 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=4312e3c9-0931-4dd5-ba11-db0d982c2a11,revision_number=7']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:17.129214 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:17.131043 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-71cee251-bd04-4683-8c7d-48f1219a9027 None None] Set router a4b01ad1-d952-4deb-88df-6930ad4824db gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:38:17.180184 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a1b7b2aa-b526-4b93-9543-d2070454dda5 req-f2206e1e-430c-4912-9c83-8dbea121ae44 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=1837d7d5-12fa-4414-9722-e593f5ed4c48 HTTP/1.1" status: 200  len: 1002 time: 0.1914899
Jun 03 08:38:17.193161 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['4312e3c9-0931-4dd5-ba11-db0d982c2a11'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:38:17.229212 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9648c8bc-9db6-49f1-97a5-a695e4c84816 req-f53745f2-1970-4665-ba53-76b180a88e01 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:17.230900 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-9648c8bc-9db6-49f1-97a5-a695e4c84816 req-f53745f2-1970-4665-ba53-76b180a88e01 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 945 time: 0.1067624
Jun 03 08:38:17.249911 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9c4c8dbf-518b-4ee0-8da6-86508fd8c0ce req-f3c7c586-7ce8-45cf-b122-7ccbe5a3236f tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1081588
Jun 03 08:38:17.289579 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1b7b2aa-b526-4b93-9543-d2070454dda5 req-312bb3fe-069d-4ba6-8d5a-ff63c72f9e67 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:17.291704 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a1b7b2aa-b526-4b93-9543-d2070454dda5 req-312bb3fe-069d-4ba6-8d5a-ff63c72f9e67 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=cff67a13-bc33-4d3e-a796-5829103ca25c HTTP/1.1" status: 200  len: 856 time: 0.1017127
Jun 03 08:38:17.308461 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-9648c8bc-9db6-49f1-97a5-a695e4c84816 req-f236f8d7-1a8f-4678-815b-2e735dae5ad9 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0664833
Jun 03 08:38:17.410761 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1b7b2aa-b526-4b93-9543-d2070454dda5 req-e3a5ad0d-5bf3-4110-93cc-383598da3d04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:17.412417 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a1b7b2aa-b526-4b93-9543-d2070454dda5 req-e3a5ad0d-5bf3-4110-93cc-383598da3d04 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1123259
Jun 03 08:38:17.556188 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a1b7b2aa-b526-4b93-9543-d2070454dda5 req-82697868-f115-4a38-ad91-83707181e5fc service neutron] 10.222.0.55 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1362381
Jun 03 08:38:17.652607 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-71cee251-bd04-4683-8c7d-48f1219a9027 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86bd3490>, [{'id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'name': 'tempest-AttachVolumeTestJSON-1767133114-router', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241'}], 'enable_snat': True}, 'gw_port_id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:38Z', 'updated_at': '2021-06-03T08:30:51Z', 'revision_number': 4, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'gw_port': {'id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:65:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '09aff824-d423-4557-8913-463e6f53d3e5', 'name': '', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'mac_address': 'fa:16:3e:c4:92:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_interface', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:47Z', 'updated_at': '2021-06-03T08:31:05Z', 'revision_number': 5, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'subnets': [{'id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:38:17.668825 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71cee251-bd04-4683-8c7d-48f1219a9027 None None] The sync data for ids ['a4b01ad1-d952-4deb-88df-6930ad4824db'] in dv-cinder-787262-5-iscsi is: [{'id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'name': 'tempest-AttachVolumeTestJSON-1767133114-router', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241'}], 'enable_snat': True}, 'gw_port_id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:38Z', 'updated_at': '2021-06-03T08:30:51Z', 'revision_number': 4, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'gw_port': {'id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:65:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '09aff824-d423-4557-8913-463e6f53d3e5', 'name': '', 'network_id': '020eaa43-2d59-46e1-8aec-0a688069f72b', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'mac_address': 'fa:16:3e:c4:92:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_interface', 'standard_attr_id': 75, 'fixed_ips': [{'subnet_id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:47Z', 'updated_at': '2021-06-03T08:31:05Z', 'revision_number': 5, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'subnets': [{'id': '5baf74c9-e686-40a5-b52f-f01da3bd1af9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:38:17.701318 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-a1b7b2aa-b526-4b93-9543-d2070454dda5 req-824a890d-e646-4ac0-86d1-eedbcf8ca80d service neutron] 10.222.0.55 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1374991
Jun 03 08:38:17.905845 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10d2a52c-fcdb-45db-ad83-db8bfa4fa86e None None] New status for floating IP 0cf1b680-7278-499d-96d6-d63af807b96f: DOWN {{(pid=92326) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 03 08:38:17.917786 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 55250) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:17.999440 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-78f13790-0538-46f3-a50b-c3d2fab10d3e tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:18.119088 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-78f13790-0538-46f3-a50b-c3d2fab10d3e tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:18.268595 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 4312e3c9-0931-4dd5-ba11-db0d982c2a11 up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:38:18.324074 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-78f13790-0538-46f3-a50b-c3d2fab10d3e tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:18.330225 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f5cc95b2-d537-41ae-b238-7e7f77131818 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:18.347345 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78f13790-0538-46f3-a50b-c3d2fab10d3e tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f7460adc-d3b2-4e2f-9865-c9faf88a2da7,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:18.349364 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port 4312e3c9-0931-4dd5-ba11-db0d982c2a11 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:38:18.349364 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:18.356641 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-78f13790-0538-46f3-a50b-c3d2fab10d3e tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:18.484535 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a106438-7067-42f7-86ee-c6e7cf9cd37f req-4fe7b236-160f-477b-8aaa-3a579c20d1d5 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:18.486119 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0a106438-7067-42f7-86ee-c6e7cf9cd37f req-4fe7b236-160f-477b-8aaa-3a579c20d1d5 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.0971570
Jun 03 08:38:18.487251 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-78f13790-0538-46f3-a50b-c3d2fab10d3e tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:18.490275 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-78f13790-0538-46f3-a50b-c3d2fab10d3e tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "DELETE /v2.0/security-groups/f7460adc-d3b2-4e2f-9865-c9faf88a2da7 HTTP/1.1" status: 204  len: 168 time: 0.5695820
Jun 03 08:38:18.490993 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 55256) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:18.493952 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:18.523371 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.api.v2.resource [None req-c3d0f065-3da8-4b09-925c-5cb6ef9c81d6 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] show failed (client error): The resource could not be found.
Jun 03 08:38:18.523629 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '80cea05e-57d7-4393-818e-b7a621e986ec', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4312e3c9-0931-4dd5-ba11-db0d982c2a11'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:38:18.524374 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-c3d0f065-3da8-4b09-925c-5cb6ef9c81d6 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "GET /v2.0/security-groups/f7460adc-d3b2-4e2f-9865-c9faf88a2da7 HTTP/1.1" status: 404  len: 347 time: 0.0324953
Jun 03 08:38:18.525898 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ab70b4b3-5daf-484d-8c9e-cd6526b018ba" -d '{"events": [{"server_uuid": "80cea05e-57d7-4393-818e-b7a621e986ec", "name": "network-vif-plugged", "status": "completed", "tag": "4312e3c9-0931-4dd5-ba11-db0d982c2a11"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:38:18.528032 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 55258) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:18.534789 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 4312e3c9-0931-4dd5-ba11-db0d982c2a11, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=4312e3c9-0931-4dd5-ba11-db0d982c2a11,segment=NetworkSegment(aaa5b128-9aff-431e-b567-4ca42a016de6),segment_id=aaa5b128-9aff-431e-b567-4ca42a016de6)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:38:18.553979 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0a106438-7067-42f7-86ee-c6e7cf9cd37f req-5b2c4828-9294-495b-a041-0671aaff2b44 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0588500
Jun 03 08:38:18.613650 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:18.615229 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 9b84dcd4-a96a-49e0-9102-07b3ed50b805 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:38:18.642745 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:38:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aff32c62-06e5-4fa1-abd6-3db343ff468f x-openstack-request-id: req-aff32c62-06e5-4fa1-abd6-3db343ff468f {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:38:18.643155 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "80cea05e-57d7-4393-818e-b7a621e986ec", "name": "network-vif-plugged", "status": "completed", "tag": "4312e3c9-0931-4dd5-ba11-db0d982c2a11", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:38:18.643414 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-aff32c62-06e5-4fa1-abd6-3db343ff468f {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:38:18.643900 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '80cea05e-57d7-4393-818e-b7a621e986ec', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4312e3c9-0931-4dd5-ba11-db0d982c2a11', 'code': 200}
Jun 03 08:38:18.649986 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-cc769d0a-abcb-46b4-a3f3-6406d47bc5db None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:18.698322 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] No Port match for: 9b84dcd4-a96a-49e0-9102-07b3ed50b805 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:38:18.698699 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 9b84dcd4-a96a-49e0-9102-07b3ed50b805 not bound to the agent host hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:38:18.703057 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fee77dd-111a-4e8b-8788-c4043413eec7 req-c285b55f-b515-4dab-8d6a-44b3f60b0eaf tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:18.704604 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8fee77dd-111a-4e8b-8788-c4043413eec7 req-c285b55f-b515-4dab-8d6a-44b3f60b0eaf tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 945 time: 0.2664106
Jun 03 08:38:18.727825 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=4312e3c9-0931-4dd5-ba11-db0d982c2a11,revision_number=8']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:18.731069 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:18.801600 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8fee77dd-111a-4e8b-8788-c4043413eec7 req-e7c866e8-fee9-4fc9-8103-a4786718e9da tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0860527
Jun 03 08:38:18.818343 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-bec1c7c1-0bce-4b32-b2de-d93a88a48dd1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Deleting port 835aedf4-779c-4bfc-b8d2-2d5a43b181d3 {{(pid=92324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:38:18.818730 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-bec1c7c1-0bce-4b32-b2de-d93a88a48dd1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:18.944719 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-bec1c7c1-0bce-4b32-b2de-d93a88a48dd1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:18.945420 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-bec1c7c1-0bce-4b32-b2de-d93a88a48dd1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:18.995783 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8293b3e0-1c86-48e8-b726-170648515d6d req-cdfcfb39-9229-4c40-8809-9a77a1e2dee8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:18.998238 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8293b3e0-1c86-48e8-b726-170648515d6d req-cdfcfb39-9229-4c40-8809-9a77a1e2dee8 service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 1099 time: 0.0815284
Jun 03 08:38:19.048301 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-8293b3e0-1c86-48e8-b726-170648515d6d req-bdfcd896-16be-4b56-a8dd-22e4e68249cb service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0428610
Jun 03 08:38:19.077979 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-bec1c7c1-0bce-4b32-b2de-d93a88a48dd1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Calling delete_port for 835aedf4-779c-4bfc-b8d2-2d5a43b181d3 owned by network:floatingip {{(pid=92324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:38:19.261436 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-bec1c7c1-0bce-4b32-b2de-d93a88a48dd1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:19.265360 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-851a9a2a-fdb9-470f-a100-59d992a98b65 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:19.314714 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bec1c7c1-0bce-4b32-b2de-d93a88a48dd1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Pushing event deleted for resources: {'Port': ['ID=835aedf4-779c-4bfc-b8d2-2d5a43b181d3,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:19.316716 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-bec1c7c1-0bce-4b32-b2de-d93a88a48dd1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:19.409238 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-bec1c7c1-0bce-4b32-b2de-d93a88a48dd1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks [] for floatingip, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:19.423269 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-bec1c7c1-0bce-4b32-b2de-d93a88a48dd1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for floatingip, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:19.425076 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-bec1c7c1-0bce-4b32-b2de-d93a88a48dd1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] 10.222.0.11 "DELETE /v2.0/floatingips/0cf1b680-7278-499d-96d6-d63af807b96f HTTP/1.1" status: 204  len: 168 time: 0.8951061
Jun 03 08:38:19.892573 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a0f161d-4338-40d5-b873-eb93e9129fcb req-4cdf2201-9a97-444b-9a66-7528c4059ced tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:19.900794 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0a0f161d-4338-40d5-b873-eb93e9129fcb req-4cdf2201-9a97-444b-9a66-7528c4059ced tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 946 time: 0.2293868
Jun 03 08:38:19.950028 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-0a0f161d-4338-40d5-b873-eb93e9129fcb req-682929e3-42cb-4db8-a221-28524ae74ba8 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0481100
Jun 03 08:38:20.017753 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03325eec-bd50-4f0d-bf08-89f259793f82 req-6351bc21-5c8d-4a08-96af-9c406c2430b5 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:20.019419 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-03325eec-bd50-4f0d-bf08-89f259793f82 req-6351bc21-5c8d-4a08-96af-9c406c2430b5 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 946 time: 0.0925841
Jun 03 08:38:20.070550 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-03325eec-bd50-4f0d-bf08-89f259793f82 req-a8896be0-4642-42eb-8965-24af1a95cf67 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0448899
Jun 03 08:38:20.286119 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 1837d7d5-12fa-4414-9722-e593f5ed4c48 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:38:20.407973 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:20.442804 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 1837d7d5-12fa-4414-9722-e593f5ed4c48, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=1837d7d5-12fa-4414-9722-e593f5ed4c48,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:38:20.541352 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:20.543086 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-15d7e8ad-2b00-447d-8d05-d55c94af4848 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:20.644873 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '41d57543-e5c8-45b5-8eef-2f829250eec3', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1837d7d5-12fa-4414-9722-e593f5ed4c48'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:38:20.647199 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-777bc786-c527-46cb-a004-5e5e89204984" -d '{"events": [{"server_uuid": "41d57543-e5c8-45b5-8eef-2f829250eec3", "name": "network-vif-unplugged", "status": "completed", "tag": "1837d7d5-12fa-4414-9722-e593f5ed4c48"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:38:20.657059 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=1837d7d5-12fa-4414-9722-e593f5ed4c48,revision_number=8']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:20.660264 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:20.691289 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Thu, 03 Jun 2021 08:38:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8b60b4fd-b177-449f-99d6-29965fb6e261 x-openstack-request-id: req-8b60b4fd-b177-449f-99d6-29965fb6e261 {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:38:20.691581 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "41d57543-e5c8-45b5-8eef-2f829250eec3", "name": "network-vif-unplugged", "status": "failed", "tag": "1837d7d5-12fa-4414-9722-e593f5ed4c48", "code": 422}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:38:20.691871 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-8b60b4fd-b177-449f-99d6-29965fb6e261 {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:38:20.692462 dv-cinder-787262-5-iscsi neutron-server[92325]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '41d57543-e5c8-45b5-8eef-2f829250eec3', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '1837d7d5-12fa-4414-9722-e593f5ed4c48', 'code': 422} returned with failed status
Jun 03 08:38:21.162057 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c30d14a-1dcb-4ac9-8dca-439f8353c7ec req-96ed44d6-8e5c-40e8-b41d-a4e4b42c561b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:21.163531 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0c30d14a-1dcb-4ac9-8dca-439f8353c7ec req-96ed44d6-8e5c-40e8-b41d-a4e4b42c561b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 944 time: 0.0907202
Jun 03 08:38:21.224254 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0c30d14a-1dcb-4ac9-8dca-439f8353c7ec req-058dfa9b-6ea3-4265-92e3-353f7fadd6c4 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0536938
Jun 03 08:38:21.302174 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e8fa07d-b201-4fb7-a788-38ff511c34b8 req-b3d6d28b-c275-4245-8c95-bfc37c85fb94 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:21.310567 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3e8fa07d-b201-4fb7-a788-38ff511c34b8 req-b3d6d28b-c275-4245-8c95-bfc37c85fb94 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 946 time: 0.1195915
Jun 03 08:38:21.349016 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3e8fa07d-b201-4fb7-a788-38ff511c34b8 req-bffba3b3-98b3-46a0-98da-265a61b25bcb tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0394421
Jun 03 08:38:24.083789 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 55334) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:24.190840 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebbf2652-6f07-4cc6-bc99-f9978ec02256 req-d43bef67-2347-4cd8-b53d-7cd220a0d372 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:24.192316 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ebbf2652-6f07-4cc6-bc99-f9978ec02256 req-d43bef67-2347-4cd8-b53d-7cd220a0d372 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 944 time: 0.0984957
Jun 03 08:38:24.412387 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ebbf2652-6f07-4cc6-bc99-f9978ec02256 req-6c71fd92-88a7-466e-a0cd-ba77bbc80e29 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2138789
Jun 03 08:38:24.640671 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2b6b3104-36e4-4773-81f9-7d9afe9d9d23 req-1a37c079-8f69-498a-96a6-02ddc5caa5f3 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.3375053
Jun 03 08:38:24.945214 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8f86859e-92ee-4728-a021-6cf0b2293c65 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-16328733'] for router_interface, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:25.378206 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-8f86859e-92ee-4728-a021-6cf0b2293c65 admin admin] Deleting port 09aff824-d423-4557-8913-463e6f53d3e5 {{(pid=92324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:38:25.378998 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8f86859e-92ee-4728-a021-6cf0b2293c65 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:25.511940 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.db [None req-8f86859e-92ee-4728-a021-6cf0b2293c65 admin admin] For port 09aff824-d423-4557-8913-463e6f53d3e5, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=09aff824-d423-4557-8913-463e6f53d3e5,segment=NetworkSegment(56366949-8cc8-4cf3-b3eb-d458d3515059),segment_id=56366949-8cc8-4cf3-b3eb-d458d3515059)] {{(pid=92324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:38:25.512296 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8f86859e-92ee-4728-a021-6cf0b2293c65 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:25.612968 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e702f27-aeb0-40dc-9f48-4bfc84ca70fe req-710eb11c-1ae4-42f6-8165-27491bd82929 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:25.615116 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4e702f27-aeb0-40dc-9f48-4bfc84ca70fe req-710eb11c-1ae4-42f6-8165-27491bd82929 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 944 time: 0.0905826
Jun 03 08:38:25.642918 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-8f86859e-92ee-4728-a021-6cf0b2293c65 admin admin] Calling delete_port for 09aff824-d423-4557-8913-463e6f53d3e5 owned by network:router_interface {{(pid=92324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:38:25.662770 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4e702f27-aeb0-40dc-9f48-4bfc84ca70fe req-9f03f5a8-9b75-48e2-89f7-b2d3bffb3f40 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0416243
Jun 03 08:38:26.033336 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8f86859e-92ee-4728-a021-6cf0b2293c65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:26.040100 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:26.072692 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:26.087702 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f86859e-92ee-4728-a021-6cf0b2293c65 admin admin] Pushing event deleted for resources: {'Port': ['ID=09aff824-d423-4557-8913-463e6f53d3e5,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:26.090816 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-8f86859e-92ee-4728-a021-6cf0b2293c65 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:26.257187 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b6b3104-36e4-4773-81f9-7d9afe9d9d23 req-970672d7-44ab-4122-b1d0-bda18bec5a4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:26.259214 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2b6b3104-36e4-4773-81f9-7d9afe9d9d23 req-970672d7-44ab-4122-b1d0-bda18bec5a4e service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3&tenant_id=36c42f532cd14f19811ffbee3a39a208 HTTP/1.1" status: 200  len: 1097 time: 0.0867321
Jun 03 08:38:26.365563 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b6b3104-36e4-4773-81f9-7d9afe9d9d23 req-54ab82be-3294-4e05-9b90-48d3b0a877fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:26.367880 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2b6b3104-36e4-4773-81f9-7d9afe9d9d23 req-54ab82be-3294-4e05-9b90-48d3b0a877fc service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=36c42f532cd14f19811ffbee3a39a208&device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 1097 time: 0.0821676
Jun 03 08:38:26.489467 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8f86859e-92ee-4728-a021-6cf0b2293c65 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-16344783', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-16328833'] for router_interface, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:26.507018 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b6b3104-36e4-4773-81f9-7d9afe9d9d23 req-f1b20ba6-0e16-4242-bed6-6ff12258e8c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:26.508481 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2b6b3104-36e4-4773-81f9-7d9afe9d9d23 req-f1b20ba6-0e16-4242-bed6-6ff12258e8c0 service neutron] 10.222.0.55 "GET /v2.0/networks?id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba HTTP/1.1" status: 200  len: 918 time: 0.1338415
Jun 03 08:38:26.619837 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2b6b3104-36e4-4773-81f9-7d9afe9d9d23 req-112a4fa0-6250-4e90-9f9a-ad9bd1490808 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=1837d7d5-12fa-4414-9722-e593f5ed4c48 HTTP/1.1" status: 200  len: 1000 time: 0.0997357
Jun 03 08:38:26.698048 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b6b3104-36e4-4773-81f9-7d9afe9d9d23 req-b61522dd-b1f6-442e-9a51-239a9a8220fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:26.699786 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2b6b3104-36e4-4773-81f9-7d9afe9d9d23 req-b61522dd-b1f6-442e-9a51-239a9a8220fc service neutron] 10.222.0.55 "GET /v2.0/subnets?id=cff67a13-bc33-4d3e-a796-5829103ca25c HTTP/1.1" status: 200  len: 856 time: 0.0601704
Jun 03 08:38:26.783899 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b6b3104-36e4-4773-81f9-7d9afe9d9d23 req-ecc3f672-76cf-4567-b7e6-a7a8ae9c0264 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:26.785687 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2b6b3104-36e4-4773-81f9-7d9afe9d9d23 req-ecc3f672-76cf-4567-b7e6-a7a8ae9c0264 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0791926
Jun 03 08:38:26.913884 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8f86859e-92ee-4728-a021-6cf0b2293c65 admin admin] Router a4b01ad1-d952-4deb-88df-6930ad4824db has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:38:26.933454 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2b6b3104-36e4-4773-81f9-7d9afe9d9d23 req-b847705f-0b8e-4748-8272-9bb545ab5362 service neutron] 10.222.0.55 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1392274
Jun 03 08:38:27.002983 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bef1f61a-e075-4acb-8f47-82372adec7fb req-575e3614-449e-4d12-b4ff-a95c0de147e5 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:27.004523 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-bef1f61a-e075-4acb-8f47-82372adec7fb req-575e3614-449e-4d12-b4ff-a95c0de147e5 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 944 time: 0.1934986
Jun 03 08:38:27.070136 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-2b6b3104-36e4-4773-81f9-7d9afe9d9d23 req-c7cbc954-5c3e-48e7-9131-251198eb85f3 service neutron] 10.222.0.55 "GET /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1299932
Jun 03 08:38:27.128901 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-bef1f61a-e075-4acb-8f47-82372adec7fb req-33a52d4e-13ec-4b0d-bc4d-22ca56e4eee2 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1160307
Jun 03 08:38:27.143888 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8f86859e-92ee-4728-a021-6cf0b2293c65 admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:38:27.153193 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f604b8be-77f4-46a5-a080-a49227cb352b None None] Sync routers for ids ['a4b01ad1-d952-4deb-88df-6930ad4824db'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:38:27.156500 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-8f86859e-92ee-4728-a021-6cf0b2293c65 admin admin] 10.222.0.11 "PUT /v2.0/routers/a4b01ad1-d952-4deb-88df-6930ad4824db/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 3.0715444
Jun 03 08:38:27.158989 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 55370) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:27.164282 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f604b8be-77f4-46a5-a080-a49227cb352b None None] Routers {'a4b01ad1-d952-4deb-88df-6930ad4824db'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:38:27.164972 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-f604b8be-77f4-46a5-a080-a49227cb352b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae861f3f40>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:38:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['a4b01ad1-d952-4deb-88df-6930ad4824db'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:38:27.336320 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a84f4688-62d8-4f0f-8e88-4915c7c37fcf admin admin] Notify callbacks [] for router, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:27.347443 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-f604b8be-77f4-46a5-a080-a49227cb352b None None] Set router a4b01ad1-d952-4deb-88df-6930ad4824db gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:38:27.514788 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a84f4688-62d8-4f0f-8e88-4915c7c37fcf admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:27.643061 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-f604b8be-77f4-46a5-a080-a49227cb352b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae861f3f40>, [{'id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'name': 'tempest-AttachVolumeTestJSON-1767133114-router', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241'}], 'enable_snat': True}, 'gw_port_id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:38Z', 'updated_at': '2021-06-03T08:38:25Z', 'revision_number': 5, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'gw_port': {'id': '25fe9a61-dbff-4283-b107-964710e6f4ad', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:65:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'device_owner': 'network:router_gateway', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.241', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:38:27.646958 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f604b8be-77f4-46a5-a080-a49227cb352b None None] Checking router: a4b01ad1-d952-4deb-88df-6930ad4824db for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:38:27.652497 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-a84f4688-62d8-4f0f-8e88-4915c7c37fcf admin admin] Deleting port 25fe9a61-dbff-4283-b107-964710e6f4ad {{(pid=92324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:38:27.652855 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a84f4688-62d8-4f0f-8e88-4915c7c37fcf admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:27.655419 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f604b8be-77f4-46a5-a080-a49227cb352b None None] Routers {'a4b01ad1-d952-4deb-88df-6930ad4824db'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:38:27.655968 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-f604b8be-77f4-46a5-a080-a49227cb352b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae861f3f40>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:38:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['a4b01ad1-d952-4deb-88df-6930ad4824db'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:38:27.826214 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-f604b8be-77f4-46a5-a080-a49227cb352b None None] Set router a4b01ad1-d952-4deb-88df-6930ad4824db gateway port host: None {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:38:27.973229 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-f604b8be-77f4-46a5-a080-a49227cb352b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae861f3f40>, [{'id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'name': 'tempest-AttachVolumeTestJSON-1767133114-router', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:38Z', 'updated_at': '2021-06-03T08:38:27Z', 'revision_number': 6, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'gw_port_host': None}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:38:27.973439 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.db [None req-a84f4688-62d8-4f0f-8e88-4915c7c37fcf admin admin] For port 25fe9a61-dbff-4283-b107-964710e6f4ad, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=25fe9a61-dbff-4283-b107-964710e6f4ad,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:38:27.973835 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a84f4688-62d8-4f0f-8e88-4915c7c37fcf admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:27.978655 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f604b8be-77f4-46a5-a080-a49227cb352b None None] The sync data for ids ['a4b01ad1-d952-4deb-88df-6930ad4824db'] in dv-cinder-787262-5-iscsi is: [{'id': 'a4b01ad1-d952-4deb-88df-6930ad4824db', 'name': 'tempest-AttachVolumeTestJSON-1767133114-router', 'tenant_id': '755371c3d9de4747a47ba62e4d101829', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:38Z', 'updated_at': '2021-06-03T08:38:27Z', 'revision_number': 6, 'project_id': '755371c3d9de4747a47ba62e4d101829', 'gw_port_host': None}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:38:28.133955 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-a84f4688-62d8-4f0f-8e88-4915c7c37fcf admin admin] Calling delete_port for 25fe9a61-dbff-4283-b107-964710e6f4ad owned by network:router_gateway {{(pid=92324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:38:28.365069 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 09aff824-d423-4557-8913-463e6f53d3e5 no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:38:28.381846 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f88c8742-54d3-4a99-9541-e11c0dcaef69 req-4f341735-2ebc-4adf-86e7-1027450c18fc tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:28.389398 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f88c8742-54d3-4a99-9541-e11c0dcaef69 req-4f341735-2ebc-4adf-86e7-1027450c18fc tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 944 time: 0.1238279
Jun 03 08:38:28.420188 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a84f4688-62d8-4f0f-8e88-4915c7c37fcf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:28.433086 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-bec1c7c1-0bce-4b32-b2de-d93a88a48dd1 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:28.446098 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f88c8742-54d3-4a99-9541-e11c0dcaef69 req-5434b322-a235-401e-83c4-42c1b336c073 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0556712
Jun 03 08:38:28.452658 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: 09aff824-d423-4557-8913-463e6f53d3e5 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:38:28.453379 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 09aff824-d423-4557-8913-463e6f53d3e5 not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:38:28.506035 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a84f4688-62d8-4f0f-8e88-4915c7c37fcf admin admin] Pushing event deleted for resources: {'Port': ['ID=25fe9a61-dbff-4283-b107-964710e6f4ad,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:28.536800 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-a84f4688-62d8-4f0f-8e88-4915c7c37fcf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:28.607190 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a84f4688-62d8-4f0f-8e88-4915c7c37fcf admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-16327738'] for router_gateway, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:28.791561 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a84f4688-62d8-4f0f-8e88-4915c7c37fcf admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-16388336', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2351'] for router, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:28.793803 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a84f4688-62d8-4f0f-8e88-4915c7c37fcf admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:28.923828 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a84f4688-62d8-4f0f-8e88-4915c7c37fcf admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-16388448'] for router, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:28.924350 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a84f4688-62d8-4f0f-8e88-4915c7c37fcf admin admin] Fanout notify agent at l3_agent the message router_deleted on router a4b01ad1-d952-4deb-88df-6930ad4824db {{(pid=92324) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 03 08:38:28.937591 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a84f4688-62d8-4f0f-8e88-4915c7c37fcf admin admin] Notify callbacks [] for router, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:28.938903 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-a84f4688-62d8-4f0f-8e88-4915c7c37fcf admin admin] 10.222.0.11 "DELETE /v2.0/routers/a4b01ad1-d952-4deb-88df-6930ad4824db HTTP/1.1" status: 204  len: 168 time: 1.7789290
Jun 03 08:38:28.942211 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 55400) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:29.008728 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_v2 [None req-3b2dbf5c-f834-47b5-9b2e-732ece3cca65 admin admin] Deleting subnet 5baf74c9-e686-40a5-b52f-f01da3bd1af9 {{(pid=92323) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 03 08:38:29.012053 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-3b2dbf5c-f834-47b5-9b2e-732ece3cca65 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:29.065776 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-3b2dbf5c-f834-47b5-9b2e-732ece3cca65 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14518184'] for subnet, precommit_delete_associations {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:29.192242 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-3b2dbf5c-f834-47b5-9b2e-732ece3cca65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-862421'] for subnet, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:29.512310 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-3b2dbf5c-f834-47b5-9b2e-732ece3cca65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-862434', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14211216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14857862'] for subnet, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:29.526438 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-aa0a8100-3574-4dcb-b15b-59de5e491fd0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:29.561493 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-3b2dbf5c-f834-47b5-9b2e-732ece3cca65 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:29.566431 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be76f3d7-34e9-41c7-a2c0-893784220eec None None] Network 020eaa43-2d59-46e1-8aec-0a688069f72b requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:38:29.581131 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-3b2dbf5c-f834-47b5-9b2e-732ece3cca65 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/5baf74c9-e686-40a5-b52f-f01da3bd1af9 HTTP/1.1" status: 204  len: 168 time: 0.6347518
Jun 03 08:38:29.581131 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b2dbf5c-f834-47b5-9b2e-732ece3cca65 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5baf74c9-e686-40a5-b52f-f01da3bd1af9,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:29.588809 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-3b2dbf5c-f834-47b5-9b2e-732ece3cca65 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:29.589389 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 55406) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:29.701896 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3bb5300-a88f-43e3-827d-733f469d7cae req-0ca9e959-518e-4431-ace3-8c9465c4f46f tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:29.710257 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d3bb5300-a88f-43e3-827d-733f469d7cae req-0ca9e959-518e-4431-ace3-8c9465c4f46f tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 944 time: 0.1510069
Jun 03 08:38:29.772113 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d3bb5300-a88f-43e3-827d-733f469d7cae req-3a4e0d12-6ea3-41ad-84e2-e7944a765662 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0605624
Jun 03 08:38:29.851332 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-529010'] for network, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:29.876609 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e7f9b4c9-095f-4dfd-a979-3b9132f4a226 None None] DHCP port deletion for 020eaa43-2d59-46e1-8aec-0a688069f72b request from dv-cinder-787262-5-iscsi {{(pid=92325) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 03 08:38:29.935761 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] Deleting port 4e183c7e-d68a-4fcc-8844-a9cadeac12f4 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:38:29.936100 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:29.956765 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-e7f9b4c9-095f-4dfd-a979-3b9132f4a226 None None] Deleting port 4e183c7e-d68a-4fcc-8844-a9cadeac12f4 {{(pid=92325) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:38:29.957150 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-e7f9b4c9-095f-4dfd-a979-3b9132f4a226 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:30.055866 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] For port 4e183c7e-d68a-4fcc-8844-a9cadeac12f4, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=4e183c7e-d68a-4fcc-8844-a9cadeac12f4,segment=NetworkSegment(56366949-8cc8-4cf3-b3eb-d458d3515059),segment_id=56366949-8cc8-4cf3-b3eb-d458d3515059)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:38:30.056780 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:30.073654 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-e7f9b4c9-095f-4dfd-a979-3b9132f4a226 None None] For port 4e183c7e-d68a-4fcc-8844-a9cadeac12f4, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=4e183c7e-d68a-4fcc-8844-a9cadeac12f4,segment=NetworkSegment(56366949-8cc8-4cf3-b3eb-d458d3515059),segment_id=56366949-8cc8-4cf3-b3eb-d458d3515059)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:38:30.074057 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-e7f9b4c9-095f-4dfd-a979-3b9132f4a226 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:30.189767 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] Calling delete_port for 4e183c7e-d68a-4fcc-8844-a9cadeac12f4 owned by network:dhcp {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:38:30.267252 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-e7f9b4c9-095f-4dfd-a979-3b9132f4a226 None None] Calling delete_port for 4e183c7e-d68a-4fcc-8844-a9cadeac12f4 owned by network:dhcp {{(pid=92325) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:38:30.340689 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:30.344705 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-73d4a196-f8ae-4405-98c4-925b1a1f1bb7 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:30.354710 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-e7f9b4c9-095f-4dfd-a979-3b9132f4a226 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151'] for port, after_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:30.361421 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:30.402684 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] Pushing event deleted for resources: {'Port': ['ID=4e183c7e-d68a-4fcc-8844-a9cadeac12f4,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:30.406522 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 4e183c7e-d68a-4fcc-8844-a9cadeac12f4 no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:38:30.410649 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:30.413799 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] No DVR routers for this DVR port 4e183c7e-d68a-4fcc-8844-a9cadeac12f4 on host dv-cinder-787262-5-iscsi {{(pid=92323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:38:30.448493 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7f9b4c9-095f-4dfd-a979-3b9132f4a226 None None] Pushing event deleted for resources: {'Port': ['ID=4e183c7e-d68a-4fcc-8844-a9cadeac12f4,revision_number=None']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:30.461237 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: 4e183c7e-d68a-4fcc-8844-a9cadeac12f4 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:38:30.461591 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 4e183c7e-d68a-4fcc-8844-a9cadeac12f4 not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:38:30.462026 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 25fe9a61-dbff-4283-b107-964710e6f4ad no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:38:30.486796 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7f9b4c9-095f-4dfd-a979-3b9132f4a226 None None] No DVR routers for this DVR port 4e183c7e-d68a-4fcc-8844-a9cadeac12f4 on host dv-cinder-787262-5-iscsi {{(pid=92325) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:38:30.493716 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f9b4c9-095f-4dfd-a979-3b9132f4a226 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:30.494044 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f9b4c9-095f-4dfd-a979-3b9132f4a226 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:30.494397 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f9b4c9-095f-4dfd-a979-3b9132f4a226 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:30.494763 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f9b4c9-095f-4dfd-a979-3b9132f4a226 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:30.495101 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f9b4c9-095f-4dfd-a979-3b9132f4a226 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:30.495436 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f9b4c9-095f-4dfd-a979-3b9132f4a226 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:30.495770 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f9b4c9-095f-4dfd-a979-3b9132f4a226 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:30.496104 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f9b4c9-095f-4dfd-a979-3b9132f4a226 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:30.496430 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f9b4c9-095f-4dfd-a979-3b9132f4a226 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:30.496759 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f9b4c9-095f-4dfd-a979-3b9132f4a226 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:30.497095 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f9b4c9-095f-4dfd-a979-3b9132f4a226 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:30.497424 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7f9b4c9-095f-4dfd-a979-3b9132f4a226 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:38:30.505539 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-e7f9b4c9-095f-4dfd-a979-3b9132f4a226 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:30.506266 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: 25fe9a61-dbff-4283-b107-964710e6f4ad {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:38:30.506735 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 25fe9a61-dbff-4283-b107-964710e6f4ad not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:38:30.578867 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-862046', 'neutron.services.segments.db._delete_segments_for_network-8774224358894'] for network, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:30.602331 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fae858351c0>,) {'filters': {'network_id': ['020eaa43-2d59-46e1-8aec-0a688069f72b']}} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:38:30.616432 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fae858351c0>, '56366949-8cc8-4cf3-b3eb-d458d3515059') {'for_net_delete': True} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:38:30.616727 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fae858351c0>, '56366949-8cc8-4cf3-b3eb-d458d3515059') {} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:38:30.628109 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8774224362253', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14518195'] for segment, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:30.643988 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:30.650634 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] Releasing vlan 531 on physical network physnet1 to pool {{(pid=92323) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 03 08:38:30.651038 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14211322'] for segment, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]: Traceback (most recent call last):
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:     timer()
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:     cb(*args, **kw)
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:     return func(*args, **kwargs)
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:     self._notify()
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:     self.callback(batched_events)
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:     event.method(event)
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:     return f(self, *a, **k)
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self._get(url).json()
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self.request(url, 'GET', **kwargs)
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 03 08:38:30.664726 dv-cinder-787262-5-iscsi neutron-server[92323]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 03 08:38:30.832729 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-862039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16327709'] for network, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:30.836364 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:30.851916 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:30.867506 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] Pushing event deleted for resources: {'Network': ['ID=020eaa43-2d59-46e1-8aec-0a688069f72b,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:30.870885 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:30.971433 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] 10.222.0.11 "DELETE /v2.0/networks/020eaa43-2d59-46e1-8aec-0a688069f72b HTTP/1.1" status: 204  len: 168 time: 1.3807218
Jun 03 08:38:30.999950 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd8366f2-d05c-4970-bd8f-e26a52fc3bb4 req-0c314a2f-4100-4b77-93d3-9f7e44bbbbff tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:31.001449 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-dd8366f2-d05c-4970-bd8f-e26a52fc3bb4 req-0c314a2f-4100-4b77-93d3-9f7e44bbbbff tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 944 time: 0.0869570
Jun 03 08:38:31.051553 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-dd8366f2-d05c-4970-bd8f-e26a52fc3bb4 req-b1611302-5b37-4435-85f8-11d12d171205 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0440762
Jun 03 08:38:31.301199 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 55416) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:31.377043 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-a78f7413-5dcd-4111-99fe-448fec3a2cf6 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=755371c3d9de4747a47ba62e4d101829&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0718238
Jun 03 08:38:31.377511 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 55420) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:31.443204 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2a9ab5e2-a70d-4fb9-a4ee-4136d61f0dff admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:31.469859 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2a9ab5e2-a70d-4fb9-a4ee-4136d61f0dff admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:31.621194 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2a9ab5e2-a70d-4fb9-a4ee-4136d61f0dff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:31.625021 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-4864964e-94fb-423f-912a-ebcf3beab917 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:31.638457 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a9ab5e2-a70d-4fb9-a4ee-4136d61f0dff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=70c51560-c72c-46c4-a284-e38445caed1a,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:31.642774 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-2a9ab5e2-a70d-4fb9-a4ee-4136d61f0dff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:31.648133 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-2a9ab5e2-a70d-4fb9-a4ee-4136d61f0dff admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:31.651142 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-2a9ab5e2-a70d-4fb9-a4ee-4136d61f0dff admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/70c51560-c72c-46c4-a284-e38445caed1a HTTP/1.1" status: 204  len: 168 time: 0.2707801
Jun 03 08:38:32.311323 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbb98fb5-35d1-468c-9e95-6fca30802cd8 req-c19e78bd-c2ef-4b25-95c5-5f6f5dfaf4b4 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:32.317611 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-cbb98fb5-35d1-468c-9e95-6fca30802cd8 req-c19e78bd-c2ef-4b25-95c5-5f6f5dfaf4b4 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 944 time: 0.1010215
Jun 03 08:38:32.367871 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-cbb98fb5-35d1-468c-9e95-6fca30802cd8 req-265d8a6e-ebeb-41a8-b272-bd0dfd7184aa tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0491800
Jun 03 08:38:32.998626 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-0ee873e5-39de-4918-80bb-b891d821597c tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Synchronizing usage tracker for tenant:db653c0bf0ab42639863b4ea2268a265 on resource:security_group {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:38:33.369411 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-0ee873e5-39de-4918-80bb-b891d821597c tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Unset dirty status for tenant:db653c0bf0ab42639863b4ea2268a265 on resource:security_group {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:38:33.369753 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-bef4ce86-438f-447c-88f8-ae7247298157 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:33.371043 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-0ee873e5-39de-4918-80bb-b891d821597c tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1108931873&fields=id&tenant_id=db653c0bf0ab42639863b4ea2268a265 HTTP/1.1" status: 200  len: 267 time: 0.4143238
Jun 03 08:38:33.585494 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-2c85fc84-cabd-4e28-859f-dd735b8ed923 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:33.586337 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-2c85fc84-cabd-4e28-859f-dd735b8ed923 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Synchronizing usage tracker for tenant:db653c0bf0ab42639863b4ea2268a265 on resource:network {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:38:33.620943 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ffbb29d-d0a7-4938-8ee0-e79e88bb577b req-0e49bad7-5004-4c0b-91bc-4732f3c96497 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:33.622801 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-1ffbb29d-d0a7-4938-8ee0-e79e88bb577b req-0e49bad7-5004-4c0b-91bc-4732f3c96497 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 944 time: 0.0974145
Jun 03 08:38:33.676465 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-1ffbb29d-d0a7-4938-8ee0-e79e88bb577b req-7f6a1c8a-cdf6-42ae-bc71-03f5a578f5fb tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0467081
Jun 03 08:38:33.695692 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-2c85fc84-cabd-4e28-859f-dd735b8ed923 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Unset dirty status for tenant:db653c0bf0ab42639863b4ea2268a265 on resource:network {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:38:33.696337 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-2c85fc84-cabd-4e28-859f-dd735b8ed923 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/networks?id=7722e8fc-e6a8-422f-8456-a3c594da293a HTTP/1.1" status: 200  len: 812 time: 0.3142219
Jun 03 08:38:33.722938 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-1758b35e-eaf7-45d3-9cfa-ff1e768e14d0 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/quotas/db653c0bf0ab42639863b4ea2268a265 HTTP/1.1" status: 200  len: 375 time: 0.0166595
Jun 03 08:38:33.807459 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-123d9eb5-8c71-44b5-9e64-ac398522be04 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=db653c0bf0ab42639863b4ea2268a265&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0835695
Jun 03 08:38:33.974001 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-2ca02e0a-1c8a-4f21-bba8-a2251748552e service neutron] 10.222.0.11 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1540945
Jun 03 08:38:34.123246 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-160ed838-254c-485a-a3c6-791b10a11f41 service neutron] 10.222.0.11 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1470799
Jun 03 08:38:34.803962 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:34.918734 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77a0f9aa-bf18-468e-b6f1-4b30277d0965 req-f72c66d5-3ff7-49c8-a691-74d5164b533d tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:34.921695 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-77a0f9aa-bf18-468e-b6f1-4b30277d0965 req-f72c66d5-3ff7-49c8-a691-74d5164b533d tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 944 time: 0.1151228
Jun 03 08:38:35.039744 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-77a0f9aa-bf18-468e-b6f1-4b30277d0965 req-b6bc0f2a-5c82-488c-9734-08dbde776347 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1103244
Jun 03 08:38:35.158130 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b867e462-7123-4441-a0da-086ac4533663 req-1b24338f-26ac-4119-915b-f50b81357115 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 210 time: 0.2227826
Jun 03 08:38:35.381540 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-3c7b1ee0-c87e-4821-88ad-001fa724af81 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:36.272417 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:36.299814 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c994b990-a504-4a2f-8573-c397014f0c0e req-2ac92664-8c67-4152-9fef-a3ed2348b4dd tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 210 time: 0.0653253
Jun 03 08:38:36.331864 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94eb3cd8-0c75-4307-8338-dfd6f5abbee1 req-236fcb96-298a-4b6a-89a0-102fdbfffe18 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:36.334986 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-94eb3cd8-0c75-4307-8338-dfd6f5abbee1 req-236fcb96-298a-4b6a-89a0-102fdbfffe18 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 944 time: 0.1189971
Jun 03 08:38:36.384881 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-94eb3cd8-0c75-4307-8338-dfd6f5abbee1 req-58d2da6a-32bc-4c96-9804-a61590274f3d tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0447760
Jun 03 08:38:37.472560 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fafd55eb-4eab-4a1a-8322-05c26badbef0 req-f874c669-d321-4e5c-8039-8042d52dce38 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 210 time: 0.0482740
Jun 03 08:38:37.629820 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ef82430-8d06-4016-941d-3cc55158ef3c req-359e0ac5-b6b6-4baa-bc91-fbd1a3148192 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:37.631471 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0ef82430-8d06-4016-941d-3cc55158ef3c req-359e0ac5-b6b6-4baa-bc91-fbd1a3148192 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 944 time: 0.0880723
Jun 03 08:38:37.680485 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0ef82430-8d06-4016-941d-3cc55158ef3c req-88bf55cb-03c0-4938-bf47-3c8bd685f65a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0415363
Jun 03 08:38:38.134636 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:38.625555 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-979e428d-39c1-45b7-9f16-fb94410cf6da req-382981a2-5c67-44b2-97ea-dc80d9bfe554 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 210 time: 0.0433195
Jun 03 08:38:38.882199 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76224ae0-6d67-470a-8891-0d006bd89589 req-d969c17c-0277-4b26-a2d9-1c387f27a927 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:38.883684 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-76224ae0-6d67-470a-8891-0d006bd89589 req-d969c17c-0277-4b26-a2d9-1c387f27a927 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 944 time: 0.0854552
Jun 03 08:38:38.931933 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-76224ae0-6d67-470a-8891-0d006bd89589 req-bb2ed328-b432-494b-bcbf-338ed80b0144 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0425594
Jun 03 08:38:39.779199 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6f9fff40-4b2c-4fad-9bda-a1640060ea7f req-b31cc76c-2f1e-4270-9f59-3f07f65fe1d5 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 210 time: 0.0438185
Jun 03 08:38:40.132533 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90971717-e2a3-423d-8388-bd8e94a34a49 req-0a636426-7da5-4abe-b91e-b5e91d32b0fe tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:40.134069 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-90971717-e2a3-423d-8388-bd8e94a34a49 req-0a636426-7da5-4abe-b91e-b5e91d32b0fe tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 944 time: 0.0908833
Jun 03 08:38:40.187491 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-90971717-e2a3-423d-8388-bd8e94a34a49 req-c3f02702-9dd6-4eb7-b71a-2a85dd9a2f29 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0433364
Jun 03 08:38:40.332002 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 1837d7d5-12fa-4414-9722-e593f5ed4c48 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:38:40.491359 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 1837d7d5-12fa-4414-9722-e593f5ed4c48, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=1837d7d5-12fa-4414-9722-e593f5ed4c48,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:38:40.504653 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': '1837d7d5-12fa-4414-9722-e593f5ed4c48', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'port_id': '1837d7d5-12fa-4414-9722-e593f5ed4c48', 'mac_address': 'fa:16:3e:ee:f3:ae', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 526, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:38:40.575604 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:40.593340 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1837d7d5-12fa-4414-9722-e593f5ed4c48 {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:38:40.608795 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 1837d7d5-12fa-4414-9722-e593f5ed4c48, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=1837d7d5-12fa-4414-9722-e593f5ed4c48,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:38:40.933853 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-293c6b5d-4fe2-4283-acc7-c24f0714d8fb req-26fc1377-ca1f-4b29-b68c-c2a982e004e4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 210 time: 0.0494416
Jun 03 08:38:41.164075 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:41.168245 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-cc769d0a-abcb-46b4-a3f3-6406d47bc5db None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:41.237198 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=1837d7d5-12fa-4414-9722-e593f5ed4c48,revision_number=9']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:41.240780 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:41.369405 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['1837d7d5-12fa-4414-9722-e593f5ed4c48'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:38:41.497859 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-371dca99-0555-4c8f-9ba4-ab23ad5fd30c req-d8b80fcc-736c-47d5-8bd3-b614101c9e33 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:41.499581 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-371dca99-0555-4c8f-9ba4-ab23ad5fd30c req-d8b80fcc-736c-47d5-8bd3-b614101c9e33 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 945 time: 0.1993096
Jun 03 08:38:41.557008 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-371dca99-0555-4c8f-9ba4-ab23ad5fd30c req-440ebff6-cb3e-4a7f-8455-083d3d51120e tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0515168
Jun 03 08:38:41.596978 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-a5393e2a-5556-4a9d-a172-4034efe76766 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:41.598439 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-a5393e2a-5556-4a9d-a172-4034efe76766 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.55 "GET /v2.0/networks?id=7722e8fc-e6a8-422f-8456-a3c594da293a HTTP/1.1" status: 200  len: 812 time: 0.1834507
Jun 03 08:38:41.648393 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-acc9bee5-4b66-4992-b1d1-877fe7741cb5 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.55 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=db653c0bf0ab42639863b4ea2268a265 HTTP/1.1" status: 200  len: 380 time: 0.0399806
Jun 03 08:38:41.659013 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-fe31f79e-9abd-444b-9b56-1aa6348955ee tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Request body: {'port': {'device_id': 'fb968b3c-aeca-41a4-b10a-1baf38dc4151', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'admin_state_up': True, 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'security_groups': ['fe784a5d-57d4-414f-8feb-b263c44efaf6']}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:38:41.794969 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-fe31f79e-9abd-444b-9b56-1aa6348955ee tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:38:41.799032 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-fe31f79e-9abd-444b-9b56-1aa6348955ee tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Usage tracker for resource:port and tenant:db653c0bf0ab42639863b4ea2268a265 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:38:41.801778 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-fe31f79e-9abd-444b-9b56-1aa6348955ee tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Quota usage for port was recalculated. Used quota:2. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:38:41.807783 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-fe31f79e-9abd-444b-9b56-1aa6348955ee tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:38:41.901155 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-fe31f79e-9abd-444b-9b56-1aa6348955ee tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Made reservation on behalf of db653c0bf0ab42639863b4ea2268a265 for: {'port': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:38:41.904728 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-fe31f79e-9abd-444b-9b56-1aa6348955ee tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:42.103140 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-09680278-e5dc-469b-9808-df32e7547a09 req-a9172c69-e4ff-4d1a-a65c-372e48a47cd2 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 210 time: 0.0467887
Jun 03 08:38:42.114790 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-fe31f79e-9abd-444b-9b56-1aa6348955ee tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Allocated IP 172.20.0.10 (7722e8fc-e6a8-422f-8456-a3c594da293a/3eb5b6e1-724c-48ab-a49b-2b1fa5adb401/254571a2-c7f3-4505-bb99-ea3fbf4f484b) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:38:42.313381 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-fe31f79e-9abd-444b-9b56-1aa6348955ee tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:42.329199 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-fe31f79e-9abd-444b-9b56-1aa6348955ee tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Transition to ACTIVE for port object 254571a2-c7f3-4505-bb99-ea3fbf4f484b will not be triggered until provisioned by entity DHCP. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:38:42.356802 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 1837d7d5-12fa-4414-9722-e593f5ed4c48 up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:38:42.423558 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port 1837d7d5-12fa-4414-9722-e593f5ed4c48 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:38:42.424235 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:42.479240 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-fe31f79e-9abd-444b-9b56-1aa6348955ee tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:42.487206 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:42.542030 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:42.555831 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-fe31f79e-9abd-444b-9b56-1aa6348955ee tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Network 7722e8fc-e6a8-422f-8456-a3c594da293a is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:38:42.558897 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-fe31f79e-9abd-444b-9b56-1aa6348955ee tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:38:42.562672 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-fe31f79e-9abd-444b-9b56-1aa6348955ee tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:38:42.568938 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '41d57543-e5c8-45b5-8eef-2f829250eec3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1837d7d5-12fa-4414-9722-e593f5ed4c48'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:38:42.571311 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-80ec1f35-75ee-4a5e-bb71-c55e83f57d28" -d '{"events": [{"server_uuid": "41d57543-e5c8-45b5-8eef-2f829250eec3", "name": "network-vif-plugged", "status": "completed", "tag": "1837d7d5-12fa-4414-9722-e593f5ed4c48"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:38:42.580483 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 1837d7d5-12fa-4414-9722-e593f5ed4c48, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=1837d7d5-12fa-4414-9722-e593f5ed4c48,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:38:42.618810 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe31f79e-9abd-444b-9b56-1aa6348955ee tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event updated for resources: {'Port': ['ID=254571a2-c7f3-4505-bb99-ea3fbf4f484b,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:42.620235 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-fe31f79e-9abd-444b-9b56-1aa6348955ee tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:42.638114 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:38:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8433848a-3195-41b1-bc25-de2bf562e68d x-openstack-request-id: req-8433848a-3195-41b1-bc25-de2bf562e68d {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:38:42.638417 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "41d57543-e5c8-45b5-8eef-2f829250eec3", "name": "network-vif-plugged", "status": "completed", "tag": "1837d7d5-12fa-4414-9722-e593f5ed4c48", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:38:42.638703 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-8433848a-3195-41b1-bc25-de2bf562e68d {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:38:42.639095 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '41d57543-e5c8-45b5-8eef-2f829250eec3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1837d7d5-12fa-4414-9722-e593f5ed4c48', 'code': 200}
Jun 03 08:38:42.649157 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-fe31f79e-9abd-444b-9b56-1aa6348955ee tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:42.649879 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-fe31f79e-9abd-444b-9b56-1aa6348955ee tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:42.778696 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3d660be-3685-47aa-9bda-7ec04cc008be req-d23373a1-faab-4369-bc15-78d36c69624d tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:42.780187 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c3d660be-3685-47aa-9bda-7ec04cc008be req-d23373a1-faab-4369-bc15-78d36c69624d tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 945 time: 0.0922525
Jun 03 08:38:42.786047 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:42.789329 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:42.828563 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c3d660be-3685-47aa-9bda-7ec04cc008be req-6e025af1-0406-4253-ad18-2355f6ab09ae tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0413368
Jun 03 08:38:42.851874 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-fe31f79e-9abd-444b-9b56-1aa6348955ee tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.55 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.1966689
Jun 03 08:38:42.868891 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Request body: {'port': {'device_id': 'fb968b3c-aeca-41a4-b10a-1baf38dc4151', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:38:42.869973 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=1837d7d5-12fa-4414-9722-e593f5ed4c48,revision_number=10']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:42.873288 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:42.958909 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-5ddab7fa-5f83-4046-bf8a-416e76def00e None None] Provisioning for port 254571a2-c7f3-4505-bb99-ea3fbf4f484b completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:38:42.964265 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-5ddab7fa-5f83-4046-bf8a-416e76def00e None None] Provisioning complete for port 254571a2-c7f3-4505-bb99-ea3fbf4f484b triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:38:42.964839 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5ddab7fa-5f83-4046-bf8a-416e76def00e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:42.985235 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:43.023623 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-5ddab7fa-5f83-4046-bf8a-416e76def00e None None] Port 254571a2-c7f3-4505-bb99-ea3fbf4f484b cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:38:43.027831 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 55578) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:43.169672 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-3d4cc85d-ebe9-4d15-adc3-e211b9812134 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:43.187795 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-3d4cc85d-ebe9-4d15-adc3-e211b9812134 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:38:43.192475 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-3d4cc85d-ebe9-4d15-adc3-e211b9812134 admin admin] Usage tracker for resource:security_group_rule and tenant:ef591a7329eb4d6fb8f87c273d1d5a38 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:38:43.195481 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-3d4cc85d-ebe9-4d15-adc3-e211b9812134 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:38:43.201410 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-3d4cc85d-ebe9-4d15-adc3-e211b9812134 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:38:43.361419 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a9fda03-e2e8-4921-8a27-1ac315c6a743 req-ab5bbbaa-c060-4347-82f9-ffccfd14546e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:43.362094 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-2a9fda03-e2e8-4921-8a27-1ac315c6a743 req-ab5bbbaa-c060-4347-82f9-ffccfd14546e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Synchronizing usage tracker for tenant:db653c0bf0ab42639863b4ea2268a265 on resource:port {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:38:43.369158 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-3d4cc85d-ebe9-4d15-adc3-e211b9812134 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:43.407670 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5ac648e-8b6a-4a96-8983-add8efa49ab5 req-d280bb8e-d39a-4d20-a7a2-ef609cc4e94f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:43.409171 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d5ac648e-8b6a-4a96-8983-add8efa49ab5 req-d280bb8e-d39a-4d20-a7a2-ef609cc4e94f service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 1100 time: 0.2753773
Jun 03 08:38:43.470146 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d5ac648e-8b6a-4a96-8983-add8efa49ab5 req-ef36eb3c-e498-4224-8c22-9a26c0461a42 service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0490928
Jun 03 08:38:43.484403 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-2a9fda03-e2e8-4921-8a27-1ac315c6a743 req-ab5bbbaa-c060-4347-82f9-ffccfd14546e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Unset dirty status for tenant:db653c0bf0ab42639863b4ea2268a265 on resource:port {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:38:43.489448 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2a9fda03-e2e8-4921-8a27-1ac315c6a743 req-ab5bbbaa-c060-4347-82f9-ffccfd14546e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 932 time: 0.2622187
Jun 03 08:38:43.489448 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-3d4cc85d-ebe9-4d15-adc3-e211b9812134 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:43.494764 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-4daad0ad-2ae5-43cc-8c4d-68ea4c3e015c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:43.535693 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 254571a2-c7f3-4505-bb99-ea3fbf4f484b {{(pid=92323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:38:43.542859 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:43.556970 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Transition to ACTIVE for port object 254571a2-c7f3-4505-bb99-ea3fbf4f484b will not be triggered until provisioned by entity L2. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:38:43.568961 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-3d4cc85d-ebe9-4d15-adc3-e211b9812134 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=ef591a7329eb4d6fb8f87c273d1d5a38&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5399706
Jun 03 08:38:43.571585 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 55584) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:43.571757 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d4cc85d-ebe9-4d15-adc3-e211b9812134 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9fba2c06-119e-4634-a938-6d7a15bdd917,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:43.576003 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-3d4cc85d-ebe9-4d15-adc3-e211b9812134 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:43.579385 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-2a9fda03-e2e8-4921-8a27-1ac315c6a743 req-efdeb4fc-069e-479e-8957-c8985c539731 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0857582
Jun 03 08:38:43.630844 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b2c46e40-d7b2-4a00-8293-43660b729d0d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:43.651700 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14211294'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:43.661440 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-7f4b5042-f722-41ff-ad97-22e45d28a8fc tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:43.690571 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b2c46e40-d7b2-4a00-8293-43660b729d0d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:43.823876 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Pushing event updated for resources: {'Port': ['ID=254571a2-c7f3-4505-bb99-ea3fbf4f484b,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:43.850636 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:43.944810 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Attempting to bind port 254571a2-c7f3-4505-bb99-ea3fbf4f484b on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:38:43.945290 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Attempting to bind port 254571a2-c7f3-4505-bb99-ea3fbf4f484b by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': 'fd0545c3-e436-4d2f-9d2d-71983702d34f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a'}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:38:43.945674 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Attempting to bind port 254571a2-c7f3-4505-bb99-ea3fbf4f484b on network 7722e8fc-e6a8-422f-8456-a3c594da293a {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:38:43.981275 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Port 254571a2-c7f3-4505-bb99-ea3fbf4f484b on network 7722e8fc-e6a8-422f-8456-a3c594da293a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 03 08:38:43.981540 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Attempting to bind port 254571a2-c7f3-4505-bb99-ea3fbf4f484b on network 7722e8fc-e6a8-422f-8456-a3c594da293a {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:38:43.995701 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Checking agent: {'id': '181c5753-100b-4f03-bda8-e34279b057f4', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'started_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 38, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:38:43.996030 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Checking segment: {'id': 'fd0545c3-e436-4d2f-9d2d-71983702d34f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:38:43.996425 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Bound using segment: {'id': 'fd0545c3-e436-4d2f-9d2d-71983702d34f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a'} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:38:43.996829 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Bound port: 254571a2-c7f3-4505-bb99-ea3fbf4f484b, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fd0545c3-e436-4d2f-9d2d-71983702d34f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a'}}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:38:43.997166 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:44.008415 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b2c46e40-d7b2-4a00-8293-43660b729d0d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:44.016307 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f0d95c06-a21e-4476-86d8-870e09d42ec3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:44.066423 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2c46e40-d7b2-4a00-8293-43660b729d0d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9fba2c06-119e-4634-a938-6d7a15bdd917,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:44.075375 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b2c46e40-d7b2-4a00-8293-43660b729d0d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:44.092958 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-b2c46e40-d7b2-4a00-8293-43660b729d0d admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:44.092958 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-b2c46e40-d7b2-4a00-8293-43660b729d0d admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/9fba2c06-119e-4634-a938-6d7a15bdd917 HTTP/1.1" status: 204  len: 168 time: 0.5188699
Jun 03 08:38:44.142291 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ab23891-c77e-46b7-9161-8d7453f108cf req-91f6f6ef-73aa-4985-b2b9-71b902b4bda9 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:44.143804 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6ab23891-c77e-46b7-9161-8d7453f108cf req-91f6f6ef-73aa-4985-b2b9-71b902b4bda9 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 947 time: 0.1945274
Jun 03 08:38:44.144833 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] For port 254571a2-c7f3-4505-bb99-ea3fbf4f484b, host hv-cinder-78726, cleared binding levels {{(pid=92323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:38:44.148783 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] For port 254571a2-c7f3-4505-bb99-ea3fbf4f484b, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=254571a2-c7f3-4505-bb99-ea3fbf4f484b,segment=NetworkSegment(fd0545c3-e436-4d2f-9d2d-71983702d34f),segment_id=fd0545c3-e436-4d2f-9d2d-71983702d34f)] {{(pid=92323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:38:44.190988 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6ab23891-c77e-46b7-9161-8d7453f108cf req-a65bcb53-cafc-4476-9d17-13906804ea46 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0407960
Jun 03 08:38:44.243060 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14211294'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:44.246947 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-77d6c140-dd68-4328-9320-5b696ac2e322 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:44.311316 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:44.311694 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:44.313135 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] 10.222.0.55 "PUT /v2.0/ports/254571a2-c7f3-4505-bb99-ea3fbf4f484b HTTP/1.1" status: 200  len: 1094 time: 1.4485693
Jun 03 08:38:44.313696 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fb968b3c-aeca-41a4-b10a-1baf38dc4151', 'tag': '254571a2-c7f3-4505-bb99-ea3fbf4f484b'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:38:44.316376 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-49b106ea-9b83-4d06-aab4-a44167c0215e" -d '{"events": [{"name": "network-changed", "server_uuid": "fb968b3c-aeca-41a4-b10a-1baf38dc4151", "tag": "254571a2-c7f3-4505-bb99-ea3fbf4f484b"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:38:44.335270 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Pushing event updated for resources: {'Port': ['ID=254571a2-c7f3-4505-bb99-ea3fbf4f484b,revision_number=3']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:44.339413 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:44.400105 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:38:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8389df9f-137f-40d6-8dda-d0e2d4f9c00f x-openstack-request-id: req-8389df9f-137f-40d6-8dda-d0e2d4f9c00f {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:38:44.400431 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fb968b3c-aeca-41a4-b10a-1baf38dc4151", "tag": "254571a2-c7f3-4505-bb99-ea3fbf4f484b", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:38:44.400711 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-8389df9f-137f-40d6-8dda-d0e2d4f9c00f {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:38:44.401131 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fb968b3c-aeca-41a4-b10a-1baf38dc4151', 'tag': '254571a2-c7f3-4505-bb99-ea3fbf4f484b', 'status': 'completed', 'code': 200}
Jun 03 08:38:44.523490 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49b106ea-9b83-4d06-aab4-a44167c0215e req-ab57ea9c-64bd-45f3-bcdb-82290ef2b944 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:44.525087 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-49b106ea-9b83-4d06-aab4-a44167c0215e req-ab57ea9c-64bd-45f3-bcdb-82290ef2b944 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=db653c0bf0ab42639863b4ea2268a265&device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 1097 time: 0.0828536
Jun 03 08:38:44.680496 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49b106ea-9b83-4d06-aab4-a44167c0215e req-7772e8b1-4532-47ef-8ca7-fabc8178cfda service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:44.681982 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-49b106ea-9b83-4d06-aab4-a44167c0215e req-7772e8b1-4532-47ef-8ca7-fabc8178cfda service neutron] 10.222.0.55 "GET /v2.0/networks?tenant_id=db653c0bf0ab42639863b4ea2268a265&shared=False HTTP/1.1" status: 200  len: 913 time: 0.1482766
Jun 03 08:38:44.877296 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49b106ea-9b83-4d06-aab4-a44167c0215e req-c242015e-f520-40ba-8119-91607294aff1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:44.878786 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-49b106ea-9b83-4d06-aab4-a44167c0215e req-c242015e-f520-40ba-8119-91607294aff1 service neutron] 10.222.0.55 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1896245
Jun 03 08:38:44.886261 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb224359-46a3-4a43-911a-6f3ad44b5f21 req-79d59086-cf6b-41d7-a2dc-9fcd960c5a05 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:44.887004 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-bb224359-46a3-4a43-911a-6f3ad44b5f21 req-79d59086-cf6b-41d7-a2dc-9fcd960c5a05 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Synchronizing usage tracker for tenant:db653c0bf0ab42639863b4ea2268a265 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:38:44.901386 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-bb224359-46a3-4a43-911a-6f3ad44b5f21 req-79d59086-cf6b-41d7-a2dc-9fcd960c5a05 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Unset dirty status for tenant:db653c0bf0ab42639863b4ea2268a265 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:38:44.902537 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-bb224359-46a3-4a43-911a-6f3ad44b5f21 req-79d59086-cf6b-41d7-a2dc-9fcd960c5a05 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 944 time: 0.1948030
Jun 03 08:38:44.936410 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 55622) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:44.954977 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-57888798-b56e-4df2-9c68-15d441093b95 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:44.969459 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-57888798-b56e-4df2-9c68-15d441093b95 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:38:44.974325 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-57888798-b56e-4df2-9c68-15d441093b95 admin admin] Usage tracker for resource:security_group_rule and tenant:0117d929d6944551987d82d2598b072b is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:38:44.977593 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-57888798-b56e-4df2-9c68-15d441093b95 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:38:44.984170 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-57888798-b56e-4df2-9c68-15d441093b95 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:38:44.995302 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-bb224359-46a3-4a43-911a-6f3ad44b5f21 req-ebe4be01-176d-41ac-b989-058b2ce4aa39 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0859017
Jun 03 08:38:45.026554 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-b2eea8a4-b798-4bbc-803d-ad99146d106a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:45.028019 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-b2eea8a4-b798-4bbc-803d-ad99146d106a service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=db653c0bf0ab42639863b4ea2268a265&device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 1097 time: 0.0817790
Jun 03 08:38:45.068419 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-57888798-b56e-4df2-9c68-15d441093b95 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:45.096919 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-a3793cc7-6ac4-480c-8aa6-ae70a6d986b5 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=254571a2-c7f3-4505-bb99-ea3fbf4f484b HTTP/1.1" status: 200  len: 217 time: 0.0614355
Jun 03 08:38:45.141021 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-57888798-b56e-4df2-9c68-15d441093b95 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:45.150714 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-7a9c93f7-ae1b-4f91-8765-212fccb42c82 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:45.167371 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-924a226d-ce21-4efd-8c52-f6bd7a969c9f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:45.168887 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-924a226d-ce21-4efd-8c52-f6bd7a969c9f service neutron] 10.222.0.55 "GET /v2.0/subnets?id=3eb5b6e1-724c-48ab-a49b-2b1fa5adb401 HTTP/1.1" status: 200  len: 851 time: 0.0658140
Jun 03 08:38:45.191738 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57888798-b56e-4df2-9c68-15d441093b95 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=85753201-19a2-4e2f-a9d2-d2b585d4c454,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:45.196045 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-57888798-b56e-4df2-9c68-15d441093b95 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=0117d929d6944551987d82d2598b072b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2578528
Jun 03 08:38:45.196932 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-57888798-b56e-4df2-9c68-15d441093b95 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:45.198800 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 55632) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:45.259356 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-fc13dbd5-30a7-4c7e-b143-61d56095783f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:45.260791 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-fc13dbd5-30a7-4c7e-b143-61d56095783f service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=7722e8fc-e6a8-422f-8456-a3c594da293a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0852654
Jun 03 08:38:45.270106 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e95138b5-d093-40e5-b85c-1a65266614fe admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:45.297570 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e95138b5-d093-40e5-b85c-1a65266614fe admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:45.427987 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ed9b1f0-4090-47ea-b510-57250385ed9d req-10827f33-f9b2-4ae0-aeb2-3e0786734d9b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:45.436140 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-1ed9b1f0-4090-47ea-b510-57250385ed9d req-10827f33-f9b2-4ae0-aeb2-3e0786734d9b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 947 time: 0.1184540
Jun 03 08:38:45.485977 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-1ed9b1f0-4090-47ea-b510-57250385ed9d req-30f242f1-c51b-4bee-9f92-e62d519a1cff tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0487003
Jun 03 08:38:45.500417 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e95138b5-d093-40e5-b85c-1a65266614fe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:45.517604 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-a76a1728-ddc7-4340-a6ed-6a51d5fee7a3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:45.535338 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e95138b5-d093-40e5-b85c-1a65266614fe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=85753201-19a2-4e2f-a9d2-d2b585d4c454,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:45.539748 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e95138b5-d093-40e5-b85c-1a65266614fe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:45.543213 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-45aff2a0-4768-4012-af30-e3912c9ac6f5 service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2752702
Jun 03 08:38:45.550900 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e95138b5-d093-40e5-b85c-1a65266614fe admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:45.554548 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-e95138b5-d093-40e5-b85c-1a65266614fe admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/85753201-19a2-4e2f-a9d2-d2b585d4c454 HTTP/1.1" status: 204  len: 168 time: 0.3524945
Jun 03 08:38:45.708563 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ecd8a0dc-9642-4743-a901-63bb1880ec9f req-43b3b2dc-b9f7-47fc-9fde-f5195b670c3b service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1527064
Jun 03 08:38:46.192424 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b2d2088-141e-4dd0-a4cc-bd2972606d32 req-101663a5-78d0-4c36-92d9-6a623dcc825c tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:46.194454 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9b2d2088-141e-4dd0-a4cc-bd2972606d32 req-101663a5-78d0-4c36-92d9-6a623dcc825c tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 944 time: 0.0915539
Jun 03 08:38:46.245360 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9b2d2088-141e-4dd0-a4cc-bd2972606d32 req-b2172240-a011-4864-a992-144f645a233d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0453160
Jun 03 08:38:46.685678 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24fb28ea-a9fe-44bd-ba7e-df1c588c28c2 req-22543571-0267-4511-8453-a85492ad70fa tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:46.687194 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-24fb28ea-a9fe-44bd-ba7e-df1c588c28c2 req-22543571-0267-4511-8453-a85492ad70fa tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 947 time: 0.0845630
Jun 03 08:38:46.734076 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-24fb28ea-a9fe-44bd-ba7e-df1c588c28c2 req-06f456fa-4523-4a9a-86d8-6ae80040194a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0408278
Jun 03 08:38:46.784632 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 55662) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:46.885509 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-755727911-network', 'tenant_id': '45f4a8c8d0d84e8981fb1a9ad77403d7'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:38:46.890149 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:38:46.898151 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Usage tracker for resource:network and tenant:45f4a8c8d0d84e8981fb1a9ad77403d7 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:38:46.901114 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:38:46.907244 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:38:46.998397 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Made reservation on behalf of 45f4a8c8d0d84e8981fb1a9ad77403d7 for: {'network': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:38:47.000668 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-676039'] for network, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:47.013318 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:47.027795 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:38:47.031465 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Usage tracker for resource:security_group_rule and tenant:45f4a8c8d0d84e8981fb1a9ad77403d7 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:38:47.034445 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:38:47.040111 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:38:47.123773 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:47.209342 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:47.212319 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-6f464e8e-fe6a-4229-a466-81b6a80a146a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:47.242852 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] vlan segment allocate from pool success with {'vlan_id': 523, 'physical_network': 'physnet1'}  {{(pid=92324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 03 08:38:47.247980 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c88e865c-e495-465c-84d1-5c424740df16,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:47.252106 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:47.255720 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:47.259298 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.segments_db [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Added segment dd5e6844-f9b1-450a-b170-6d582de05fbb of type vlan for network ae766a30-f45d-4c43-8742-e5d8554ec245
Jun 03 08:38:47.281868 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8774223827658'] for network, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:47.380102 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820'] for network, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:47.381525 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:47.382120 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:47.387078 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:47.428662 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d27f6e9-e195-4a28-b49b-02f7925b2609 req-93b84e43-ef80-4727-9a61-34b3c8419b22 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:47.430370 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3d27f6e9-e195-4a28-b49b-02f7925b2609 req-93b84e43-ef80-4727-9a61-34b3c8419b22 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 944 time: 0.0785463
Jun 03 08:38:47.479423 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3d27f6e9-e195-4a28-b49b-02f7925b2609 req-6830e736-373c-44cc-801b-6c4380845957 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0429826
Jun 03 08:38:47.490814 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Pushing event updated for resources: {'Network': ['ID=ae766a30-f45d-4c43-8742-e5d8554ec245,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:47.493895 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:47.501158 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Network ae766a30-f45d-4c43-8742-e5d8554ec245 details requested by agent ovs-agent-dv-cinder-787262-5-iscsi with host dv-cinder-787262-5-iscsi {{(pid=92325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 03 08:38:47.541676 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 0.7559335
Jun 03 08:38:47.544509 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 55670) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:47.549529 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-44da431f-4102-4707-9a92-ba881cd4a942 admin admin] Request body: {'subnet': {'network_id': 'ae766a30-f45d-4c43-8742-e5d8554ec245', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-755727911-subnet', 'tenant_id': '45f4a8c8d0d84e8981fb1a9ad77403d7', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:38:47.554342 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-44da431f-4102-4707-9a92-ba881cd4a942 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:38:47.558410 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-44da431f-4102-4707-9a92-ba881cd4a942 admin admin] Usage tracker for resource:subnet and tenant:45f4a8c8d0d84e8981fb1a9ad77403d7 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:38:47.561234 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-44da431f-4102-4707-9a92-ba881cd4a942 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:38:47.567043 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-44da431f-4102-4707-9a92-ba881cd4a942 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:38:47.637767 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-44da431f-4102-4707-9a92-ba881cd4a942 admin admin] Made reservation on behalf of 45f4a8c8d0d84e8981fb1a9ad77403d7 for: {'subnet': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:38:47.640170 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-44da431f-4102-4707-9a92-ba881cd4a942 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14870279'] for subnet, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:48.081900 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-44da431f-4102-4707-9a92-ba881cd4a942 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15641492', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14870385'] for subnet, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:48.085554 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-89302253-322f-4e5e-88d6-6adb48f1e09f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:48.157574 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44da431f-4102-4707-9a92-ba881cd4a942 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5b5b9ebb-32c7-4a72-9921-e204c717d5e2,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:48.161013 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-44da431f-4102-4707-9a92-ba881cd4a942 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:48.166644 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44da431f-4102-4707-9a92-ba881cd4a942 admin admin] Checking segment: {'id': 'dd5e6844-f9b1-450a-b170-6d582de05fbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 523, 'network_id': 'ae766a30-f45d-4c43-8742-e5d8554ec245'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:38:48.167000 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44da431f-4102-4707-9a92-ba881cd4a942 admin admin] Network hostable DHCP agents. Network: ae766a30-f45d-4c43-8742-e5d8554ec245, hostable agents: ['07372699-02ac-4239-816f-84b3a5b0eff9'], hosted agents: [] {{(pid=92324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 03 08:38:48.243563 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44da431f-4102-4707-9a92-ba881cd4a942 admin admin] Network ae766a30-f45d-4c43-8742-e5d8554ec245 is scheduled to be hosted by DHCP agent 07372699-02ac-4239-816f-84b3a5b0eff9 with binding_index 1 {{(pid=92324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 03 08:38:48.335421 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-44da431f-4102-4707-9a92-ba881cd4a942 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-5-iscsi, ae766a30-f45d-4c43-8742-e5d8554ec245) {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:38:48.345151 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea3070e7-9ec9-4cbe-aece-54337c8705f2 None None] Network ae766a30-f45d-4c43-8742-e5d8554ec245 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:38:48.346458 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44da431f-4102-4707-9a92-ba881cd4a942 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:48.347415 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-44da431f-4102-4707-9a92-ba881cd4a942 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:48.480592 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-44da431f-4102-4707-9a92-ba881cd4a942 admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.9275355
Jun 03 08:38:48.550267 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7fb256de-fce3-4273-8fe1-990c2e744709 None None] Network ae766a30-f45d-4c43-8742-e5d8554ec245 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:38:48.685863 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdda4032-f47a-4c19-848b-af198fc7ef07 req-3140e1ed-dbdf-4c5e-9606-a49af40d8561 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:48.687364 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-bdda4032-f47a-4c19-848b-af198fc7ef07 req-3140e1ed-dbdf-4c5e-9606-a49af40d8561 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 944 time: 0.0907009
Jun 03 08:38:48.737188 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-bdda4032-f47a-4c19-848b-af198fc7ef07 req-260bec81-81e8-4391-a948-c17e052c82e0 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0437834
Jun 03 08:38:49.234984 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 55690) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:49.240967 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1997314544-network', 'tenant_id': '9627efa7a27541729000521675cc16f9'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:38:49.248492 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:38:49.253406 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Usage tracker for resource:network and tenant:9627efa7a27541729000521675cc16f9 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:38:49.256247 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:38:49.261824 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:38:49.330995 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:38:49.334824 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Made reservation on behalf of 9627efa7a27541729000521675cc16f9 for: {'network': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:38:49.337237 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-676039'] for network, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:49.349774 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:49.364249 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:38:49.367999 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Usage tracker for resource:security_group_rule and tenant:9627efa7a27541729000521675cc16f9 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:38:49.370784 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:38:49.376492 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:38:49.459789 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:49.529250 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:49.533311 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-914a3dbd-cb81-4253-88ec-959cff9e9f7c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:49.561780 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] vlan segment allocate from pool success with {'vlan_id': 515, 'physical_network': 'physnet1'}  {{(pid=92324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 03 08:38:49.572483 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2588dbb7-8466-43b8-a38a-a9b2688933eb,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:49.577786 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:49.581126 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:49.581451 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.segments_db [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Added segment 5b0c8236-42e9-4ef1-bc3a-6af28a68d41c of type vlan for network a403a57f-3a04-459a-a7a1-4c12e89375ac
Jun 03 08:38:49.607352 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8774223827658'] for network, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:49.723828 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820'] for network, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:49.725090 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:49.725701 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:49.730689 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:49.923701 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Pushing event updated for resources: {'Network': ['ID=a403a57f-3a04-459a-a7a1-4c12e89375ac,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:49.926369 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:49.936403 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Network a403a57f-3a04-459a-a7a1-4c12e89375ac details requested by agent ovs-agent-dv-cinder-787262-5-iscsi with host dv-cinder-787262-5-iscsi {{(pid=92325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 03 08:38:49.945826 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec32be07-d809-42df-9914-125fd02ca703 req-ae29c731-79b2-4471-bdb2-e6de376a8f6b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:49.947334 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ec32be07-d809-42df-9914-125fd02ca703 req-ae29c731-79b2-4471-bdb2-e6de376a8f6b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 944 time: 0.0891893
Jun 03 08:38:49.994430 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ec32be07-d809-42df-9914-125fd02ca703 req-7c5ee308-ae75-4849-8372-986a916ab72d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0409925
Jun 03 08:38:50.005260 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-f8a0924f-b4bb-4860-8f2e-428c9dbc080d admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.7685061
Jun 03 08:38:50.007461 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 55694) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:50.012770 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-f6fad4d3-b6d4-462a-aa03-90228b1bb53f admin admin] Request body: {'subnet': {'network_id': 'a403a57f-3a04-459a-a7a1-4c12e89375ac', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1997314544-subnet', 'tenant_id': '9627efa7a27541729000521675cc16f9', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:38:50.018710 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-f6fad4d3-b6d4-462a-aa03-90228b1bb53f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:38:50.022871 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-f6fad4d3-b6d4-462a-aa03-90228b1bb53f admin admin] Usage tracker for resource:subnet and tenant:9627efa7a27541729000521675cc16f9 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:38:50.025906 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-f6fad4d3-b6d4-462a-aa03-90228b1bb53f admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:38:50.031727 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-f6fad4d3-b6d4-462a-aa03-90228b1bb53f admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:38:50.112514 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f6fad4d3-b6d4-462a-aa03-90228b1bb53f admin admin] Made reservation on behalf of 9627efa7a27541729000521675cc16f9 for: {'subnet': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:38:50.114960 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f6fad4d3-b6d4-462a-aa03-90228b1bb53f admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14870279'] for subnet, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:50.593415 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f6fad4d3-b6d4-462a-aa03-90228b1bb53f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15641492', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14870385'] for subnet, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:50.598070 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:50.670211 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6fad4d3-b6d4-462a-aa03-90228b1bb53f admin admin] Pushing event updated for resources: {'Subnet': ['ID=b9b37d51-88ba-4a11-bfb6-c6ed3edf5bf8,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:50.674743 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f6fad4d3-b6d4-462a-aa03-90228b1bb53f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:50.681792 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6fad4d3-b6d4-462a-aa03-90228b1bb53f admin admin] Checking segment: {'id': '5b0c8236-42e9-4ef1-bc3a-6af28a68d41c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 515, 'network_id': 'a403a57f-3a04-459a-a7a1-4c12e89375ac'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:38:50.682145 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f6fad4d3-b6d4-462a-aa03-90228b1bb53f admin admin] Network hostable DHCP agents. Network: a403a57f-3a04-459a-a7a1-4c12e89375ac, hostable agents: ['07372699-02ac-4239-816f-84b3a5b0eff9'], hosted agents: [] {{(pid=92324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 03 08:38:50.758216 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f6fad4d3-b6d4-462a-aa03-90228b1bb53f admin admin] Network a403a57f-3a04-459a-a7a1-4c12e89375ac is scheduled to be hosted by DHCP agent 07372699-02ac-4239-816f-84b3a5b0eff9 with binding_index 1 {{(pid=92324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 03 08:38:50.866544 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-f6fad4d3-b6d4-462a-aa03-90228b1bb53f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-5-iscsi, a403a57f-3a04-459a-a7a1-4c12e89375ac) {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:38:50.875095 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6fad4d3-b6d4-462a-aa03-90228b1bb53f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:50.875260 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-133e2cde-4cae-4475-b0b0-926b6131902f None None] Network a403a57f-3a04-459a-a7a1-4c12e89375ac requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:38:50.875681 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f6fad4d3-b6d4-462a-aa03-90228b1bb53f admin admin] Notify callbacks [] for subnet, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:50.970847 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-f6fad4d3-b6d4-462a-aa03-90228b1bb53f admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 0.9621880
Jun 03 08:38:51.084013 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-155a6944-bbee-4f68-8347-c86b662f6a3e None None] Network a403a57f-3a04-459a-a7a1-4c12e89375ac requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:38:51.201377 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c808125a-3baf-489e-ad74-7dca4676d8f3 req-2728e4fc-6fcb-47e0-8a0e-ed2ef4104f98 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:51.202945 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c808125a-3baf-489e-ad74-7dca4676d8f3 req-2728e4fc-6fcb-47e0-8a0e-ed2ef4104f98 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 944 time: 0.0928140
Jun 03 08:38:51.252673 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c808125a-3baf-489e-ad74-7dca4676d8f3 req-beceb8a1-0ba2-4083-b583-e781514bc738 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0421364
Jun 03 08:38:52.437947 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 254571a2-c7f3-4505-bb99-ea3fbf4f484b details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:38:52.460066 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c62b0c3c-18b6-4b80-9cca-1f6c2889220e req-890a0c25-7a54-44cc-8f26-8c5650c12472 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:52.462963 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c62b0c3c-18b6-4b80-9cca-1f6c2889220e req-890a0c25-7a54-44cc-8f26-8c5650c12472 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 944 time: 0.0898812
Jun 03 08:38:52.512399 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-c62b0c3c-18b6-4b80-9cca-1f6c2889220e req-5d2f08e0-c4d5-4718-9571-4915ffaf193c tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0442941
Jun 03 08:38:52.587907 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 254571a2-c7f3-4505-bb99-ea3fbf4f484b, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=254571a2-c7f3-4505-bb99-ea3fbf4f484b,segment=NetworkSegment(fd0545c3-e436-4d2f-9d2d-71983702d34f),segment_id=fd0545c3-e436-4d2f-9d2d-71983702d34f)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:38:52.601279 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': '254571a2-c7f3-4505-bb99-ea3fbf4f484b', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'port_id': '254571a2-c7f3-4505-bb99-ea3fbf4f484b', 'mac_address': 'fa:16:3e:61:05:58', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 506, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:38:52.662059 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:52.680229 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 254571a2-c7f3-4505-bb99-ea3fbf4f484b {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:38:52.696335 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 254571a2-c7f3-4505-bb99-ea3fbf4f484b, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=254571a2-c7f3-4505-bb99-ea3fbf4f484b,segment=NetworkSegment(fd0545c3-e436-4d2f-9d2d-71983702d34f),segment_id=fd0545c3-e436-4d2f-9d2d-71983702d34f)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:38:52.798669 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:52.800508 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-4bd15fe4-c979-456f-ac32-9a73904970b7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:52.865007 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=254571a2-c7f3-4505-bb99-ea3fbf4f484b,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:52.868027 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:53.043775 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['254571a2-c7f3-4505-bb99-ea3fbf4f484b'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:38:53.703664 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e733ff33-4b2a-46ab-9184-8588dfd5d5fb req-c2d65131-e0f5-489a-8dc3-363c3b96eb71 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:53.706188 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e733ff33-4b2a-46ab-9184-8588dfd5d5fb req-c2d65131-e0f5-489a-8dc3-363c3b96eb71 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 945 time: 0.0844772
Jun 03 08:38:53.750829 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e733ff33-4b2a-46ab-9184-8588dfd5d5fb req-92649745-f61e-442d-b85e-b8aa90c43217 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0387812
Jun 03 08:38:54.467050 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 254571a2-c7f3-4505-bb99-ea3fbf4f484b up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:38:54.597733 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning for port 254571a2-c7f3-4505-bb99-ea3fbf4f484b completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:38:54.602362 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port 254571a2-c7f3-4505-bb99-ea3fbf4f484b triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:38:54.602767 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:54.720994 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:54.747672 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fb968b3c-aeca-41a4-b10a-1baf38dc4151', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '254571a2-c7f3-4505-bb99-ea3fbf4f484b'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:38:54.749877 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ec81a8b0-6f4f-46a8-a2c4-e8694dd5ab6a" -d '{"events": [{"server_uuid": "fb968b3c-aeca-41a4-b10a-1baf38dc4151", "name": "network-vif-plugged", "status": "completed", "tag": "254571a2-c7f3-4505-bb99-ea3fbf4f484b"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:38:54.757897 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 254571a2-c7f3-4505-bb99-ea3fbf4f484b, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=254571a2-c7f3-4505-bb99-ea3fbf4f484b,segment=NetworkSegment(fd0545c3-e436-4d2f-9d2d-71983702d34f),segment_id=fd0545c3-e436-4d2f-9d2d-71983702d34f)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:38:54.793693 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:38:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7b1f5164-f388-41d1-b91b-56a66d2831e1 x-openstack-request-id: req-7b1f5164-f388-41d1-b91b-56a66d2831e1 {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:38:54.793994 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fb968b3c-aeca-41a4-b10a-1baf38dc4151", "name": "network-vif-plugged", "status": "completed", "tag": "254571a2-c7f3-4505-bb99-ea3fbf4f484b", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:38:54.794254 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-7b1f5164-f388-41d1-b91b-56a66d2831e1 {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:38:54.794678 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fb968b3c-aeca-41a4-b10a-1baf38dc4151', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '254571a2-c7f3-4505-bb99-ea3fbf4f484b', 'code': 200}
Jun 03 08:38:54.883967 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:54.885848 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:54.939031 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e107a4-c22d-4b5e-8728-657ef1e8a67b req-6142b593-be3f-4432-9f6f-dba7f24e02f2 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:54.940492 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d2e107a4-c22d-4b5e-8728-657ef1e8a67b req-6142b593-be3f-4432-9f6f-dba7f24e02f2 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 946 time: 0.0828376
Jun 03 08:38:54.951087 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=254571a2-c7f3-4505-bb99-ea3fbf4f484b,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:54.954776 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:54.985093 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-d2e107a4-c22d-4b5e-8728-657ef1e8a67b req-cf360391-d926-487b-a71f-0fe11acbabf8 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0387876
Jun 03 08:38:55.293314 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b81477d3-8597-4e31-b96b-680749518342 req-1cd7df81-0a7a-4d70-85ba-20b9374fd59c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:55.294831 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b81477d3-8597-4e31-b96b-680749518342 req-1cd7df81-0a7a-4d70-85ba-20b9374fd59c service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 1099 time: 0.0681219
Jun 03 08:38:55.337560 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b81477d3-8597-4e31-b96b-680749518342 req-22375e75-44e2-4e44-b9f6-0872e7d59921 service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0343914
Jun 03 08:38:56.141168 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:56.180603 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0b7eef3-97da-4c99-afc7-ed4408baac13 req-0950be9c-7fd8-4621-8d7d-d56948ba16b2 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:56.182060 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d0b7eef3-97da-4c99-afc7-ed4408baac13 req-0950be9c-7fd8-4621-8d7d-d56948ba16b2 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 946 time: 0.0829723
Jun 03 08:38:56.232086 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-d0b7eef3-97da-4c99-afc7-ed4408baac13 req-0bf05172-cdbc-4933-b56f-9e704bddf8b4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0425730
Jun 03 08:38:57.423484 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-385088ee-555c-4159-98f6-b14ec5dae4ea req-c866d46a-b341-438d-a571-37cdea32a234 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:57.424920 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-385088ee-555c-4159-98f6-b14ec5dae4ea req-c866d46a-b341-438d-a571-37cdea32a234 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 946 time: 0.0847487
Jun 03 08:38:57.470705 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-385088ee-555c-4159-98f6-b14ec5dae4ea req-9a918b1f-7ed9-40eb-b71d-8df730856a08 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0399542
Jun 03 08:38:57.656713 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6935634a-9055-4ca1-9474-7f5aacb45c50 req-bb6486df-7195-49cc-a1fa-70bd834409d1 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:57.658696 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6935634a-9055-4ca1-9474-7f5aacb45c50 req-bb6486df-7195-49cc-a1fa-70bd834409d1 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 946 time: 0.0807214
Jun 03 08:38:57.710102 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6935634a-9055-4ca1-9474-7f5aacb45c50 req-e6d63868-8aea-40bd-82d0-ec82148e74d6 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0456495
Jun 03 08:38:57.733127 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 55754) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:57.965818 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-60c3f049-4357-4583-b7b7-63da8a2be6e7 tempest-TestVolumeBootPattern-1749998531 tempest-TestVolumeBootPattern-1749998531-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:38:57.967683 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-60c3f049-4357-4583-b7b7-63da8a2be6e7 tempest-TestVolumeBootPattern-1749998531 tempest-TestVolumeBootPattern-1749998531-project-admin] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 1094 time: 0.2329812
Jun 03 08:38:57.970357 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 55758) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:38:57.974967 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Request body: {'floatingip': {'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'port_id': '254571a2-c7f3-4505-bb99-ea3fbf4f484b', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'fixed_ip_address': '172.20.0.10'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:38:57.980827 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:38:57.984588 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Usage tracker for resource:floatingip and tenant:db653c0bf0ab42639863b4ea2268a265 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:38:57.987974 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:38:57.994151 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:38:58.095289 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for floatingip, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:58.230974 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:58.363031 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Allocated IP 172.27.0.172 (684ef871-89aa-450d-ae0d-e232bfaf51fb/e7b58fba-1ed5-483b-b341-7736b2ffb853/52a19d3c-91d9-424b-8343-8fdc0cf11c2c) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:38:58.505648 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:58.592249 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:58.596944 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-fe31f79e-9abd-444b-9b56-1aa6348955ee tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:58.662153 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:38:58.664953 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:38:58.668543 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:38:58.703129 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event updated for resources: {'Port': ['ID=52a19d3c-91d9-424b-8343-8fdc0cf11c2c,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:58.708219 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:59.183173 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:59.355692 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:59.580090 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:59.677925 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14211294'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:59.683151 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-68f8b023-38e6-4cbd-9fe2-985e2995ae92 tempest-VolumesNegativeTest-1359797740 tempest-VolumesNegativeTest-1359797740-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:38:59.792868 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event updated for resources: {'Port': ['ID=52a19d3c-91d9-424b-8343-8fdc0cf11c2c,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:38:59.797457 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:38:59.803382 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16327919'] for floatingip, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:38:59.974572 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.db.l3_db [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Floating IP 8d72a0ec-fc93-4d28-ab68-b67c6c4fa370 associated. External IP: 172.27.0.172, port: 254571a2-c7f3-4505-bb99-ea3fbf4f484b.
Jun 03 08:39:00.332273 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:39:00.514819 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:39:00.524881 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5baeb63-698a-44e1-9449-b7b5aee8d8ad None None] Sync routers for ids ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'] in dv-cinder-787262-5-iscsi {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:39:00.534562 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5baeb63-698a-44e1-9449-b7b5aee8d8ad None None] Routers {'8d6b2faf-68a8-4edd-91ad-352b92d8cf84'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:39:00.535181 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-b5baeb63-698a-44e1-9449-b7b5aee8d8ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86b2d370>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:38:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:00.621148 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for floatingip, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:00.681673 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 2.7101691
Jun 03 08:39:00.682423 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fb968b3c-aeca-41a4-b10a-1baf38dc4151', 'tag': '254571a2-c7f3-4505-bb99-ea3fbf4f484b'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:39:00.684645 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ed90d862-c3f8-4aee-80a1-93c2cef87262" -d '{"events": [{"name": "network-changed", "server_uuid": "fb968b3c-aeca-41a4-b10a-1baf38dc4151", "tag": "254571a2-c7f3-4505-bb99-ea3fbf4f484b"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:39:00.723441 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-b5baeb63-698a-44e1-9449-b7b5aee8d8ad None None] Set router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:39:00.737109 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:39:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ac805f50-9982-4d0d-b8e1-c523493745f1 x-openstack-request-id: req-ac805f50-9982-4d0d-b8e1-c523493745f1 {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:39:00.737431 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fb968b3c-aeca-41a4-b10a-1baf38dc4151", "tag": "254571a2-c7f3-4505-bb99-ea3fbf4f484b", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:39:00.737715 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-ac805f50-9982-4d0d-b8e1-c523493745f1 {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:39:00.738140 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fb968b3c-aeca-41a4-b10a-1baf38dc4151', 'tag': '254571a2-c7f3-4505-bb99-ea3fbf4f484b', 'status': 'completed', 'code': 200}
Jun 03 08:39:00.953026 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed90d862-c3f8-4aee-80a1-93c2cef87262 req-0a9ef069-385b-462a-a687-d20d89563dd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:39:00.954499 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ed90d862-c3f8-4aee-80a1-93c2cef87262 req-0a9ef069-385b-462a-a687-d20d89563dd4 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=db653c0bf0ab42639863b4ea2268a265&device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 1099 time: 0.1955314
Jun 03 08:39:01.100596 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed90d862-c3f8-4aee-80a1-93c2cef87262 req-fdb011bb-d1dc-48d0-9ad4-f79255f420d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:39:01.100596 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ed90d862-c3f8-4aee-80a1-93c2cef87262 req-fdb011bb-d1dc-48d0-9ad4-f79255f420d7 service neutron] 10.222.0.55 "GET /v2.0/networks?id=7722e8fc-e6a8-422f-8456-a3c594da293a HTTP/1.1" status: 200  len: 913 time: 0.1356130
Jun 03 08:39:01.108411 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-b5baeb63-698a-44e1-9449-b7b5aee8d8ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86b2d370>, [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': '8d72a0ec-fc93-4d28-ab68-b67c6c4fa370', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'floating_ip_address': '172.27.0.172', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'port_id': '254571a2-c7f3-4505-bb99-ea3fbf4f484b', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 610, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'mac_address': 'fa:16:3e:61:05:58', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb968b3c-aeca-41a4-b10a-1baf38dc4151', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:38:59Z', 'updated_at': '2021-06-03T08:38:59Z', 'revision_number': 0, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1b247c7f-4ca7-44d5-97b2-94031de25c6e', 'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'mac_address': 'fa:16:3e:f4:70:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:51Z', 'updated_at': '2021-06-03T08:37:59Z', 'revision_number': 5, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'subnets': [{'id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:01.117285 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5baeb63-698a-44e1-9449-b7b5aee8d8ad None None] Checking router: 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 for host: dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:39:01.127860 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5baeb63-698a-44e1-9449-b7b5aee8d8ad None None] Routers {'8d6b2faf-68a8-4edd-91ad-352b92d8cf84'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:39:01.128483 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-b5baeb63-698a-44e1-9449-b7b5aee8d8ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86b2d370>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:38:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:01.216323 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ed90d862-c3f8-4aee-80a1-93c2cef87262 req-81f36484-4f83-41a9-9245-89dfe6f0a3dd service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=254571a2-c7f3-4505-bb99-ea3fbf4f484b HTTP/1.1" status: 200  len: 1000 time: 0.1138761
Jun 03 08:39:01.284250 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed90d862-c3f8-4aee-80a1-93c2cef87262 req-a3d07e46-1a8d-49a5-b6b7-d5e7ad634350 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:39:01.285683 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ed90d862-c3f8-4aee-80a1-93c2cef87262 req-a3d07e46-1a8d-49a5-b6b7-d5e7ad634350 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=3eb5b6e1-724c-48ab-a49b-2b1fa5adb401 HTTP/1.1" status: 200  len: 851 time: 0.0629032
Jun 03 08:39:01.314461 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-b5baeb63-698a-44e1-9449-b7b5aee8d8ad None None] Set router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:39:01.376365 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed90d862-c3f8-4aee-80a1-93c2cef87262 req-3fe816f1-a40e-4d99-8d42-aae61b4e986b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:39:01.378853 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ed90d862-c3f8-4aee-80a1-93c2cef87262 req-3fe816f1-a40e-4d99-8d42-aae61b4e986b service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=7722e8fc-e6a8-422f-8456-a3c594da293a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0845191
Jun 03 08:39:01.529975 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ed90d862-c3f8-4aee-80a1-93c2cef87262 req-826df6ea-6394-4fef-8c7d-4a782779d174 service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1411576
Jun 03 08:39:01.702706 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ed90d862-c3f8-4aee-80a1-93c2cef87262 req-397b072b-d18f-4d2b-ba6c-836f5918b717 service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1660120
Jun 03 08:39:01.938279 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-b5baeb63-698a-44e1-9449-b7b5aee8d8ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86b2d370>, [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': '8d72a0ec-fc93-4d28-ab68-b67c6c4fa370', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'floating_ip_address': '172.27.0.172', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'port_id': '254571a2-c7f3-4505-bb99-ea3fbf4f484b', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 610, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'mac_address': 'fa:16:3e:61:05:58', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb968b3c-aeca-41a4-b10a-1baf38dc4151', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:38:59Z', 'updated_at': '2021-06-03T08:38:59Z', 'revision_number': 0, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1b247c7f-4ca7-44d5-97b2-94031de25c6e', 'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'mac_address': 'fa:16:3e:f4:70:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:51Z', 'updated_at': '2021-06-03T08:37:59Z', 'revision_number': 5, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'subnets': [{'id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:01.940621 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5baeb63-698a-44e1-9449-b7b5aee8d8ad None None] The sync data for ids ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'] in dv-cinder-787262-5-iscsi is: [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': '8d72a0ec-fc93-4d28-ab68-b67c6c4fa370', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'floating_ip_address': '172.27.0.172', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'port_id': '254571a2-c7f3-4505-bb99-ea3fbf4f484b', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 610, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'mac_address': 'fa:16:3e:61:05:58', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb968b3c-aeca-41a4-b10a-1baf38dc4151', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:38:59Z', 'updated_at': '2021-06-03T08:38:59Z', 'revision_number': 0, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1b247c7f-4ca7-44d5-97b2-94031de25c6e', 'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'mac_address': 'fa:16:3e:f4:70:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:51Z', 'updated_at': '2021-06-03T08:37:59Z', 'revision_number': 5, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'subnets': [{'id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:39:01.946565 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b12d7d5c-6d4a-4543-9a23-9b2132bc9252 None None] New status for floating IP 8d72a0ec-fc93-4d28-ab68-b67c6c4fa370: ACTIVE {{(pid=92325) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 03 08:39:02.614827 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-fa4a0dd0-85a5-4250-9659-63d9e6b7b6e5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:04.912462 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:05.278260 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-2452a3fe-ceb1-4868-bfdc-0af1ff230727 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:06.221180 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:08.083496 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:11.096390 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 55848) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:11.156444 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_v2 [None req-d71c2a40-1a7b-432c-85ab-f1827d63c3b3 admin admin] Deleting subnet 5b5b9ebb-32c7-4a72-9921-e204c717d5e2 {{(pid=92323) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 03 08:39:11.159451 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d71c2a40-1a7b-432c-85ab-f1827d63c3b3 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:11.208404 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d71c2a40-1a7b-432c-85ab-f1827d63c3b3 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14518184'] for subnet, precommit_delete_associations {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:11.264032 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d71c2a40-1a7b-432c-85ab-f1827d63c3b3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-862421'] for subnet, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:11.620966 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d71c2a40-1a7b-432c-85ab-f1827d63c3b3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-862434', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14211216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14857862'] for subnet, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:11.624963 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-202b0576-d856-485e-8092-0532306fe0a4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:11.662390 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d71c2a40-1a7b-432c-85ab-f1827d63c3b3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5b5b9ebb-32c7-4a72-9921-e204c717d5e2,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:11.669471 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d71c2a40-1a7b-432c-85ab-f1827d63c3b3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:11.677437 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71c2a40-1a7b-432c-85ab-f1827d63c3b3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:11.677810 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71c2a40-1a7b-432c-85ab-f1827d63c3b3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:11.678175 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71c2a40-1a7b-432c-85ab-f1827d63c3b3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:11.678558 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71c2a40-1a7b-432c-85ab-f1827d63c3b3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:11.678916 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71c2a40-1a7b-432c-85ab-f1827d63c3b3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:11.679269 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71c2a40-1a7b-432c-85ab-f1827d63c3b3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:11.679683 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71c2a40-1a7b-432c-85ab-f1827d63c3b3 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:11.680291 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71c2a40-1a7b-432c-85ab-f1827d63c3b3 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:11.680640 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71c2a40-1a7b-432c-85ab-f1827d63c3b3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:11.680984 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71c2a40-1a7b-432c-85ab-f1827d63c3b3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:11.681329 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71c2a40-1a7b-432c-85ab-f1827d63c3b3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:11.681670 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71c2a40-1a7b-432c-85ab-f1827d63c3b3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:11.685217 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-d71c2a40-1a7b-432c-85ab-f1827d63c3b3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:11.687189 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-d71c2a40-1a7b-432c-85ab-f1827d63c3b3 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/5b5b9ebb-32c7-4a72-9921-e204c717d5e2 HTTP/1.1" status: 204  len: 168 time: 0.5884528
Jun 03 08:39:11.689671 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 55850) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:11.794393 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-3755d936-569e-4865-b052-1c639e5901a5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-529010'] for network, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:11.915505 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-3755d936-569e-4865-b052-1c639e5901a5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-862046', 'neutron.services.segments.db._delete_segments_for_network-8774224358894'] for network, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:11.928499 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-3755d936-569e-4865-b052-1c639e5901a5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fae85bcaa30>,) {'filters': {'network_id': ['ae766a30-f45d-4c43-8742-e5d8554ec245']}} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:11.940534 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-3755d936-569e-4865-b052-1c639e5901a5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fae85bcaa30>, 'dd5e6844-f9b1-450a-b170-6d582de05fbb') {'for_net_delete': True} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:11.940869 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-3755d936-569e-4865-b052-1c639e5901a5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fae85bcaa30>, 'dd5e6844-f9b1-450a-b170-6d582de05fbb') {} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:11.951806 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-3755d936-569e-4865-b052-1c639e5901a5 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8774224362253', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14518195'] for segment, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:11.967155 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-3755d936-569e-4865-b052-1c639e5901a5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:11.973550 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3755d936-569e-4865-b052-1c639e5901a5 admin admin] Releasing vlan 523 on physical network physnet1 to pool {{(pid=92323) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 03 08:39:11.973929 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-3755d936-569e-4865-b052-1c639e5901a5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14211322'] for segment, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]: Traceback (most recent call last):
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:     timer()
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:     cb(*args, **kw)
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:     return func(*args, **kwargs)
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:     self._notify()
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:     self.callback(batched_events)
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:     event.method(event)
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:     return f(self, *a, **k)
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self._get(url).json()
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self.request(url, 'GET', **kwargs)
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 03 08:39:11.986692 dv-cinder-787262-5-iscsi neutron-server[92323]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 03 08:39:12.272358 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-3755d936-569e-4865-b052-1c639e5901a5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-862039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16327709'] for network, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:12.276010 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:12.289602 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-3755d936-569e-4865-b052-1c639e5901a5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:12.299814 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3755d936-569e-4865-b052-1c639e5901a5 admin admin] Pushing event deleted for resources: {'Network': ['ID=ae766a30-f45d-4c43-8742-e5d8554ec245,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:12.302357 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-3755d936-569e-4865-b052-1c639e5901a5 admin admin] 10.222.0.11 "DELETE /v2.0/networks/ae766a30-f45d-4c43-8742-e5d8554ec245 HTTP/1.1" status: 204  len: 168 time: 0.6117857
Jun 03 08:39:12.303233 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-3755d936-569e-4865-b052-1c639e5901a5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:12.305449 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 55852) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:12.364228 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_v2 [None req-af4487c6-dd1b-433f-95f5-819c9083aa05 admin admin] Deleting subnet b9b37d51-88ba-4a11-bfb6-c6ed3edf5bf8 {{(pid=92323) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 03 08:39:12.367263 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-af4487c6-dd1b-433f-95f5-819c9083aa05 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:12.418025 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-af4487c6-dd1b-433f-95f5-819c9083aa05 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14518184'] for subnet, precommit_delete_associations {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:12.472432 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-af4487c6-dd1b-433f-95f5-819c9083aa05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-862421'] for subnet, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:12.872312 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-af4487c6-dd1b-433f-95f5-819c9083aa05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-862434', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14211216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14857862'] for subnet, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:12.876288 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:12.908900 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af4487c6-dd1b-433f-95f5-819c9083aa05 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b9b37d51-88ba-4a11-bfb6-c6ed3edf5bf8,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:12.913069 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-af4487c6-dd1b-433f-95f5-819c9083aa05 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:12.916268 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-af4487c6-dd1b-433f-95f5-819c9083aa05 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:12.922852 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-af4487c6-dd1b-433f-95f5-819c9083aa05 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/b9b37d51-88ba-4a11-bfb6-c6ed3edf5bf8 HTTP/1.1" status: 204  len: 168 time: 0.6163981
Jun 03 08:39:12.926024 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 55854) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:13.030295 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-cf4025ed-31a5-42b5-ba48-8baacfdfad71 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-529010'] for network, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:13.154454 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-cf4025ed-31a5-42b5-ba48-8baacfdfad71 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-862046', 'neutron.services.segments.db._delete_segments_for_network-8774224358894'] for network, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:13.167972 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-cf4025ed-31a5-42b5-ba48-8baacfdfad71 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fae860d2190>,) {'filters': {'network_id': ['a403a57f-3a04-459a-a7a1-4c12e89375ac']}} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:13.180658 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-cf4025ed-31a5-42b5-ba48-8baacfdfad71 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fae860d2190>, '5b0c8236-42e9-4ef1-bc3a-6af28a68d41c') {'for_net_delete': True} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:13.180959 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-cf4025ed-31a5-42b5-ba48-8baacfdfad71 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fae860d2190>, '5b0c8236-42e9-4ef1-bc3a-6af28a68d41c') {} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:13.192126 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-cf4025ed-31a5-42b5-ba48-8baacfdfad71 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8774224362253', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14518195'] for segment, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:13.208177 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-cf4025ed-31a5-42b5-ba48-8baacfdfad71 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:13.214047 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cf4025ed-31a5-42b5-ba48-8baacfdfad71 admin admin] Releasing vlan 515 on physical network physnet1 to pool {{(pid=92323) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 03 08:39:13.214428 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-cf4025ed-31a5-42b5-ba48-8baacfdfad71 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14211322'] for segment, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]: Traceback (most recent call last):
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:     timer()
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:     cb(*args, **kw)
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:     return func(*args, **kwargs)
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:     self._notify()
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:     self.callback(batched_events)
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:     event.method(event)
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:     return f(self, *a, **k)
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self._get(url).json()
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self.request(url, 'GET', **kwargs)
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 03 08:39:13.227727 dv-cinder-787262-5-iscsi neutron-server[92323]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 03 08:39:13.403411 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-cf4025ed-31a5-42b5-ba48-8baacfdfad71 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-862039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16327709'] for network, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:13.407690 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-452b858f-1441-41e3-abdb-50d587aed15b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:13.421759 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-cf4025ed-31a5-42b5-ba48-8baacfdfad71 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:13.432296 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf4025ed-31a5-42b5-ba48-8baacfdfad71 admin admin] Pushing event deleted for resources: {'Network': ['ID=a403a57f-3a04-459a-a7a1-4c12e89375ac,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:13.434992 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-cf4025ed-31a5-42b5-ba48-8baacfdfad71 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:13.436334 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-cf4025ed-31a5-42b5-ba48-8baacfdfad71 admin admin] 10.222.0.11 "DELETE /v2.0/networks/a403a57f-3a04-459a-a7a1-4c12e89375ac HTTP/1.1" status: 204  len: 168 time: 0.5093596
Jun 03 08:39:13.838429 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 55858) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:13.885337 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-87d73fca-4a6e-4055-bb40-6d4741164684 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=45f4a8c8d0d84e8981fb1a9ad77403d7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0456357
Jun 03 08:39:13.887765 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 55860) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:13.948613 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-17d6c89d-7cca-47de-812a-00d8850ae2c4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:13.976180 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-17d6c89d-7cca-47de-812a-00d8850ae2c4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:14.106728 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-17d6c89d-7cca-47de-812a-00d8850ae2c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:14.110678 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a3fc66dd-6ac0-48be-8c94-3a3f0313aba1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:14.123354 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17d6c89d-7cca-47de-812a-00d8850ae2c4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c88e865c-e495-465c-84d1-5c424740df16,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:14.131808 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-17d6c89d-7cca-47de-812a-00d8850ae2c4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:14.131808 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-17d6c89d-7cca-47de-812a-00d8850ae2c4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:14.131808 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-17d6c89d-7cca-47de-812a-00d8850ae2c4 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/c88e865c-e495-465c-84d1-5c424740df16 HTTP/1.1" status: 204  len: 168 time: 0.2410934
Jun 03 08:39:14.909786 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 55870) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:14.963043 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-f177855d-aa5a-4f75-a3aa-6b0452a68d58 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=9627efa7a27541729000521675cc16f9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0519760
Jun 03 08:39:14.965518 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 55872) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:15.027180 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-025340a0-e12b-4d38-b98a-c8cfbf784491 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:15.052958 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-025340a0-e12b-4d38-b98a-c8cfbf784491 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:15.203884 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-025340a0-e12b-4d38-b98a-c8cfbf784491 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:15.208662 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-2b1c7a75-f67b-467b-a4fb-3d7f9ecf8944 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:15.220380 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-025340a0-e12b-4d38-b98a-c8cfbf784491 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2588dbb7-8466-43b8-a38a-a9b2688933eb,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:15.224914 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-025340a0-e12b-4d38-b98a-c8cfbf784491 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:15.228141 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-025340a0-e12b-4d38-b98a-c8cfbf784491 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:15.229239 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-025340a0-e12b-4d38-b98a-c8cfbf784491 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/2588dbb7-8466-43b8-a38a-a9b2688933eb HTTP/1.1" status: 204  len: 168 time: 0.2628460
Jun 03 08:39:21.343048 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15bab8ab-14f6-4d69-a561-78cea3b2c575 req-de20adc1-70d4-43af-935b-01fc182d0393 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:39:21.344525 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-15bab8ab-14f6-4d69-a561-78cea3b2c575 req-de20adc1-70d4-43af-935b-01fc182d0393 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 947 time: 0.0861287
Jun 03 08:39:21.391621 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-15bab8ab-14f6-4d69-a561-78cea3b2c575 req-e7b009c4-b34e-49e6-a680-ae547926b950 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0407681
Jun 03 08:39:22.583992 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd269c4-2d3a-4ef6-9080-1aa3ddf9f4d4 req-2ac91921-fd2e-417d-9aef-55cb24e71b17 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:39:22.585474 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fdd269c4-2d3a-4ef6-9080-1aa3ddf9f4d4 req-2ac91921-fd2e-417d-9aef-55cb24e71b17 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 947 time: 0.0840747
Jun 03 08:39:22.631908 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fdd269c4-2d3a-4ef6-9080-1aa3ddf9f4d4 req-303bb91e-f3f6-4288-bbf4-ca02c7c979dd tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups?id=98e250d0-0941-4a9a-af9c-14f7797b1b84&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0407906
Jun 03 08:39:22.875339 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-057f1452-6749-4f6a-b636-a0b8735406c8 req-89d98636-a666-47e2-9c58-6b0834642877 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:39:22.876825 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-057f1452-6749-4f6a-b636-a0b8735406c8 req-89d98636-a666-47e2-9c58-6b0834642877 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.55 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 947 time: 0.0897508
Jun 03 08:39:23.023101 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-057f1452-6749-4f6a-b636-a0b8735406c8 req-1883b8ec-6956-45c0-9b5a-c47684e61167 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Deleting port 1837d7d5-12fa-4414-9722-e593f5ed4c48 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:39:23.023445 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-057f1452-6749-4f6a-b636-a0b8735406c8 req-1883b8ec-6956-45c0-9b5a-c47684e61167 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:23.160713 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-057f1452-6749-4f6a-b636-a0b8735406c8 req-1883b8ec-6956-45c0-9b5a-c47684e61167 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] For port 1837d7d5-12fa-4414-9722-e593f5ed4c48, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=1837d7d5-12fa-4414-9722-e593f5ed4c48,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:39:23.161070 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-057f1452-6749-4f6a-b636-a0b8735406c8 req-1883b8ec-6956-45c0-9b5a-c47684e61167 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:23.546965 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-057f1452-6749-4f6a-b636-a0b8735406c8 req-1883b8ec-6956-45c0-9b5a-c47684e61167 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:23.547340 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-057f1452-6749-4f6a-b636-a0b8735406c8 req-1883b8ec-6956-45c0-9b5a-c47684e61167 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16327919'] for floatingip, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:23.547655 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.db.l3_db [req-057f1452-6749-4f6a-b636-a0b8735406c8 req-1883b8ec-6956-45c0-9b5a-c47684e61167 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Floating IP 5234be0d-8a41-4218-9c7f-e80e95e82666 disassociated. External IP: 172.27.0.166, port: 1837d7d5-12fa-4414-9722-e593f5ed4c48.
Jun 03 08:39:23.547998 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-057f1452-6749-4f6a-b636-a0b8735406c8 req-1883b8ec-6956-45c0-9b5a-c47684e61167 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Calling delete_port for 1837d7d5-12fa-4414-9722-e593f5ed4c48 owned by compute:nova {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:39:23.755193 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-057f1452-6749-4f6a-b636-a0b8735406c8 req-1883b8ec-6956-45c0-9b5a-c47684e61167 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:23.761650 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c1ba5287-bfc8-47ec-b51f-34fd87dab87b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:23.794852 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a5220c9b-358d-48df-ba75-b303c006fb2c req-16683b6f-0170-4732-9472-7cd9d8bc4878 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 210 time: 0.0492573
Jun 03 08:39:23.809540 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1883b8ec-6956-45c0-9b5a-c47684e61167 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Pushing event deleted for resources: {'Port': ['ID=1837d7d5-12fa-4414-9722-e593f5ed4c48,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:23.814086 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-1883b8ec-6956-45c0-9b5a-c47684e61167 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:24.007259 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [req-057f1452-6749-4f6a-b636-a0b8735406c8 req-1883b8ec-6956-45c0-9b5a-c47684e61167 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Router cb358121-3d7d-46b4-8e93-e40d5a92215c has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:39:24.194144 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-057f1452-6749-4f6a-b636-a0b8735406c8 req-1883b8ec-6956-45c0-9b5a-c47684e61167 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:39:24.203815 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-944b4d08-8c2f-40f8-9750-b5f32cb801f6 None None] Sync routers for ids ['cb358121-3d7d-46b4-8e93-e40d5a92215c'] in dv-cinder-787262-5-iscsi {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:39:24.214727 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-944b4d08-8c2f-40f8-9750-b5f32cb801f6 None None] Routers {'cb358121-3d7d-46b4-8e93-e40d5a92215c'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:39:24.215475 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-944b4d08-8c2f-40f8-9750-b5f32cb801f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae870bf2b0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:39:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['cb358121-3d7d-46b4-8e93-e40d5a92215c'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:24.275711 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-057f1452-6749-4f6a-b636-a0b8735406c8 req-1883b8ec-6956-45c0-9b5a-c47684e61167 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] No DVR routers for this DVR port 1837d7d5-12fa-4414-9722-e593f5ed4c48 on host hv-cinder-78726 {{(pid=92323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:39:24.278283 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-057f1452-6749-4f6a-b636-a0b8735406c8 req-1883b8ec-6956-45c0-9b5a-c47684e61167 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:24.281052 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '41d57543-e5c8-45b5-8eef-2f829250eec3', 'name': 'network-vif-deleted', 'tag': '1837d7d5-12fa-4414-9722-e593f5ed4c48'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:39:24.283468 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-826077d4-5eaa-4bee-bf45-fbc9ac29bbd2" -d '{"events": [{"server_uuid": "41d57543-e5c8-45b5-8eef-2f829250eec3", "name": "network-vif-deleted", "tag": "1837d7d5-12fa-4414-9722-e593f5ed4c48"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:39:24.340801 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:39:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1ac1270c-ca9e-41e5-988b-c5e34d95966e x-openstack-request-id: req-1ac1270c-ca9e-41e5-988b-c5e34d95966e {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:39:24.340801 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "41d57543-e5c8-45b5-8eef-2f829250eec3", "name": "network-vif-deleted", "tag": "1837d7d5-12fa-4414-9722-e593f5ed4c48", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:39:24.340801 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-1ac1270c-ca9e-41e5-988b-c5e34d95966e {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:39:24.340801 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '41d57543-e5c8-45b5-8eef-2f829250eec3', 'name': 'network-vif-deleted', 'tag': '1837d7d5-12fa-4414-9722-e593f5ed4c48', 'status': 'completed', 'code': 200}
Jun 03 08:39:24.387732 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-057f1452-6749-4f6a-b636-a0b8735406c8 req-1883b8ec-6956-45c0-9b5a-c47684e61167 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.55 "DELETE /v2.0/ports/1837d7d5-12fa-4414-9722-e593f5ed4c48 HTTP/1.1" status: 204  len: 173 time: 1.5034101
Jun 03 08:39:24.409629 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-944b4d08-8c2f-40f8-9750-b5f32cb801f6 None None] Set router cb358121-3d7d-46b4-8e93-e40d5a92215c gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:39:24.740478 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-944b4d08-8c2f-40f8-9750-b5f32cb801f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae870bf2b0>, [{'id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-router', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:37Z', 'updated_at': '2021-06-03T08:30:48Z', 'revision_number': 4, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'gw_port': {'id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:11:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '5d9c4d5c-7c2e-4911-823a-3a3242707096', 'name': '', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'mac_address': 'fa:16:3e:0c:7e:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_interface', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:46Z', 'updated_at': '2021-06-03T08:31:03Z', 'revision_number': 5, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'subnets': [{'id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:24.745707 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-944b4d08-8c2f-40f8-9750-b5f32cb801f6 None None] Checking router: cb358121-3d7d-46b4-8e93-e40d5a92215c for host: dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:39:24.756531 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-944b4d08-8c2f-40f8-9750-b5f32cb801f6 None None] Routers {'cb358121-3d7d-46b4-8e93-e40d5a92215c'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:39:24.757144 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-944b4d08-8c2f-40f8-9750-b5f32cb801f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae870bf2b0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:39:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['cb358121-3d7d-46b4-8e93-e40d5a92215c'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:24.948516 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-944b4d08-8c2f-40f8-9750-b5f32cb801f6 None None] Set router cb358121-3d7d-46b4-8e93-e40d5a92215c gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:39:24.989478 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-c8ab405c-0af7-4608-b3dd-8bcec48e0330 req-884c5afa-8bf8-4f06-a20b-85522653a6af tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/ports?device_id=41d57543-e5c8-45b5-8eef-2f829250eec3 HTTP/1.1" status: 200  len: 210 time: 0.0623562
Jun 03 08:39:25.274701 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-944b4d08-8c2f-40f8-9750-b5f32cb801f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae870bf2b0>, [{'id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-router', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:37Z', 'updated_at': '2021-06-03T08:30:48Z', 'revision_number': 4, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'gw_port': {'id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:11:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '5d9c4d5c-7c2e-4911-823a-3a3242707096', 'name': '', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'mac_address': 'fa:16:3e:0c:7e:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_interface', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:46Z', 'updated_at': '2021-06-03T08:31:03Z', 'revision_number': 5, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'subnets': [{'id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:25.278433 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-944b4d08-8c2f-40f8-9750-b5f32cb801f6 None None] The sync data for ids ['cb358121-3d7d-46b4-8e93-e40d5a92215c'] in dv-cinder-787262-5-iscsi is: [{'id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-router', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:37Z', 'updated_at': '2021-06-03T08:30:48Z', 'revision_number': 4, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'gw_port': {'id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:11:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '5d9c4d5c-7c2e-4911-823a-3a3242707096', 'name': '', 'network_id': '958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'mac_address': 'fa:16:3e:0c:7e:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_interface', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:46Z', 'updated_at': '2021-06-03T08:31:03Z', 'revision_number': 5, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'subnets': [{'id': 'cff67a13-bc33-4d3e-a796-5829103ca25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:39:25.492921 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6536cc42-f792-4684-9aa5-de1629e9d7b9 None None] New status for floating IP 5234be0d-8a41-4218-9c7f-e80e95e82666: DOWN {{(pid=92325) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 03 08:39:26.129933 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:26.222922 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 55996) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:26.288489 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9c7d953c-4162-4dc8-8301-7787dbc3a05b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:26.318729 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9c7d953c-4162-4dc8-8301-7787dbc3a05b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:26.330139 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:39:26.442712 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9c7d953c-4162-4dc8-8301-7787dbc3a05b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:26.446783 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-3d4cc85d-ebe9-4d15-adc3-e211b9812134 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:26.460916 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c7d953c-4162-4dc8-8301-7787dbc3a05b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=98e250d0-0941-4a9a-af9c-14f7797b1b84,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:26.470999 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c7d953c-4162-4dc8-8301-7787dbc3a05b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:26.471386 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c7d953c-4162-4dc8-8301-7787dbc3a05b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:26.471813 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c7d953c-4162-4dc8-8301-7787dbc3a05b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:26.472169 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c7d953c-4162-4dc8-8301-7787dbc3a05b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:26.472546 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c7d953c-4162-4dc8-8301-7787dbc3a05b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:26.472917 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c7d953c-4162-4dc8-8301-7787dbc3a05b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:26.473282 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c7d953c-4162-4dc8-8301-7787dbc3a05b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:26.473647 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c7d953c-4162-4dc8-8301-7787dbc3a05b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:26.474009 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c7d953c-4162-4dc8-8301-7787dbc3a05b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:26.474370 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c7d953c-4162-4dc8-8301-7787dbc3a05b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:26.474761 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c7d953c-4162-4dc8-8301-7787dbc3a05b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:26.475128 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c7d953c-4162-4dc8-8301-7787dbc3a05b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:26.478264 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9c7d953c-4162-4dc8-8301-7787dbc3a05b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:26.557650 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9c7d953c-4162-4dc8-8301-7787dbc3a05b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:26.558791 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-9c7d953c-4162-4dc8-8301-7787dbc3a05b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "DELETE /v2.0/security-groups/98e250d0-0941-4a9a-af9c-14f7797b1b84 HTTP/1.1" status: 204  len: 168 time: 0.3348496
Jun 03 08:39:26.561374 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 55998) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:26.581919 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.api.v2.resource [None req-82e5641a-e207-4144-8d4e-ed3740d3ea34 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] show failed (client error): The resource could not be found.
Jun 03 08:39:26.582936 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-82e5641a-e207-4144-8d4e-ed3740d3ea34 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "GET /v2.0/security-groups/98e250d0-0941-4a9a-af9c-14f7797b1b84 HTTP/1.1" status: 404  len: 347 time: 0.0206420
Jun 03 08:39:26.586042 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56000) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:26.607634 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 1837d7d5-12fa-4414-9722-e593f5ed4c48 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:39:26.647422 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] No Port match for: 1837d7d5-12fa-4414-9722-e593f5ed4c48 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:39:26.647773 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 1837d7d5-12fa-4414-9722-e593f5ed4c48 not bound to the agent host hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:39:26.820431 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-50749a23-6d2b-4851-8858-181566ead40a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Deleting port e8d7eb7e-5f0b-4c0e-bc57-29125096cfca {{(pid=92324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:39:26.820781 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-50749a23-6d2b-4851-8858-181566ead40a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:27.029360 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-50749a23-6d2b-4851-8858-181566ead40a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:27.029691 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-50749a23-6d2b-4851-8858-181566ead40a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:27.161046 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-50749a23-6d2b-4851-8858-181566ead40a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Calling delete_port for e8d7eb7e-5f0b-4c0e-bc57-29125096cfca owned by network:floatingip {{(pid=92324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:39:27.375326 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-50749a23-6d2b-4851-8858-181566ead40a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:27.379347 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f5532a6c-9fad-4d06-9517-a01aad90f0ea admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:27.427683 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50749a23-6d2b-4851-8858-181566ead40a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Pushing event deleted for resources: {'Port': ['ID=e8d7eb7e-5f0b-4c0e-bc57-29125096cfca,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:27.431066 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-50749a23-6d2b-4851-8858-181566ead40a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:27.520962 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-50749a23-6d2b-4851-8858-181566ead40a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks [] for floatingip, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:27.535910 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-50749a23-6d2b-4851-8858-181566ead40a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for floatingip, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:27.537039 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-50749a23-6d2b-4851-8858-181566ead40a tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] 10.222.0.11 "DELETE /v2.0/floatingips/5234be0d-8a41-4218-9c7f-e80e95e82666 HTTP/1.1" status: 204  len: 168 time: 0.9500334
Jun 03 08:39:30.711001 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 56040) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:31.413669 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-44bd37b7-fd86-43cb-9814-58f8782453d4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-16328733'] for router_interface, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:31.933184 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-44bd37b7-fd86-43cb-9814-58f8782453d4 admin admin] Deleting port 5d9c4d5c-7c2e-4911-823a-3a3242707096 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:39:31.933894 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-44bd37b7-fd86-43cb-9814-58f8782453d4 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:32.051504 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [None req-44bd37b7-fd86-43cb-9814-58f8782453d4 admin admin] For port 5d9c4d5c-7c2e-4911-823a-3a3242707096, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=5d9c4d5c-7c2e-4911-823a-3a3242707096,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:39:32.051882 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-44bd37b7-fd86-43cb-9814-58f8782453d4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:32.181892 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-44bd37b7-fd86-43cb-9814-58f8782453d4 admin admin] Calling delete_port for 5d9c4d5c-7c2e-4911-823a-3a3242707096 owned by network:router_interface {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:39:32.546549 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-a90c43a7-3e13-4318-8fdc-89f2f9d638dd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:32.558112 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-44bd37b7-fd86-43cb-9814-58f8782453d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:32.566571 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-4f7c322f-36ce-4cab-bd21-6109fcef42ed tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:32.649691 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44bd37b7-fd86-43cb-9814-58f8782453d4 admin admin] Pushing event deleted for resources: {'Port': ['ID=5d9c4d5c-7c2e-4911-823a-3a3242707096,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:32.652533 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-44bd37b7-fd86-43cb-9814-58f8782453d4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:32.905428 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-44bd37b7-fd86-43cb-9814-58f8782453d4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-16344783', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-16328833'] for router_interface, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:33.359609 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-44bd37b7-fd86-43cb-9814-58f8782453d4 admin admin] Router cb358121-3d7d-46b4-8e93-e40d5a92215c has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:39:33.535282 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-44bd37b7-fd86-43cb-9814-58f8782453d4 admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:39:33.543827 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8670ba55-5306-418d-9d41-9fd1f8ce11fd None None] Sync routers for ids ['cb358121-3d7d-46b4-8e93-e40d5a92215c'] in dv-cinder-787262-5-iscsi {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:39:33.547250 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-44bd37b7-fd86-43cb-9814-58f8782453d4 admin admin] 10.222.0.11 "PUT /v2.0/routers/cb358121-3d7d-46b4-8e93-e40d5a92215c/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.8349960
Jun 03 08:39:33.549571 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 56052) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:33.553978 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8670ba55-5306-418d-9d41-9fd1f8ce11fd None None] Routers {'cb358121-3d7d-46b4-8e93-e40d5a92215c'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:39:33.555038 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-8670ba55-5306-418d-9d41-9fd1f8ce11fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae879f9c40>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:39:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['cb358121-3d7d-46b4-8e93-e40d5a92215c'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:33.722339 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8140619d-263f-462f-8db5-b5633c3758cf admin admin] Notify callbacks [] for router, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:33.764535 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-8670ba55-5306-418d-9d41-9fd1f8ce11fd None None] Set router cb358121-3d7d-46b4-8e93-e40d5a92215c gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:39:33.900538 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8140619d-263f-462f-8db5-b5633c3758cf admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:34.046219 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-8670ba55-5306-418d-9d41-9fd1f8ce11fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae879f9c40>, [{'id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-router', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:37Z', 'updated_at': '2021-06-03T08:39:32Z', 'revision_number': 5, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'gw_port': {'id': '3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:11:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:30:39Z', 'updated_at': '2021-06-03T08:30:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:34.051088 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8670ba55-5306-418d-9d41-9fd1f8ce11fd None None] Checking router: cb358121-3d7d-46b4-8e93-e40d5a92215c for host: dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:39:34.059475 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8670ba55-5306-418d-9d41-9fd1f8ce11fd None None] Routers {'cb358121-3d7d-46b4-8e93-e40d5a92215c'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:39:34.060103 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-8670ba55-5306-418d-9d41-9fd1f8ce11fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae879f9c40>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:39:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['cb358121-3d7d-46b4-8e93-e40d5a92215c'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:34.121658 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-8140619d-263f-462f-8db5-b5633c3758cf admin admin] Deleting port 3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:39:34.122090 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8140619d-263f-462f-8db5-b5633c3758cf admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:34.209935 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-8670ba55-5306-418d-9d41-9fd1f8ce11fd None None] Set router cb358121-3d7d-46b4-8e93-e40d5a92215c gateway port host: None {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:39:34.243532 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [None req-8140619d-263f-462f-8db5-b5633c3758cf admin admin] For port 3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:39:34.243893 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8140619d-263f-462f-8db5-b5633c3758cf admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:34.315052 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-8670ba55-5306-418d-9d41-9fd1f8ce11fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae879f9c40>, [{'id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-router', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:37Z', 'updated_at': '2021-06-03T08:39:33Z', 'revision_number': 6, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'gw_port_host': None}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:34.319009 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8670ba55-5306-418d-9d41-9fd1f8ce11fd None None] The sync data for ids ['cb358121-3d7d-46b4-8e93-e40d5a92215c'] in dv-cinder-787262-5-iscsi is: [{'id': 'cb358121-3d7d-46b4-8e93-e40d5a92215c', 'name': 'tempest-AttachVolumeShelveTestJSON-1780948510-router', 'tenant_id': '36c42f532cd14f19811ffbee3a39a208', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:30:37Z', 'updated_at': '2021-06-03T08:39:33Z', 'revision_number': 6, 'project_id': '36c42f532cd14f19811ffbee3a39a208', 'gw_port_host': None}] {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:39:34.367412 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-8140619d-263f-462f-8db5-b5633c3758cf admin admin] Calling delete_port for 3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b owned by network:router_gateway {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:39:34.586557 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8140619d-263f-462f-8db5-b5633c3758cf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:34.591004 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-d95bdf19-c990-4314-8233-2d78306fb8c2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:34.633676 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8140619d-263f-462f-8db5-b5633c3758cf admin admin] Pushing event deleted for resources: {'Port': ['ID=3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:34.662940 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-8140619d-263f-462f-8db5-b5633c3758cf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:34.839907 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8140619d-263f-462f-8db5-b5633c3758cf admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-16327738'] for router_gateway, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:34.855029 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:35.013640 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8140619d-263f-462f-8db5-b5633c3758cf admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-16388336', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2351'] for router, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:35.015821 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8140619d-263f-462f-8db5-b5633c3758cf admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:35.219327 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8140619d-263f-462f-8db5-b5633c3758cf admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-16388448'] for router, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:35.220160 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8140619d-263f-462f-8db5-b5633c3758cf admin admin] Fanout notify agent at l3_agent the message router_deleted on router cb358121-3d7d-46b4-8e93-e40d5a92215c {{(pid=92323) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 03 08:39:35.234181 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8140619d-263f-462f-8db5-b5633c3758cf admin admin] Notify callbacks [] for router, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:35.243188 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-8140619d-263f-462f-8db5-b5633c3758cf admin admin] 10.222.0.11 "DELETE /v2.0/routers/cb358121-3d7d-46b4-8e93-e40d5a92215c HTTP/1.1" status: 204  len: 168 time: 1.6844316
Jun 03 08:39:35.243188 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 56062) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:35.277704 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5ae0204c-2f77-4012-917c-8efc79c43fbd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:35.301135 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_v2 [None req-455b803b-50fb-4b4c-a4c8-4f72b27ea8d1 admin admin] Deleting subnet cff67a13-bc33-4d3e-a796-5829103ca25c {{(pid=92323) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 03 08:39:35.304227 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-455b803b-50fb-4b4c-a4c8-4f72b27ea8d1 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:35.366055 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-455b803b-50fb-4b4c-a4c8-4f72b27ea8d1 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14518184'] for subnet, precommit_delete_associations {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:35.455154 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-455b803b-50fb-4b4c-a4c8-4f72b27ea8d1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-862421'] for subnet, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:35.803918 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-455b803b-50fb-4b4c-a4c8-4f72b27ea8d1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-862434', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14211216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14857862'] for subnet, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:35.808292 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:35.841027 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-455b803b-50fb-4b4c-a4c8-4f72b27ea8d1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cff67a13-bc33-4d3e-a796-5829103ca25c,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:35.847049 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-455b803b-50fb-4b4c-a4c8-4f72b27ea8d1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:35.849968 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-455b803b-50fb-4b4c-a4c8-4f72b27ea8d1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:35.857998 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56072) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:35.858510 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-455b803b-50fb-4b4c-a4c8-4f72b27ea8d1 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/cff67a13-bc33-4d3e-a796-5829103ca25c HTTP/1.1" status: 204  len: 168 time: 0.6186604
Jun 03 08:39:35.863723 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-09fe2538-8000-4056-832d-945d29499f3d None None] Network 958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:39:35.979194 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-529010'] for network, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:36.051183 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] Deleting port b978875c-3e77-480c-9a07-17ea1232f6ab {{(pid=92324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:39:36.051521 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:36.133616 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-80850e3c-7b3d-4ec7-8f8a-e44ac778d1d8 None None] DHCP port deletion for 958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba request from dv-cinder-787262-5-iscsi {{(pid=92325) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 03 08:39:36.155861 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.db [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] For port b978875c-3e77-480c-9a07-17ea1232f6ab, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=b978875c-3e77-480c-9a07-17ea1232f6ab,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:39:36.156148 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:36.220074 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-80850e3c-7b3d-4ec7-8f8a-e44ac778d1d8 None None] Deleting port b978875c-3e77-480c-9a07-17ea1232f6ab {{(pid=92325) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:39:36.220469 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-80850e3c-7b3d-4ec7-8f8a-e44ac778d1d8 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:36.254725 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:36.296707 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] Calling delete_port for b978875c-3e77-480c-9a07-17ea1232f6ab owned by network:dhcp {{(pid=92324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:39:36.337073 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-80850e3c-7b3d-4ec7-8f8a-e44ac778d1d8 None None] For port b978875c-3e77-480c-9a07-17ea1232f6ab, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=b978875c-3e77-480c-9a07-17ea1232f6ab,segment=NetworkSegment(377c6f4a-d9be-4dae-86db-35230d8009c9),segment_id=377c6f4a-d9be-4dae-86db-35230d8009c9)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:39:36.337476 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-80850e3c-7b3d-4ec7-8f8a-e44ac778d1d8 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:36.413617 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 5d9c4d5c-7c2e-4911-823a-3a3242707096 no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:39:36.459751 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:36.463596 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:36.503803 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-80850e3c-7b3d-4ec7-8f8a-e44ac778d1d8 None None] Calling delete_port for b978875c-3e77-480c-9a07-17ea1232f6ab owned by network:dhcp {{(pid=92325) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:39:36.507093 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] Pushing event deleted for resources: {'Port': ['ID=b978875c-3e77-480c-9a07-17ea1232f6ab,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:36.510135 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:36.510920 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] No DVR routers for this DVR port b978875c-3e77-480c-9a07-17ea1232f6ab on host dv-cinder-787262-5-iscsi {{(pid=92324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:39:36.515540 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: 5d9c4d5c-7c2e-4911-823a-3a3242707096 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:39:36.515947 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 5d9c4d5c-7c2e-4911-823a-3a3242707096 not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:39:36.516384 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:39:36.555829 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: 3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:39:36.556185 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 3a2e8f0e-bf3a-42a4-b119-61b74bb93e8b not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:39:36.556617 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device b978875c-3e77-480c-9a07-17ea1232f6ab no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:39:36.596160 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: b978875c-3e77-480c-9a07-17ea1232f6ab {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:39:36.597220 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device b978875c-3e77-480c-9a07-17ea1232f6ab not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:39:36.629047 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-80850e3c-7b3d-4ec7-8f8a-e44ac778d1d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151'] for port, after_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:36.629808 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-862046', 'neutron.services.segments.db._delete_segments_for_network-8774224358894'] for network, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:36.633697 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:36.642359 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fae85d31040>,) {'filters': {'network_id': ['958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba']}} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:36.654410 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fae85d31040>, '377c6f4a-d9be-4dae-86db-35230d8009c9') {'for_net_delete': True} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:36.654736 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fae85d31040>, '377c6f4a-d9be-4dae-86db-35230d8009c9') {} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:36.666271 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8774224362253', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-15250406'] for segment, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:36.678361 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80850e3c-7b3d-4ec7-8f8a-e44ac778d1d8 None None] No DVR routers for this DVR port b978875c-3e77-480c-9a07-17ea1232f6ab on host dv-cinder-787262-5-iscsi {{(pid=92325) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:39:36.680658 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80850e3c-7b3d-4ec7-8f8a-e44ac778d1d8 None None] Pushing event deleted for resources: {'Port': ['ID=b978875c-3e77-480c-9a07-17ea1232f6ab,revision_number=None']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:36.684294 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:36.692950 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80850e3c-7b3d-4ec7-8f8a-e44ac778d1d8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:36.692950 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80850e3c-7b3d-4ec7-8f8a-e44ac778d1d8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:36.692950 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80850e3c-7b3d-4ec7-8f8a-e44ac778d1d8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:36.692950 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80850e3c-7b3d-4ec7-8f8a-e44ac778d1d8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:36.692950 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80850e3c-7b3d-4ec7-8f8a-e44ac778d1d8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:36.692950 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80850e3c-7b3d-4ec7-8f8a-e44ac778d1d8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:36.692950 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80850e3c-7b3d-4ec7-8f8a-e44ac778d1d8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:36.692950 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80850e3c-7b3d-4ec7-8f8a-e44ac778d1d8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:36.692950 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80850e3c-7b3d-4ec7-8f8a-e44ac778d1d8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:36.693615 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80850e3c-7b3d-4ec7-8f8a-e44ac778d1d8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:36.693615 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80850e3c-7b3d-4ec7-8f8a-e44ac778d1d8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:36.693804 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80850e3c-7b3d-4ec7-8f8a-e44ac778d1d8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:39:36.695309 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] Releasing vlan 526 on physical network physnet1 to pool {{(pid=92324) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 03 08:39:36.695710 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15641405'] for segment, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:36.696835 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-80850e3c-7b3d-4ec7-8f8a-e44ac778d1d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]: Traceback (most recent call last):
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:     timer()
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:     cb(*args, **kw)
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:     return func(*args, **kwargs)
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:     self._notify()
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:     self.callback(batched_events)
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:     event.method(event)
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:     return f(self, *a, **k)
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self._get(url).json()
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self.request(url, 'GET', **kwargs)
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 03 08:39:36.708792 dv-cinder-787262-5-iscsi neutron-server[92324]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 03 08:39:36.900428 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-862039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16327709'] for network, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:36.904071 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-766d23b5-fee0-494e-8992-c7dff8cc3517 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:36.921847 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:36.930485 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] Pushing event deleted for resources: {'Network': ['ID=958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:36.933663 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:37.020079 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] 10.222.0.11 "DELETE /v2.0/networks/958f6ecd-e08a-47cc-8f4b-c1f0a1ddb9ba HTTP/1.1" status: 204  len: 168 time: 1.1608033
Jun 03 08:39:37.590678 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56086) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:37.598180 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56090) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:37.664461 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-67f30741-f5f9-4b5e-bbdd-3cc468b1178a admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=36c42f532cd14f19811ffbee3a39a208&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0645676
Jun 03 08:39:37.666594 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56092) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:37.730827 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ae3caddf-aeaf-4b08-ad34-def2012f62b5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:37.759309 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ae3caddf-aeaf-4b08-ad34-def2012f62b5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:37.829790 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ae64ec39-5234-4ab6-97e3-7e882b630122 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:37.843813 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-ae64ec39-5234-4ab6-97e3-7e882b630122 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:39:37.847760 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-ae64ec39-5234-4ab6-97e3-7e882b630122 admin admin] Usage tracker for resource:security_group_rule and tenant:fc8d4ff26401480a8fd7a3308e99a187 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:39:37.850598 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-ae64ec39-5234-4ab6-97e3-7e882b630122 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:39:37.856289 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-ae64ec39-5234-4ab6-97e3-7e882b630122 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:39:37.885732 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ae3caddf-aeaf-4b08-ad34-def2012f62b5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:37.891317 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-bd495bda-dc24-463f-b85f-7a38804bd9ba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:37.912763 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae3caddf-aeaf-4b08-ad34-def2012f62b5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6dd0ffd9-5529-4e6f-8d41-4ebabade9056,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:37.917283 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-ae3caddf-aeaf-4b08-ad34-def2012f62b5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:37.939491 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ae3caddf-aeaf-4b08-ad34-def2012f62b5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:37.939491 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-ae3caddf-aeaf-4b08-ad34-def2012f62b5 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/6dd0ffd9-5529-4e6f-8d41-4ebabade9056 HTTP/1.1" status: 204  len: 168 time: 0.2683203
Jun 03 08:39:37.973917 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ae64ec39-5234-4ab6-97e3-7e882b630122 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:38.083368 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ae64ec39-5234-4ab6-97e3-7e882b630122 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:38.090221 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-ce2cbe01-f9b6-41e5-b20d-39953ebb851e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:38.113276 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:38.219388 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-ae64ec39-5234-4ab6-97e3-7e882b630122 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=fc8d4ff26401480a8fd7a3308e99a187&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6275823
Jun 03 08:39:38.220320 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae64ec39-5234-4ab6-97e3-7e882b630122 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fca1370f-550d-4ce4-9b56-786d1ea22b46,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:38.222835 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 56096) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:38.224008 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-ae64ec39-5234-4ab6-97e3-7e882b630122 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:38.289193 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f35824d0-db5a-4847-b3eb-a2c077086e0d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:38.319088 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f35824d0-db5a-4847-b3eb-a2c077086e0d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:38.455035 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f35824d0-db5a-4847-b3eb-a2c077086e0d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:38.460948 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-2a9ab5e2-a70d-4fb9-a4ee-4136d61f0dff admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:38.473177 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f35824d0-db5a-4847-b3eb-a2c077086e0d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fca1370f-550d-4ce4-9b56-786d1ea22b46,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:38.475764 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f35824d0-db5a-4847-b3eb-a2c077086e0d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:38.479249 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f35824d0-db5a-4847-b3eb-a2c077086e0d admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:38.480352 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-f35824d0-db5a-4847-b3eb-a2c077086e0d admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/fca1370f-550d-4ce4-9b56-786d1ea22b46 HTTP/1.1" status: 204  len: 168 time: 0.2558279
Jun 03 08:39:39.738979 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 56166) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:40.097031 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56172) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:40.173181 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-cb29bace-184c-4546-9403-dc882ae26505 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Deleting port e5dbbb85-852d-4ccb-acb6-96d42033c441 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:39:40.173530 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-cb29bace-184c-4546-9403-dc882ae26505 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:40.217343 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5b438950-34eb-42bb-8a5c-7f1270c66df1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:40.231921 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-5b438950-34eb-42bb-8a5c-7f1270c66df1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:39:40.235681 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-5b438950-34eb-42bb-8a5c-7f1270c66df1 admin admin] Usage tracker for resource:security_group_rule and tenant:4fa2b27f612741ad986b4f52c7517b55 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:39:40.239241 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-5b438950-34eb-42bb-8a5c-7f1270c66df1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:39:40.245077 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-5b438950-34eb-42bb-8a5c-7f1270c66df1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:39:40.293806 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-cb29bace-184c-4546-9403-dc882ae26505 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:40.294186 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-cb29bace-184c-4546-9403-dc882ae26505 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:40.326144 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5b438950-34eb-42bb-8a5c-7f1270c66df1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:40.454162 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5b438950-34eb-42bb-8a5c-7f1270c66df1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:40.462190 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-ae64ec39-5234-4ab6-97e3-7e882b630122 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:40.503789 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-5b438950-34eb-42bb-8a5c-7f1270c66df1 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=4fa2b27f612741ad986b4f52c7517b55&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4054339
Jun 03 08:39:40.504545 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b438950-34eb-42bb-8a5c-7f1270c66df1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8c9c7681-3b77-4d64-9cd0-4ecb5632ee98,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:40.506921 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56176) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:40.514527 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-cb29bace-184c-4546-9403-dc882ae26505 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Calling delete_port for e5dbbb85-852d-4ccb-acb6-96d42033c441 owned by network:floatingip {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:39:40.522688 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-5b438950-34eb-42bb-8a5c-7f1270c66df1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:40.569270 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5cf653c2-2b12-4dc1-9a61-23a32c229f64 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:40.605822 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5cf653c2-2b12-4dc1-9a61-23a32c229f64 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:40.735195 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-cb29bace-184c-4546-9403-dc882ae26505 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:40.740485 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-8b91234d-755c-4b59-a95b-fd42fe3eebea tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:40.780490 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5cf653c2-2b12-4dc1-9a61-23a32c229f64 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:40.783133 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb29bace-184c-4546-9403-dc882ae26505 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Pushing event deleted for resources: {'Port': ['ID=e5dbbb85-852d-4ccb-acb6-96d42033c441,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:40.785251 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-58990faf-79cd-4281-8340-493200500455 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:40.791358 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-cb29bace-184c-4546-9403-dc882ae26505 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:40.796194 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cf653c2-2b12-4dc1-9a61-23a32c229f64 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8c9c7681-3b77-4d64-9cd0-4ecb5632ee98,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:40.798383 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-5cf653c2-2b12-4dc1-9a61-23a32c229f64 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:40.805573 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-5cf653c2-2b12-4dc1-9a61-23a32c229f64 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:40.806896 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-5cf653c2-2b12-4dc1-9a61-23a32c229f64 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/8c9c7681-3b77-4d64-9cd0-4ecb5632ee98 HTTP/1.1" status: 204  len: 168 time: 0.2992156
Jun 03 08:39:40.878210 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-cb29bace-184c-4546-9403-dc882ae26505 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for floatingip, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:40.878210 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.db.l3_db [None req-cb29bace-184c-4546-9403-dc882ae26505 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Floating IP aa804224-baf6-4b3f-a57f-017c677d978b disassociated (deleted). External IP: 172.27.0.53, port: 4312e3c9-0931-4dd5-ba11-db0d982c2a11.
Jun 03 08:39:41.234291 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cb29bace-184c-4546-9403-dc882ae26505 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Router 02c1b0e4-a9b8-4fc7-af87-8069fb4caced has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:39:41.423451 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cb29bace-184c-4546-9403-dc882ae26505 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:39:41.434588 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-704131c2-6479-4bdb-89c3-6bef32eba08f None None] Sync routers for ids ['02c1b0e4-a9b8-4fc7-af87-8069fb4caced'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:39:41.445565 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-704131c2-6479-4bdb-89c3-6bef32eba08f None None] Routers {'02c1b0e4-a9b8-4fc7-af87-8069fb4caced'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:39:41.446194 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-704131c2-6479-4bdb-89c3-6bef32eba08f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae870f6250>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:39:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['02c1b0e4-a9b8-4fc7-af87-8069fb4caced'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:41.552645 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-cb29bace-184c-4546-9403-dc882ae26505 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for floatingip, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:41.607259 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-cb29bace-184c-4546-9403-dc882ae26505 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "DELETE /v2.0/floatingips/aa804224-baf6-4b3f-a57f-017c677d978b HTTP/1.1" status: 204  len: 168 time: 1.8670111
Jun 03 08:39:41.607946 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '80cea05e-57d7-4393-818e-b7a621e986ec', 'tag': '4312e3c9-0931-4dd5-ba11-db0d982c2a11'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:39:41.610381 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-64aa38be-ce4c-4eac-bbca-7b4f14f7dd1e" -d '{"events": [{"name": "network-changed", "server_uuid": "80cea05e-57d7-4393-818e-b7a621e986ec", "tag": "4312e3c9-0931-4dd5-ba11-db0d982c2a11"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:39:41.623815 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-704131c2-6479-4bdb-89c3-6bef32eba08f None None] Set router 02c1b0e4-a9b8-4fc7-af87-8069fb4caced gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:39:41.674192 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:39:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-867f7f00-9e1f-4b4b-9f6d-680a1bb1f13a x-openstack-request-id: req-867f7f00-9e1f-4b4b-9f6d-680a1bb1f13a {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:39:41.675275 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "80cea05e-57d7-4393-818e-b7a621e986ec", "tag": "4312e3c9-0931-4dd5-ba11-db0d982c2a11", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:39:41.675573 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-867f7f00-9e1f-4b4b-9f6d-680a1bb1f13a {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:39:41.675997 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '80cea05e-57d7-4393-818e-b7a621e986ec', 'tag': '4312e3c9-0931-4dd5-ba11-db0d982c2a11', 'status': 'completed', 'code': 200}
Jun 03 08:39:41.818620 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64aa38be-ce4c-4eac-bbca-7b4f14f7dd1e req-72c21c8a-ba42-4e4d-8324-91014f3871a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:39:41.820166 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-64aa38be-ce4c-4eac-bbca-7b4f14f7dd1e req-72c21c8a-ba42-4e4d-8324-91014f3871a1 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=0e5e096a327f421e9b0a02235740cc36&device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 1099 time: 0.1216326
Jun 03 08:39:41.970848 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56214) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:41.982968 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64aa38be-ce4c-4eac-bbca-7b4f14f7dd1e req-fef784c8-6385-46c8-b08b-9fa805639921 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:39:41.984529 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-64aa38be-ce4c-4eac-bbca-7b4f14f7dd1e req-fef784c8-6385-46c8-b08b-9fa805639921 service neutron] 10.222.0.55 "GET /v2.0/networks?id=4a053960-3cf4-4216-b7a5-291ef61e89b7 HTTP/1.1" status: 200  len: 910 time: 0.1579287
Jun 03 08:39:42.057625 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-704131c2-6479-4bdb-89c3-6bef32eba08f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae870f6250>, [{'id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'name': 'tempest-TestShelveInstance-1807805368-router', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155'}], 'enable_snat': True}, 'gw_port_id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:06Z', 'updated_at': '2021-06-03T08:33:23Z', 'revision_number': 4, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'gw_port': {'id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:4e:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:10Z', 'updated_at': '2021-06-03T08:33:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': 'ce979b40-484e-45cd-a6cb-a3940bb7a659', 'name': '', 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'mac_address': 'fa:16:3e:b9:79:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'fc181126-7c66-44d3-b731-a59036bd562f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:21Z', 'updated_at': '2021-06-03T08:33:36Z', 'revision_number': 5, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'subnets': [{'id': 'fc181126-7c66-44d3-b731-a59036bd562f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:42.060341 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-64aa38be-ce4c-4eac-bbca-7b4f14f7dd1e req-3b304abd-4f31-42d0-8b57-ab0e1f1a5729 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4312e3c9-0931-4dd5-ba11-db0d982c2a11 HTTP/1.1" status: 200  len: 217 time: 0.0683680
Jun 03 08:39:42.062188 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-704131c2-6479-4bdb-89c3-6bef32eba08f None None] Checking router: 02c1b0e4-a9b8-4fc7-af87-8069fb4caced for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:39:42.073008 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-704131c2-6479-4bdb-89c3-6bef32eba08f None None] Routers {'02c1b0e4-a9b8-4fc7-af87-8069fb4caced'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:39:42.073008 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-704131c2-6479-4bdb-89c3-6bef32eba08f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae870f6250>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:39:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['02c1b0e4-a9b8-4fc7-af87-8069fb4caced'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:42.086653 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-312968730-network', 'tenant_id': 'f0519818198c4e009c3ea65e55926733'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:39:42.091307 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:39:42.095314 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Usage tracker for resource:network and tenant:f0519818198c4e009c3ea65e55926733 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:39:42.099009 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:39:42.104954 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:39:42.137326 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64aa38be-ce4c-4eac-bbca-7b4f14f7dd1e req-4773cb92-ff67-49da-9ef4-5f68e1e6f8e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:39:42.139007 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-64aa38be-ce4c-4eac-bbca-7b4f14f7dd1e req-4773cb92-ff67-49da-9ef4-5f68e1e6f8e5 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=fc181126-7c66-44d3-b731-a59036bd562f HTTP/1.1" status: 200  len: 848 time: 0.0729408
Jun 03 08:39:42.213977 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Made reservation on behalf of f0519818198c4e009c3ea65e55926733 for: {'network': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:39:42.216752 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-676039'] for network, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:42.229434 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:42.229685 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64aa38be-ce4c-4eac-bbca-7b4f14f7dd1e req-936e5882-0bdb-4bac-8e98-1f6f7af7d8ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:39:42.231084 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-64aa38be-ce4c-4eac-bbca-7b4f14f7dd1e req-936e5882-0bdb-4bac-8e98-1f6f7af7d8ef service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=4a053960-3cf4-4216-b7a5-291ef61e89b7&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0837412
Jun 03 08:39:42.245057 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:39:42.248903 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Usage tracker for resource:security_group_rule and tenant:f0519818198c4e009c3ea65e55926733 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:39:42.252089 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:39:42.259827 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:39:42.275325 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-704131c2-6479-4bdb-89c3-6bef32eba08f None None] Set router 02c1b0e4-a9b8-4fc7-af87-8069fb4caced gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:39:42.355703 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:42.444170 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:42.458193 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-5b438950-34eb-42bb-8a5c-7f1270c66df1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:42.491485 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] vlan segment allocate from pool success with {'vlan_id': 538, 'physical_network': 'physnet1'}  {{(pid=92324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 03 08:39:42.515282 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=372c0251-dedb-4696-9ac9-4c456a53139a,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:42.524316 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:42.530042 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:42.530042 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.segments_db [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Added segment 95c0c056-9047-4438-b7a2-445fab9f6c71 of type vlan for network 3c41bee4-7ad8-4154-b861-f2ac707597e5
Jun 03 08:39:42.563340 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-64aa38be-ce4c-4eac-bbca-7b4f14f7dd1e req-a4ca8c58-3fc1-4584-b85a-08650bcef919 service neutron] 10.222.0.55 "GET /v2.0/networks/4a053960-3cf4-4216-b7a5-291ef61e89b7?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3244774
Jun 03 08:39:42.568773 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8774223827658'] for network, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:42.581726 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c1b7183-a370-4522-92c4-bace040f3efb req-24c3c601-50ed-4049-8958-fe09b4b87dad tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:39:42.583255 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-7c1b7183-a370-4522-92c4-bace040f3efb req-24c3c601-50ed-4049-8958-fe09b4b87dad tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 946 time: 0.1828392
Jun 03 08:39:42.651085 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-7c1b7183-a370-4522-92c4-bace040f3efb req-188ba806-a6b9-4cb7-b1b1-facdfae060fd tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0614715
Jun 03 08:39:42.695495 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-704131c2-6479-4bdb-89c3-6bef32eba08f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae870f6250>, [{'id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'name': 'tempest-TestShelveInstance-1807805368-router', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155'}], 'enable_snat': True}, 'gw_port_id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:06Z', 'updated_at': '2021-06-03T08:33:23Z', 'revision_number': 4, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'gw_port': {'id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:4e:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:10Z', 'updated_at': '2021-06-03T08:33:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': 'ce979b40-484e-45cd-a6cb-a3940bb7a659', 'name': '', 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'mac_address': 'fa:16:3e:b9:79:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'fc181126-7c66-44d3-b731-a59036bd562f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:21Z', 'updated_at': '2021-06-03T08:33:36Z', 'revision_number': 5, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'subnets': [{'id': 'fc181126-7c66-44d3-b731-a59036bd562f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:42.699560 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-704131c2-6479-4bdb-89c3-6bef32eba08f None None] The sync data for ids ['02c1b0e4-a9b8-4fc7-af87-8069fb4caced'] in dv-cinder-787262-5-iscsi is: [{'id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'name': 'tempest-TestShelveInstance-1807805368-router', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155'}], 'enable_snat': True}, 'gw_port_id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:06Z', 'updated_at': '2021-06-03T08:33:23Z', 'revision_number': 4, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'gw_port': {'id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:4e:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:10Z', 'updated_at': '2021-06-03T08:33:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': 'ce979b40-484e-45cd-a6cb-a3940bb7a659', 'name': '', 'network_id': '4a053960-3cf4-4216-b7a5-291ef61e89b7', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'mac_address': 'fa:16:3e:b9:79:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'device_owner': 'network:router_interface', 'standard_attr_id': 401, 'fixed_ips': [{'subnet_id': 'fc181126-7c66-44d3-b731-a59036bd562f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:21Z', 'updated_at': '2021-06-03T08:33:36Z', 'revision_number': 5, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'subnets': [{'id': 'fc181126-7c66-44d3-b731-a59036bd562f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:39:42.723918 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820'] for network, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:42.725440 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:39:42.726584 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:42.726708 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-64aa38be-ce4c-4eac-bbca-7b4f14f7dd1e req-a20d0d1d-5300-4a4e-b55c-a717d0a03bc7 service neutron] 10.222.0.55 "GET /v2.0/networks/4a053960-3cf4-4216-b7a5-291ef61e89b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1570294
Jun 03 08:39:42.731121 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:42.833067 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Pushing event updated for resources: {'Network': ['ID=3c41bee4-7ad8-4154-b861-f2ac707597e5,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:42.835719 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:42.843020 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Network 3c41bee4-7ad8-4154-b861-f2ac707597e5 details requested by agent ovs-agent-dv-cinder-787262-5-iscsi with host dv-cinder-787262-5-iscsi {{(pid=92325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 03 08:39:42.912465 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-57212df5-01db-4cb8-bd65-29ed98f53534 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201  len: 897 time: 0.9399512
Jun 03 08:39:42.912675 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 56226) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:42.918296 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-e8b03b64-8c5f-417d-a50c-4c50a9e8d4ca admin admin] Request body: {'subnet': {'network_id': '3c41bee4-7ad8-4154-b861-f2ac707597e5', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-312968730-subnet', 'tenant_id': 'f0519818198c4e009c3ea65e55926733', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:39:42.923370 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-e8b03b64-8c5f-417d-a50c-4c50a9e8d4ca admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:39:42.929108 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-e8b03b64-8c5f-417d-a50c-4c50a9e8d4ca admin admin] Usage tracker for resource:subnet and tenant:f0519818198c4e009c3ea65e55926733 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:39:42.932664 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-e8b03b64-8c5f-417d-a50c-4c50a9e8d4ca admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:39:42.940991 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-e8b03b64-8c5f-417d-a50c-4c50a9e8d4ca admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:39:42.960384 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-969d2fcb-fec5-4d7f-a9af-06f4931361f8 None None] New status for floating IP aa804224-baf6-4b3f-a57f-017c677d978b: DOWN {{(pid=92326) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 03 08:39:43.020637 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e8b03b64-8c5f-417d-a50c-4c50a9e8d4ca admin admin] Made reservation on behalf of f0519818198c4e009c3ea65e55926733 for: {'subnet': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:39:43.023091 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-e8b03b64-8c5f-417d-a50c-4c50a9e8d4ca admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14857961'] for subnet, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:43.499237 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-e8b03b64-8c5f-417d-a50c-4c50a9e8d4ca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-14211155', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14857887'] for subnet, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:43.503418 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-3b2dbf5c-f834-47b5-9b2e-732ece3cca65 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:43.574433 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8b03b64-8c5f-417d-a50c-4c50a9e8d4ca admin admin] Pushing event updated for resources: {'Subnet': ['ID=5708cd7a-867b-4288-9ae2-79852a55d47b,revision_number=0']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:43.577823 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-e8b03b64-8c5f-417d-a50c-4c50a9e8d4ca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:43.583628 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8b03b64-8c5f-417d-a50c-4c50a9e8d4ca admin admin] Checking segment: {'id': '95c0c056-9047-4438-b7a2-445fab9f6c71', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 538, 'network_id': '3c41bee4-7ad8-4154-b861-f2ac707597e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:39:43.583987 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e8b03b64-8c5f-417d-a50c-4c50a9e8d4ca admin admin] Network hostable DHCP agents. Network: 3c41bee4-7ad8-4154-b861-f2ac707597e5, hostable agents: ['07372699-02ac-4239-816f-84b3a5b0eff9'], hosted agents: [] {{(pid=92323) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 03 08:39:43.660220 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e8b03b64-8c5f-417d-a50c-4c50a9e8d4ca admin admin] Network 3c41bee4-7ad8-4154-b861-f2ac707597e5 is scheduled to be hosted by DHCP agent 07372699-02ac-4239-816f-84b3a5b0eff9 with binding_index 1 {{(pid=92323) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 03 08:39:43.797702 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-e8b03b64-8c5f-417d-a50c-4c50a9e8d4ca admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-5-iscsi, 3c41bee4-7ad8-4154-b861-f2ac707597e5) {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:39:43.807081 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a7fc184-de52-46f8-8d30-a52176319eb0 None None] Network 3c41bee4-7ad8-4154-b861-f2ac707597e5 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:39:43.818313 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8b03b64-8c5f-417d-a50c-4c50a9e8d4ca admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:39:43.818943 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-e8b03b64-8c5f-417d-a50c-4c50a9e8d4ca admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:43.918091 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-126a2257-ce29-4b1f-8ac2-61ef66b505ab req-3fe97650-7f57-4f8a-b0e3-b3e0d3e3f430 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:39:43.918851 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-126a2257-ce29-4b1f-8ac2-61ef66b505ab req-3fe97650-7f57-4f8a-b0e3-b3e0d3e3f430 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Synchronizing usage tracker for tenant:0e5e096a327f421e9b0a02235740cc36 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:39:43.925644 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-e8b03b64-8c5f-417d-a50c-4c50a9e8d4ca admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 861 time: 1.0119112
Jun 03 08:39:43.954742 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-998369b9-4704-47f0-84ab-8c0e12e13ff2 req-9de9ae4c-ab45-4eaa-a23c-817ee45ce6ce tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:39:43.955649 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-998369b9-4704-47f0-84ab-8c0e12e13ff2 req-9de9ae4c-ab45-4eaa-a23c-817ee45ce6ce tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Synchronizing usage tracker for tenant:0e5e096a327f421e9b0a02235740cc36 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:39:44.002909 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-59fe57fe-2a6b-4477-bf20-a9af268a3689 None None] Network 3c41bee4-7ad8-4154-b861-f2ac707597e5 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:39:44.050980 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-126a2257-ce29-4b1f-8ac2-61ef66b505ab req-3fe97650-7f57-4f8a-b0e3-b3e0d3e3f430 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Unset dirty status for tenant:0e5e096a327f421e9b0a02235740cc36 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:39:44.052082 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-126a2257-ce29-4b1f-8ac2-61ef66b505ab req-3fe97650-7f57-4f8a-b0e3-b3e0d3e3f430 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 946 time: 0.2907453
Jun 03 08:39:44.053301 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-998369b9-4704-47f0-84ab-8c0e12e13ff2 req-9de9ae4c-ab45-4eaa-a23c-817ee45ce6ce tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Unset dirty status for tenant:0e5e096a327f421e9b0a02235740cc36 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:39:44.054287 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-998369b9-4704-47f0-84ab-8c0e12e13ff2 req-9de9ae4c-ab45-4eaa-a23c-817ee45ce6ce tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.55 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 946 time: 0.2059600
Jun 03 08:39:44.155997 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-126a2257-ce29-4b1f-8ac2-61ef66b505ab req-0f85656d-0dcf-4c09-b602-106d992db826 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/security-groups?id=c0e8810d-eeaf-4d32-941d-aa11dff38d92&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0963688
Jun 03 08:39:44.238248 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-998369b9-4704-47f0-84ab-8c0e12e13ff2 req-f31e0ad7-eef2-464d-8115-119ed013906c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Deleting port 4312e3c9-0931-4dd5-ba11-db0d982c2a11 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:39:44.238737 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-998369b9-4704-47f0-84ab-8c0e12e13ff2 req-f31e0ad7-eef2-464d-8115-119ed013906c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:44.376618 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-998369b9-4704-47f0-84ab-8c0e12e13ff2 req-f31e0ad7-eef2-464d-8115-119ed013906c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] For port 4312e3c9-0931-4dd5-ba11-db0d982c2a11, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=4312e3c9-0931-4dd5-ba11-db0d982c2a11,segment=NetworkSegment(aaa5b128-9aff-431e-b567-4ca42a016de6),segment_id=aaa5b128-9aff-431e-b567-4ca42a016de6)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:39:44.376978 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-998369b9-4704-47f0-84ab-8c0e12e13ff2 req-f31e0ad7-eef2-464d-8115-119ed013906c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:44.510585 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-998369b9-4704-47f0-84ab-8c0e12e13ff2 req-f31e0ad7-eef2-464d-8115-119ed013906c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Calling delete_port for 4312e3c9-0931-4dd5-ba11-db0d982c2a11 owned by compute:nova {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:39:44.700807 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-998369b9-4704-47f0-84ab-8c0e12e13ff2 req-f31e0ad7-eef2-464d-8115-119ed013906c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:44.713365 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:44.725638 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56254) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:44.730763 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-666554496-network', 'tenant_id': '969ce87925f742038e0441f181c4be9c'}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:39:44.735487 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:39:44.739725 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Usage tracker for resource:network and tenant:969ce87925f742038e0441f181c4be9c is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:39:44.742834 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:39:44.749844 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:39:44.754024 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f31e0ad7-eef2-464d-8115-119ed013906c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Pushing event deleted for resources: {'Port': ['ID=4312e3c9-0931-4dd5-ba11-db0d982c2a11,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:44.758081 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f31e0ad7-eef2-464d-8115-119ed013906c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:44.841343 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-998369b9-4704-47f0-84ab-8c0e12e13ff2 req-f31e0ad7-eef2-464d-8115-119ed013906c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] No DVR routers for this DVR port 4312e3c9-0931-4dd5-ba11-db0d982c2a11 on host hv-cinder-78726 {{(pid=92323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:39:44.843747 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-998369b9-4704-47f0-84ab-8c0e12e13ff2 req-f31e0ad7-eef2-464d-8115-119ed013906c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:44.846665 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '80cea05e-57d7-4393-818e-b7a621e986ec', 'name': 'network-vif-deleted', 'tag': '4312e3c9-0931-4dd5-ba11-db0d982c2a11'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:39:44.849144 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7772e352-8b7f-4e9f-8d9d-68db5e89e1b1" -d '{"events": [{"server_uuid": "80cea05e-57d7-4393-818e-b7a621e986ec", "name": "network-vif-deleted", "tag": "4312e3c9-0931-4dd5-ba11-db0d982c2a11"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:39:44.891898 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:39:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3d45aec1-2db7-4b9d-9f4b-bdde7ce5ed74 x-openstack-request-id: req-3d45aec1-2db7-4b9d-9f4b-bdde7ce5ed74 {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:39:44.892229 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "80cea05e-57d7-4393-818e-b7a621e986ec", "name": "network-vif-deleted", "tag": "4312e3c9-0931-4dd5-ba11-db0d982c2a11", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:39:44.892545 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-3d45aec1-2db7-4b9d-9f4b-bdde7ce5ed74 {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:39:44.893576 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '80cea05e-57d7-4393-818e-b7a621e986ec', 'name': 'network-vif-deleted', 'tag': '4312e3c9-0931-4dd5-ba11-db0d982c2a11', 'status': 'completed', 'code': 200}
Jun 03 08:39:44.895267 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Made reservation on behalf of 969ce87925f742038e0441f181c4be9c for: {'network': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:39:44.897793 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-676039'] for network, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:44.910402 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:44.924689 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:39:44.928541 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Usage tracker for resource:security_group_rule and tenant:969ce87925f742038e0441f181c4be9c is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:39:44.931686 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:39:44.937384 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:39:44.981643 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-998369b9-4704-47f0-84ab-8c0e12e13ff2 req-f31e0ad7-eef2-464d-8115-119ed013906c tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.55 "DELETE /v2.0/ports/4312e3c9-0931-4dd5-ba11-db0d982c2a11 HTTP/1.1" status: 204  len: 173 time: 0.9076335
Jun 03 08:39:45.036324 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:45.117801 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:45.121084 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-82c877b8-af81-438b-ac2e-3aa5da9958e9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:45.154928 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] vlan segment allocate from pool success with {'vlan_id': 501, 'physical_network': 'physnet1'}  {{(pid=92324) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 03 08:39:45.160572 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3448695d-30c5-4099-bc7d-63f843476c30,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:45.164267 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:45.168718 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:45.168718 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.segments_db [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Added segment d02cc4f0-73df-44db-9a4e-db1468d01455 of type vlan for network 87ff1433-2514-4d21-a129-3d2f79a4693b
Jun 03 08:39:45.197293 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8774223827658'] for network, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:45.313226 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-13ab6b71-c2ba-4db8-8548-8c0a41f2b451 req-58e8874a-5462-45a0-8983-a4ee10c0868a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Synchronizing usage tracker for tenant:0e5e096a327f421e9b0a02235740cc36 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:39:45.344978 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820'] for network, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:45.346396 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:39:45.347055 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:45.351901 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:45.409696 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-13ab6b71-c2ba-4db8-8548-8c0a41f2b451 req-58e8874a-5462-45a0-8983-a4ee10c0868a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Unset dirty status for tenant:0e5e096a327f421e9b0a02235740cc36 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:39:45.410843 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-13ab6b71-c2ba-4db8-8548-8c0a41f2b451 req-58e8874a-5462-45a0-8983-a4ee10c0868a tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 210 time: 0.1400239
Jun 03 08:39:45.450399 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Pushing event updated for resources: {'Network': ['ID=87ff1433-2514-4d21-a129-3d2f79a4693b,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:45.453018 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:45.460307 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Network 87ff1433-2514-4d21-a129-3d2f79a4693b details requested by agent ovs-agent-dv-cinder-787262-5-iscsi with host dv-cinder-787262-5-iscsi {{(pid=92325) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 03 08:39:45.524664 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] 10.222.0.11 "POST /v2.0/networks HTTP/1.1" status: 201  len: 897 time: 0.7978251
Jun 03 08:39:45.527422 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56262) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:45.532669 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.v2.base [None req-bee142c7-1dfa-4b3a-b2d8-5e395dfbbeed admin admin] Request body: {'subnet': {'network_id': '87ff1433-2514-4d21-a129-3d2f79a4693b', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-666554496-subnet', 'tenant_id': '969ce87925f742038e0441f181c4be9c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92324) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:39:45.538592 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-bee142c7-1dfa-4b3a-b2d8-5e395dfbbeed admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:39:45.542354 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-bee142c7-1dfa-4b3a-b2d8-5e395dfbbeed admin admin] Usage tracker for resource:subnet and tenant:969ce87925f742038e0441f181c4be9c is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:39:45.545309 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-bee142c7-1dfa-4b3a-b2d8-5e395dfbbeed admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:39:45.552680 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-bee142c7-1dfa-4b3a-b2d8-5e395dfbbeed admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:39:45.734945 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bee142c7-1dfa-4b3a-b2d8-5e395dfbbeed admin admin] Made reservation on behalf of 969ce87925f742038e0441f181c4be9c for: {'subnet': 1} {{(pid=92324) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:39:45.738374 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-bee142c7-1dfa-4b3a-b2d8-5e395dfbbeed admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14870279'] for subnet, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:46.272736 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-bee142c7-1dfa-4b3a-b2d8-5e395dfbbeed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15641492', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14870385'] for subnet, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:46.277119 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:46.346791 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bee142c7-1dfa-4b3a-b2d8-5e395dfbbeed admin admin] Pushing event updated for resources: {'Subnet': ['ID=07d9a25d-6d2a-4b7a-bcc5-6c0a514417c6,revision_number=0']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:46.356598 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-bee142c7-1dfa-4b3a-b2d8-5e395dfbbeed admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:46.364719 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bee142c7-1dfa-4b3a-b2d8-5e395dfbbeed admin admin] Checking segment: {'id': 'd02cc4f0-73df-44db-9a4e-db1468d01455', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 501, 'network_id': '87ff1433-2514-4d21-a129-3d2f79a4693b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92324) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:39:46.365240 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bee142c7-1dfa-4b3a-b2d8-5e395dfbbeed admin admin] Network hostable DHCP agents. Network: 87ff1433-2514-4d21-a129-3d2f79a4693b, hostable agents: ['07372699-02ac-4239-816f-84b3a5b0eff9'], hosted agents: [] {{(pid=92324) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 03 08:39:46.534099 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bee142c7-1dfa-4b3a-b2d8-5e395dfbbeed admin admin] Network 87ff1433-2514-4d21-a129-3d2f79a4693b is scheduled to be hosted by DHCP agent 07372699-02ac-4239-816f-84b3a5b0eff9 with binding_index 1 {{(pid=92324) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 03 08:39:46.637733 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.base_scheduler [None req-bee142c7-1dfa-4b3a-b2d8-5e395dfbbeed admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-5-iscsi, 87ff1433-2514-4d21-a129-3d2f79a4693b) {{(pid=92324) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:39:46.648852 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a3afc08-5115-4a79-8b60-f48bbd05ff2e None None] Network 87ff1433-2514-4d21-a129-3d2f79a4693b requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:39:46.653143 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bee142c7-1dfa-4b3a-b2d8-5e395dfbbeed admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:39:46.653768 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-bee142c7-1dfa-4b3a-b2d8-5e395dfbbeed admin admin] Notify callbacks [] for subnet, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:46.722834 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-3864ba74-724b-465a-af36-5aaab7abadce req-84c735d9-7523-455f-851d-942054dd2915 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "GET /v2.0/ports?device_id=80cea05e-57d7-4393-818e-b7a621e986ec HTTP/1.1" status: 200  len: 210 time: 0.0424385
Jun 03 08:39:46.754228 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-bee142c7-1dfa-4b3a-b2d8-5e395dfbbeed admin admin] 10.222.0.11 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 861 time: 1.2255363
Jun 03 08:39:46.755087 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 4312e3c9-0931-4dd5-ba11-db0d982c2a11 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:39:46.795518 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] No Port match for: 4312e3c9-0931-4dd5-ba11-db0d982c2a11 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:39:46.795789 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 4312e3c9-0931-4dd5-ba11-db0d982c2a11 not bound to the agent host hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:39:46.901526 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ebc8bba0-4e8a-45c9-a726-c76bf0fdb9b7 None None] Network 87ff1433-2514-4d21-a129-3d2f79a4693b requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:39:46.914923 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 56274) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:47.078785 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_v2 [None req-540787b1-dc04-451f-8ca4-41a46a349f5a admin admin] Deleting subnet 5708cd7a-867b-4288-9ae2-79852a55d47b {{(pid=92323) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 03 08:39:47.082253 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-540787b1-dc04-451f-8ca4-41a46a349f5a admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:47.137202 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-540787b1-dc04-451f-8ca4-41a46a349f5a admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14518184'] for subnet, precommit_delete_associations {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:47.193315 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-540787b1-dc04-451f-8ca4-41a46a349f5a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-862421'] for subnet, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:47.516702 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-540787b1-dc04-451f-8ca4-41a46a349f5a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-862434', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14211216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14857862'] for subnet, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:47.522928 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f2386a22-481a-4b8b-83d7-dc19d7078074 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:47.559079 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-540787b1-dc04-451f-8ca4-41a46a349f5a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5708cd7a-867b-4288-9ae2-79852a55d47b,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:47.562410 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-540787b1-dc04-451f-8ca4-41a46a349f5a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:47.563418 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-540787b1-dc04-451f-8ca4-41a46a349f5a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:47.570109 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-540787b1-dc04-451f-8ca4-41a46a349f5a admin admin] 10.222.0.11 "DELETE /v2.0/subnets/5708cd7a-867b-4288-9ae2-79852a55d47b HTTP/1.1" status: 204  len: 168 time: 0.6541419
Jun 03 08:39:47.572570 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 56280) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:47.679045 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1c98a60c-4309-4d5e-bf89-1f6ed7d570f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-529010'] for network, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:47.819801 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1c98a60c-4309-4d5e-bf89-1f6ed7d570f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-862046', 'neutron.services.segments.db._delete_segments_for_network-8774224358894'] for network, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:47.836100 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-1c98a60c-4309-4d5e-bf89-1f6ed7d570f1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fae85260910>,) {'filters': {'network_id': ['3c41bee4-7ad8-4154-b861-f2ac707597e5']}} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:47.850681 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-1c98a60c-4309-4d5e-bf89-1f6ed7d570f1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fae85260910>, '95c0c056-9047-4438-b7a2-445fab9f6c71') {'for_net_delete': True} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:47.851010 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-1c98a60c-4309-4d5e-bf89-1f6ed7d570f1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fae85260910>, '95c0c056-9047-4438-b7a2-445fab9f6c71') {} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:47.864139 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1c98a60c-4309-4d5e-bf89-1f6ed7d570f1 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8774224362253', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14518195'] for segment, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:47.882707 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1c98a60c-4309-4d5e-bf89-1f6ed7d570f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:47.889510 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1c98a60c-4309-4d5e-bf89-1f6ed7d570f1 admin admin] Releasing vlan 538 on physical network physnet1 to pool {{(pid=92323) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 03 08:39:47.889911 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1c98a60c-4309-4d5e-bf89-1f6ed7d570f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14211322'] for segment, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]: Traceback (most recent call last):
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:     timer()
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:     cb(*args, **kw)
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:     return func(*args, **kwargs)
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:     self._notify()
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:     self.callback(batched_events)
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:     event.method(event)
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:     return f(self, *a, **k)
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self._get(url).json()
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self.request(url, 'GET', **kwargs)
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 03 08:39:47.904849 dv-cinder-787262-5-iscsi neutron-server[92323]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 03 08:39:47.986649 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 56284) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:48.058503 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-e027d018-25a9-418e-bba1-eb176d6e5939 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:48.069454 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1c98a60c-4309-4d5e-bf89-1f6ed7d570f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-862039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16327709'] for network, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:48.078540 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:48.091045 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1c98a60c-4309-4d5e-bf89-1f6ed7d570f1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:48.113092 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c98a60c-4309-4d5e-bf89-1f6ed7d570f1 admin admin] Pushing event deleted for resources: {'Network': ['ID=3c41bee4-7ad8-4154-b861-f2ac707597e5,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:48.116452 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-e027d018-25a9-418e-bba1-eb176d6e5939 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:48.124458 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-1c98a60c-4309-4d5e-bf89-1f6ed7d570f1 admin admin] 10.222.0.11 "DELETE /v2.0/networks/3c41bee4-7ad8-4154-b861-f2ac707597e5 HTTP/1.1" status: 204  len: 168 time: 0.5509453
Jun 03 08:39:48.125404 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-1c98a60c-4309-4d5e-bf89-1f6ed7d570f1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:48.128600 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56286) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:48.199313 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.db_base_plugin_v2 [None req-44fcf660-a051-4c9f-877c-cf884402b446 admin admin] Deleting subnet 07d9a25d-6d2a-4b7a-bcc5-6c0a514417c6 {{(pid=92324) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 03 08:39:48.202683 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-44fcf660-a051-4c9f-877c-cf884402b446 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:48.253175 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-44fcf660-a051-4c9f-877c-cf884402b446 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-15250429'] for subnet, precommit_delete_associations {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:48.289548 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-e027d018-25a9-418e-bba1-eb176d6e5939 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:48.294049 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b34434b0-4818-488b-89dd-96178baa7262 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:48.314241 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-44fcf660-a051-4c9f-877c-cf884402b446 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-862421'] for subnet, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:48.318934 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e027d018-25a9-418e-bba1-eb176d6e5939 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c0e8810d-eeaf-4d32-941d-aa11dff38d92,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:48.322303 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-e027d018-25a9-418e-bba1-eb176d6e5939 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:48.402710 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-e027d018-25a9-418e-bba1-eb176d6e5939 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:48.403957 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-e027d018-25a9-418e-bba1-eb176d6e5939 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] 10.222.0.11 "DELETE /v2.0/security-groups/c0e8810d-eeaf-4d32-941d-aa11dff38d92 HTTP/1.1" status: 204  len: 168 time: 0.4156446
Jun 03 08:39:48.513271 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 56294) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:48.735428 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-44fcf660-a051-4c9f-877c-cf884402b446 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-862434', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15641431', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14870376'] for subnet, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:48.741478 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f6fad4d3-b6d4-462a-aa03-90228b1bb53f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:48.780075 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44fcf660-a051-4c9f-877c-cf884402b446 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=07d9a25d-6d2a-4b7a-bcc5-6c0a514417c6,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:48.781996 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-44fcf660-a051-4c9f-877c-cf884402b446 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:48.786066 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-44fcf660-a051-4c9f-877c-cf884402b446 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:48.790042 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-44fcf660-a051-4c9f-877c-cf884402b446 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/07d9a25d-6d2a-4b7a-bcc5-6c0a514417c6 HTTP/1.1" status: 204  len: 168 time: 0.6604173
Jun 03 08:39:48.792647 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56298) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:48.902618 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e8cbede9-38cf-4504-9faa-2ac2d7f49201 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-529010'] for network, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:49.036712 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e8cbede9-38cf-4504-9faa-2ac2d7f49201 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-862046', 'neutron.services.segments.db._delete_segments_for_network-8774224358894'] for network, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:49.051654 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-e8cbede9-38cf-4504-9faa-2ac2d7f49201 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fae85daddc0>,) {'filters': {'network_id': ['87ff1433-2514-4d21-a129-3d2f79a4693b']}} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:49.064180 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-e8cbede9-38cf-4504-9faa-2ac2d7f49201 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fae85daddc0>, 'd02cc4f0-73df-44db-9a4e-db1468d01455') {'for_net_delete': True} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:49.064474 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-e8cbede9-38cf-4504-9faa-2ac2d7f49201 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fae85daddc0>, 'd02cc4f0-73df-44db-9a4e-db1468d01455') {} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:49.075659 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e8cbede9-38cf-4504-9faa-2ac2d7f49201 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8774224362253', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-15250406'] for segment, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:49.092285 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e8cbede9-38cf-4504-9faa-2ac2d7f49201 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:49.098826 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e8cbede9-38cf-4504-9faa-2ac2d7f49201 admin admin] Releasing vlan 501 on physical network physnet1 to pool {{(pid=92324) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 03 08:39:49.099214 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e8cbede9-38cf-4504-9faa-2ac2d7f49201 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15641405'] for segment, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]: Traceback (most recent call last):
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:     timer()
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:     cb(*args, **kw)
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:     return func(*args, **kwargs)
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:     self._notify()
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:     self.callback(batched_events)
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:     event.method(event)
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:     return f(self, *a, **k)
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self._get(url).json()
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self.request(url, 'GET', **kwargs)
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 03 08:39:49.112514 dv-cinder-787262-5-iscsi neutron-server[92324]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 03 08:39:49.266598 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e8cbede9-38cf-4504-9faa-2ac2d7f49201 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-862039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16327709'] for network, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:49.271153 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-fb2a25d4-7b07-4f6c-8a0d-3a71dbd256d3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:49.284616 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e8cbede9-38cf-4504-9faa-2ac2d7f49201 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:49.293586 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8cbede9-38cf-4504-9faa-2ac2d7f49201 admin admin] Pushing event deleted for resources: {'Network': ['ID=87ff1433-2514-4d21-a129-3d2f79a4693b,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:49.299195 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-e8cbede9-38cf-4504-9faa-2ac2d7f49201 admin admin] 10.222.0.11 "DELETE /v2.0/networks/87ff1433-2514-4d21-a129-3d2f79a4693b HTTP/1.1" status: 204  len: 168 time: 0.5030344
Jun 03 08:39:49.299195 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e8cbede9-38cf-4504-9faa-2ac2d7f49201 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:49.334677 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1a753a11-3083-4b60-8c97-ee8aa9f42b7e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-16328733'] for router_interface, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:49.631040 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56306) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:49.682561 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-4fe98508-a346-493e-ae18-6d348e9a449e admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=f0519818198c4e009c3ea65e55926733&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0462935
Jun 03 08:39:49.684098 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56308) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:49.747365 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-c80a9f61-84c7-40c9-b52e-6a1a53320352 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:49.747646 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-1a753a11-3083-4b60-8c97-ee8aa9f42b7e admin admin] Deleting port ce979b40-484e-45cd-a6cb-a3940bb7a659 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:39:49.747765 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1a753a11-3083-4b60-8c97-ee8aa9f42b7e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:49.774460 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-c80a9f61-84c7-40c9-b52e-6a1a53320352 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:49.870309 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [None req-1a753a11-3083-4b60-8c97-ee8aa9f42b7e admin admin] For port ce979b40-484e-45cd-a6cb-a3940bb7a659, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=ce979b40-484e-45cd-a6cb-a3940bb7a659,segment=NetworkSegment(aaa5b128-9aff-431e-b567-4ca42a016de6),segment_id=aaa5b128-9aff-431e-b567-4ca42a016de6)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:39:49.870729 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1a753a11-3083-4b60-8c97-ee8aa9f42b7e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:49.946023 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-c80a9f61-84c7-40c9-b52e-6a1a53320352 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:49.951101 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-1e934078-068b-46e9-a4d0-b3a6b9962ee9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:49.963236 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c80a9f61-84c7-40c9-b52e-6a1a53320352 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=372c0251-dedb-4696-9ac9-4c456a53139a,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:49.965535 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-c80a9f61-84c7-40c9-b52e-6a1a53320352 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:49.979341 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-c80a9f61-84c7-40c9-b52e-6a1a53320352 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:49.980544 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-c80a9f61-84c7-40c9-b52e-6a1a53320352 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/372c0251-dedb-4696-9ac9-4c456a53139a HTTP/1.1" status: 204  len: 168 time: 0.2954693
Jun 03 08:39:49.999754 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-1a753a11-3083-4b60-8c97-ee8aa9f42b7e admin admin] Calling delete_port for ce979b40-484e-45cd-a6cb-a3940bb7a659 owned by network:router_interface {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:39:50.278148 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1a753a11-3083-4b60-8c97-ee8aa9f42b7e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:50.284215 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-30b03c07-a902-4bf4-a2c9-caef2f0e8823 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:50.336049 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a753a11-3083-4b60-8c97-ee8aa9f42b7e admin admin] Pushing event deleted for resources: {'Port': ['ID=ce979b40-484e-45cd-a6cb-a3940bb7a659,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:50.362517 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-1a753a11-3083-4b60-8c97-ee8aa9f42b7e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:50.629923 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1a753a11-3083-4b60-8c97-ee8aa9f42b7e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-16344783', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-16328833'] for router_interface, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:50.781900 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56318) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:50.842622 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-4f23fdd7-3101-49cc-860b-917a0082340d admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=969ce87925f742038e0441f181c4be9c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0590415
Jun 03 08:39:50.844740 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56320) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:50.925780 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-3b5c5377-c3ce-49d1-907b-67d7a4632e0b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:50.952089 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-3b5c5377-c3ce-49d1-907b-67d7a4632e0b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:51.083451 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-3b5c5377-c3ce-49d1-907b-67d7a4632e0b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:51.088484 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-ae3caddf-aeaf-4b08-ad34-def2012f62b5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:51.095366 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1a753a11-3083-4b60-8c97-ee8aa9f42b7e admin admin] Router 02c1b0e4-a9b8-4fc7-af87-8069fb4caced has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:39:51.102382 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b5c5377-c3ce-49d1-907b-67d7a4632e0b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3448695d-30c5-4099-bc7d-63f843476c30,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:51.104661 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-3b5c5377-c3ce-49d1-907b-67d7a4632e0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:51.107118 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-3b5c5377-c3ce-49d1-907b-67d7a4632e0b admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:51.110123 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-3b5c5377-c3ce-49d1-907b-67d7a4632e0b admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/3448695d-30c5-4099-bc7d-63f843476c30 HTTP/1.1" status: 204  len: 168 time: 0.2622623
Jun 03 08:39:51.280898 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1a753a11-3083-4b60-8c97-ee8aa9f42b7e admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:39:51.290206 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95f146a6-38ea-4299-87a9-559a7a5bf629 None None] Sync routers for ids ['02c1b0e4-a9b8-4fc7-af87-8069fb4caced'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:39:51.299336 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95f146a6-38ea-4299-87a9-559a7a5bf629 None None] Routers {'02c1b0e4-a9b8-4fc7-af87-8069fb4caced'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:39:51.299925 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-95f146a6-38ea-4299-87a9-559a7a5bf629 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae8602a4f0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:39:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['02c1b0e4-a9b8-4fc7-af87-8069fb4caced'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:51.354922 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-1a753a11-3083-4b60-8c97-ee8aa9f42b7e admin admin] 10.222.0.11 "PUT /v2.0/routers/02c1b0e4-a9b8-4fc7-af87-8069fb4caced/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.8395383
Jun 03 08:39:51.356391 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 56324) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:51.505174 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-95f146a6-38ea-4299-87a9-559a7a5bf629 None None] Set router 02c1b0e4-a9b8-4fc7-af87-8069fb4caced gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:39:51.542562 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-21078dfc-8c75-4746-840c-8757302158ae admin admin] Notify callbacks [] for router, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:51.716428 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-21078dfc-8c75-4746-840c-8757302158ae admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:51.809057 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-95f146a6-38ea-4299-87a9-559a7a5bf629 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae8602a4f0>, [{'id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'name': 'tempest-TestShelveInstance-1807805368-router', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155'}], 'enable_snat': True}, 'gw_port_id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:06Z', 'updated_at': '2021-06-03T08:39:50Z', 'revision_number': 5, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'gw_port': {'id': 'bea952c0-6612-45c9-abe7-1c904d1c4f14', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:4e:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.155', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:10Z', 'updated_at': '2021-06-03T08:33:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:51.813394 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95f146a6-38ea-4299-87a9-559a7a5bf629 None None] Checking router: 02c1b0e4-a9b8-4fc7-af87-8069fb4caced for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:39:51.823698 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95f146a6-38ea-4299-87a9-559a7a5bf629 None None] Routers {'02c1b0e4-a9b8-4fc7-af87-8069fb4caced'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:39:51.824317 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-95f146a6-38ea-4299-87a9-559a7a5bf629 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae8602a4f0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:39:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['02c1b0e4-a9b8-4fc7-af87-8069fb4caced'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:51.891242 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-21078dfc-8c75-4746-840c-8757302158ae admin admin] Deleting port bea952c0-6612-45c9-abe7-1c904d1c4f14 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:39:51.891659 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-21078dfc-8c75-4746-840c-8757302158ae admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:51.980450 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-95f146a6-38ea-4299-87a9-559a7a5bf629 None None] Set router 02c1b0e4-a9b8-4fc7-af87-8069fb4caced gateway port host: None {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:39:52.012209 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [None req-21078dfc-8c75-4746-840c-8757302158ae admin admin] For port bea952c0-6612-45c9-abe7-1c904d1c4f14, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=bea952c0-6612-45c9-abe7-1c904d1c4f14,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:39:52.012582 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-21078dfc-8c75-4746-840c-8757302158ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:52.144201 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-95f146a6-38ea-4299-87a9-559a7a5bf629 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae8602a4f0>, [{'id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'name': 'tempest-TestShelveInstance-1807805368-router', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:06Z', 'updated_at': '2021-06-03T08:39:51Z', 'revision_number': 6, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'gw_port_host': None}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:52.148387 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95f146a6-38ea-4299-87a9-559a7a5bf629 None None] The sync data for ids ['02c1b0e4-a9b8-4fc7-af87-8069fb4caced'] in dv-cinder-787262-5-iscsi is: [{'id': '02c1b0e4-a9b8-4fc7-af87-8069fb4caced', 'name': 'tempest-TestShelveInstance-1807805368-router', 'tenant_id': '0e5e096a327f421e9b0a02235740cc36', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:06Z', 'updated_at': '2021-06-03T08:39:51Z', 'revision_number': 6, 'project_id': '0e5e096a327f421e9b0a02235740cc36', 'gw_port_host': None}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:39:52.149380 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-21078dfc-8c75-4746-840c-8757302158ae admin admin] Calling delete_port for bea952c0-6612-45c9-abe7-1c904d1c4f14 owned by network:router_gateway {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:39:52.350954 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-21078dfc-8c75-4746-840c-8757302158ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:52.355684 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-03615844-cb86-42b3-8d36-b44b0d55346b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:52.399501 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21078dfc-8c75-4746-840c-8757302158ae admin admin] Pushing event deleted for resources: {'Port': ['ID=bea952c0-6612-45c9-abe7-1c904d1c4f14,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:52.430451 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-21078dfc-8c75-4746-840c-8757302158ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:52.617720 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device ce979b40-484e-45cd-a6cb-a3940bb7a659 no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:39:52.618787 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-21078dfc-8c75-4746-840c-8757302158ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-16327738'] for router_gateway, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:52.660420 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: ce979b40-484e-45cd-a6cb-a3940bb7a659 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:39:52.660771 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device ce979b40-484e-45cd-a6cb-a3940bb7a659 not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:39:52.788732 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-21078dfc-8c75-4746-840c-8757302158ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-16388336', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2351'] for router, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:52.790880 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-21078dfc-8c75-4746-840c-8757302158ae admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:52.890022 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-21078dfc-8c75-4746-840c-8757302158ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-16388448'] for router, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:52.890682 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-21078dfc-8c75-4746-840c-8757302158ae admin admin] Fanout notify agent at l3_agent the message router_deleted on router 02c1b0e4-a9b8-4fc7-af87-8069fb4caced {{(pid=92323) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 03 08:39:52.907244 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-21078dfc-8c75-4746-840c-8757302158ae admin admin] Notify callbacks [] for router, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:52.908954 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-21078dfc-8c75-4746-840c-8757302158ae admin admin] 10.222.0.11 "DELETE /v2.0/routers/02c1b0e4-a9b8-4fc7-af87-8069fb4caced HTTP/1.1" status: 204  len: 168 time: 1.5510664
Jun 03 08:39:52.911492 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 56356) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:52.971168 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_v2 [None req-1ec47104-167a-459b-b031-e88a08e86f24 admin admin] Deleting subnet fc181126-7c66-44d3-b731-a59036bd562f {{(pid=92323) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 03 08:39:52.978590 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1ec47104-167a-459b-b031-e88a08e86f24 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:53.027136 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1ec47104-167a-459b-b031-e88a08e86f24 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14518184'] for subnet, precommit_delete_associations {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:53.114118 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1ec47104-167a-459b-b031-e88a08e86f24 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-862421'] for subnet, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:53.489921 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1ec47104-167a-459b-b031-e88a08e86f24 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-862434', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14211216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14857862'] for subnet, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:53.493903 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:53.527123 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ec47104-167a-459b-b031-e88a08e86f24 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fc181126-7c66-44d3-b731-a59036bd562f,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:53.529784 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-1ec47104-167a-459b-b031-e88a08e86f24 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:53.534328 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1ec47104-167a-459b-b031-e88a08e86f24 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:53.539621 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae81527e-8270-47eb-bc83-de79c23b7f92 None None] Network 4a053960-3cf4-4216-b7a5-291ef61e89b7 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:39:53.541477 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-1ec47104-167a-459b-b031-e88a08e86f24 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/fc181126-7c66-44d3-b731-a59036bd562f HTTP/1.1" status: 204  len: 168 time: 0.6289005
Jun 03 08:39:53.543845 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56366) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:53.655635 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-529010'] for network, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:53.743303 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] Deleting port 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63 {{(pid=92324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:39:53.743663 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:53.816232 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-79c64fa1-aa49-443d-9eab-8240a23aded5 None None] DHCP port deletion for 4a053960-3cf4-4216-b7a5-291ef61e89b7 request from dv-cinder-787262-5-iscsi {{(pid=92325) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 03 08:39:53.834773 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 56372) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:53.849310 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.db [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] For port 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=4c8a9990-58ca-4dbf-ad59-9ae166e2fd63,segment=NetworkSegment(aaa5b128-9aff-431e-b567-4ca42a016de6),segment_id=aaa5b128-9aff-431e-b567-4ca42a016de6)] {{(pid=92324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:39:53.849698 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:53.883603 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-79c64fa1-aa49-443d-9eab-8240a23aded5 None None] Deleting port 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63 {{(pid=92325) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:39:53.883991 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-79c64fa1-aa49-443d-9eab-8240a23aded5 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:53.959825 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-00b9bb39-67f2-4d60-83a5-a3ae627b6a2a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:53.976620 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-00b9bb39-67f2-4d60-83a5-a3ae627b6a2a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:39:53.979131 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] Calling delete_port for 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63 owned by network:dhcp {{(pid=92324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:39:53.981237 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-00b9bb39-67f2-4d60-83a5-a3ae627b6a2a admin admin] Usage tracker for resource:security_group_rule and tenant:1651d509bc7b4669985d04e3d45d0655 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:39:53.984384 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-00b9bb39-67f2-4d60-83a5-a3ae627b6a2a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:39:53.990325 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-00b9bb39-67f2-4d60-83a5-a3ae627b6a2a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:39:53.997715 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-79c64fa1-aa49-443d-9eab-8240a23aded5 None None] For port 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=4c8a9990-58ca-4dbf-ad59-9ae166e2fd63,segment=NetworkSegment(aaa5b128-9aff-431e-b567-4ca42a016de6),segment_id=aaa5b128-9aff-431e-b567-4ca42a016de6)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:39:53.998346 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-79c64fa1-aa49-443d-9eab-8240a23aded5 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:54.079751 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-00b9bb39-67f2-4d60-83a5-a3ae627b6a2a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:54.124076 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-79c64fa1-aa49-443d-9eab-8240a23aded5 None None] Calling delete_port for 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63 owned by network:dhcp {{(pid=92325) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:39:54.220936 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:54.221170 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-00b9bb39-67f2-4d60-83a5-a3ae627b6a2a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:54.226367 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-0b3776e3-d1a5-411d-b4cf-8be8d83d0284 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:54.227249 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-79c64fa1-aa49-443d-9eab-8240a23aded5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151'] for port, after_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:54.230196 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b2c46e40-d7b2-4a00-8293-43660b729d0d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:54.232133 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:54.270821 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] Pushing event deleted for resources: {'Port': ['ID=4c8a9990-58ca-4dbf-ad59-9ae166e2fd63,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:54.274048 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-00b9bb39-67f2-4d60-83a5-a3ae627b6a2a admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=1651d509bc7b4669985d04e3d45d0655&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4358258
Jun 03 08:39:54.274205 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] No DVR routers for this DVR port 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63 on host dv-cinder-787262-5-iscsi {{(pid=92324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:39:54.274855 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56376) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:54.274985 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00b9bb39-67f2-4d60-83a5-a3ae627b6a2a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=146933cb-29dd-4ac2-8ade-163fae83e190,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:54.276969 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:54.278274 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-00b9bb39-67f2-4d60-83a5-a3ae627b6a2a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:54.290466 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79c64fa1-aa49-443d-9eab-8240a23aded5 None None] Pushing event deleted for resources: {'Port': ['ID=4c8a9990-58ca-4dbf-ad59-9ae166e2fd63,revision_number=None']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:54.293306 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-79c64fa1-aa49-443d-9eab-8240a23aded5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:54.294163 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79c64fa1-aa49-443d-9eab-8240a23aded5 None None] No DVR routers for this DVR port 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63 on host dv-cinder-787262-5-iscsi {{(pid=92325) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:39:54.418758 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63 no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:39:54.455309 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:39:54.455675 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 4c8a9990-58ca-4dbf-ad59-9ae166e2fd63 not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:39:54.456109 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device bea952c0-6612-45c9-abe7-1c904d1c4f14 no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:39:54.491253 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: bea952c0-6612-45c9-abe7-1c904d1c4f14 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:39:54.491644 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device bea952c0-6612-45c9-abe7-1c904d1c4f14 not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:39:54.533818 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-862046', 'neutron.services.segments.db._delete_segments_for_network-8774224358894'] for network, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:54.554833 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fae8693ad30>,) {'filters': {'network_id': ['4a053960-3cf4-4216-b7a5-291ef61e89b7']}} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:54.580990 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fae8693ad30>, 'aaa5b128-9aff-431e-b567-4ca42a016de6') {'for_net_delete': True} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:54.585352 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fae8693ad30>, 'aaa5b128-9aff-431e-b567-4ca42a016de6') {} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:54.598190 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8774224362253', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-15250406'] for segment, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:54.604195 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-4629dd27-faad-4f1a-9c39-dbd571c83ed2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:54.629298 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:54.640690 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-4629dd27-faad-4f1a-9c39-dbd571c83ed2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:54.647313 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] Releasing vlan 503 on physical network physnet1 to pool {{(pid=92324) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 03 08:39:54.647702 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15641405'] for segment, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]: Traceback (most recent call last):
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:     timer()
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:     cb(*args, **kw)
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:     return func(*args, **kwargs)
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:     self._notify()
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:     self.callback(batched_events)
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:     event.method(event)
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:     return f(self, *a, **k)
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self._get(url).json()
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self.request(url, 'GET', **kwargs)
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 03 08:39:54.661225 dv-cinder-787262-5-iscsi neutron-server[92324]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 03 08:39:54.872409 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-862039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16327709'] for network, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:54.876310 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:54.893867 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:54.907196 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] Pushing event deleted for resources: {'Network': ['ID=4a053960-3cf4-4216-b7a5-291ef61e89b7,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:54.907196 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:54.913268 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-4629dd27-faad-4f1a-9c39-dbd571c83ed2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:54.918624 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-5cf653c2-2b12-4dc1-9a61-23a32c229f64 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:54.938663 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4629dd27-faad-4f1a-9c39-dbd571c83ed2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=146933cb-29dd-4ac2-8ade-163fae83e190,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:54.941515 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-4629dd27-faad-4f1a-9c39-dbd571c83ed2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:55.021928 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-228cae21-bbaa-4b8c-8e43-238105894d4f admin admin] 10.222.0.11 "DELETE /v2.0/networks/4a053960-3cf4-4216-b7a5-291ef61e89b7 HTTP/1.1" status: 204  len: 168 time: 1.4764979
Jun 03 08:39:55.024748 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 56384) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:55.025232 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-4629dd27-faad-4f1a-9c39-dbd571c83ed2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:55.025943 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-4629dd27-faad-4f1a-9c39-dbd571c83ed2 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/146933cb-29dd-4ac2-8ade-163fae83e190 HTTP/1.1" status: 204  len: 168 time: 0.7500565
Jun 03 08:39:55.571189 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f1531550-a901-4dca-8110-2d105e817599 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-16328733'] for router_interface, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:55.910335 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56396) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:55.928387 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e49de4c9-fe9a-48d3-bcbe-3a7552b310af admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:55.943052 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-e49de4c9-fe9a-48d3-bcbe-3a7552b310af admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:39:55.946823 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-e49de4c9-fe9a-48d3-bcbe-3a7552b310af admin admin] Usage tracker for resource:security_group_rule and tenant:6a39f2488d5d4f98af2d0e99150678e1 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:39:55.949654 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-e49de4c9-fe9a-48d3-bcbe-3a7552b310af admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:39:55.955958 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-e49de4c9-fe9a-48d3-bcbe-3a7552b310af admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:39:56.045414 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e49de4c9-fe9a-48d3-bcbe-3a7552b310af admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:56.085996 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-f1531550-a901-4dca-8110-2d105e817599 admin admin] Deleting port 11f176f0-69e3-4e65-9c89-e099ea83fe6a {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:39:56.086542 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f1531550-a901-4dca-8110-2d105e817599 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:56.139264 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e49de4c9-fe9a-48d3-bcbe-3a7552b310af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:56.149056 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-02f75687-fc25-43cf-9060-ba9bfe17a4c0 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:56.175680 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:56.192830 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-e49de4c9-fe9a-48d3-bcbe-3a7552b310af admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=6a39f2488d5d4f98af2d0e99150678e1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2813702
Jun 03 08:39:56.200321 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 56400) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:56.201320 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e49de4c9-fe9a-48d3-bcbe-3a7552b310af admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9d4577ec-d6e5-41e4-baa6-15897b775131,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:56.203790 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e49de4c9-fe9a-48d3-bcbe-3a7552b310af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:56.234116 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [None req-f1531550-a901-4dca-8110-2d105e817599 admin admin] For port 11f176f0-69e3-4e65-9c89-e099ea83fe6a, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=11f176f0-69e3-4e65-9c89-e099ea83fe6a,segment=NetworkSegment(eb60ee44-2fee-4938-bb69-42ff628ee059),segment_id=eb60ee44-2fee-4938-bb69-42ff628ee059)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:39:56.234452 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f1531550-a901-4dca-8110-2d105e817599 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:56.375918 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-f1531550-a901-4dca-8110-2d105e817599 admin admin] Calling delete_port for 11f176f0-69e3-4e65-9c89-e099ea83fe6a owned by network:router_interface {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:39:56.407219 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-51603fa8-5586-4e04-9cfc-3439acb1c2fa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:56.441152 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-51603fa8-5586-4e04-9cfc-3439acb1c2fa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:56.603267 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-51603fa8-5586-4e04-9cfc-3439acb1c2fa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:56.607065 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-34a7f030-754f-4228-a656-2a84b54a74be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:56.620193 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51603fa8-5586-4e04-9cfc-3439acb1c2fa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9d4577ec-d6e5-41e4-baa6-15897b775131,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:56.623881 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-51603fa8-5586-4e04-9cfc-3439acb1c2fa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:56.666227 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f1531550-a901-4dca-8110-2d105e817599 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:56.671033 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:56.715447 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1531550-a901-4dca-8110-2d105e817599 admin admin] Pushing event deleted for resources: {'Port': ['ID=11f176f0-69e3-4e65-9c89-e099ea83fe6a,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:56.722287 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f1531550-a901-4dca-8110-2d105e817599 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:56.802647 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-51603fa8-5586-4e04-9cfc-3439acb1c2fa admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:56.805281 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-51603fa8-5586-4e04-9cfc-3439acb1c2fa admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/9d4577ec-d6e5-41e4-baa6-15897b775131 HTTP/1.1" status: 204  len: 168 time: 0.6100605
Jun 03 08:39:57.001333 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f1531550-a901-4dca-8110-2d105e817599 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-16344783', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-16328833'] for router_interface, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:57.482547 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f1531550-a901-4dca-8110-2d105e817599 admin admin] Router c27a2266-4ade-41da-82ca-580ead33a547 has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:39:57.660542 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f1531550-a901-4dca-8110-2d105e817599 admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:39:57.665334 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-f1531550-a901-4dca-8110-2d105e817599 admin admin] 10.222.0.11 "PUT /v2.0/routers/c27a2266-4ade-41da-82ca-580ead33a547/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6395772
Jun 03 08:39:57.668013 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56422) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:57.668947 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39998cf5-6ecd-4b84-9fd5-da25ac9cdb83 None None] Sync routers for ids ['c27a2266-4ade-41da-82ca-580ead33a547'] in dv-cinder-787262-5-iscsi {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:39:57.678694 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39998cf5-6ecd-4b84-9fd5-da25ac9cdb83 None None] Routers {'c27a2266-4ade-41da-82ca-580ead33a547'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:39:57.679554 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-39998cf5-6ecd-4b84-9fd5-da25ac9cdb83 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86d22dc0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:39:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['c27a2266-4ade-41da-82ca-580ead33a547'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:57.853017 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-aff23901-b0d9-433e-98b1-726c59293651 admin admin] Notify callbacks [] for router, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:57.857464 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-39998cf5-6ecd-4b84-9fd5-da25ac9cdb83 None None] Set router c27a2266-4ade-41da-82ca-580ead33a547 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:39:58.033497 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-aff23901-b0d9-433e-98b1-726c59293651 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:58.173285 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-39998cf5-6ecd-4b84-9fd5-da25ac9cdb83 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86d22dc0>, [{'id': 'c27a2266-4ade-41da-82ca-580ead33a547', 'name': 'tempest-TestShelveInstance-1063943176-router', 'tenant_id': '66cedbb00e294ca49bf37a7789202b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.10'}], 'enable_snat': True}, 'gw_port_id': '095583d3-03e5-4580-b9d0-ed2b9e85e4a7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:34Z', 'updated_at': '2021-06-03T08:39:56Z', 'revision_number': 5, 'project_id': '66cedbb00e294ca49bf37a7789202b7f', 'gw_port': {'id': '095583d3-03e5-4580-b9d0-ed2b9e85e4a7', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:13:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c27a2266-4ade-41da-82ca-580ead33a547', 'device_owner': 'network:router_gateway', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.10', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:33:37Z', 'updated_at': '2021-06-03T08:33:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:58.178556 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39998cf5-6ecd-4b84-9fd5-da25ac9cdb83 None None] Checking router: c27a2266-4ade-41da-82ca-580ead33a547 for host: dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:39:58.187427 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39998cf5-6ecd-4b84-9fd5-da25ac9cdb83 None None] Routers {'c27a2266-4ade-41da-82ca-580ead33a547'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:39:58.188048 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-39998cf5-6ecd-4b84-9fd5-da25ac9cdb83 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86d22dc0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:39:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['c27a2266-4ade-41da-82ca-580ead33a547'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:58.218093 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-aff23901-b0d9-433e-98b1-726c59293651 admin admin] Deleting port 095583d3-03e5-4580-b9d0-ed2b9e85e4a7 {{(pid=92324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:39:58.218429 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-aff23901-b0d9-433e-98b1-726c59293651 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:58.347877 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-39998cf5-6ecd-4b84-9fd5-da25ac9cdb83 None None] Set router c27a2266-4ade-41da-82ca-580ead33a547 gateway port host: None {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:39:58.348553 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.db [None req-aff23901-b0d9-433e-98b1-726c59293651 admin admin] For port 095583d3-03e5-4580-b9d0-ed2b9e85e4a7, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=095583d3-03e5-4580-b9d0-ed2b9e85e4a7,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:39:58.348950 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-aff23901-b0d9-433e-98b1-726c59293651 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:58.459035 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-39998cf5-6ecd-4b84-9fd5-da25ac9cdb83 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86d22dc0>, [{'id': 'c27a2266-4ade-41da-82ca-580ead33a547', 'name': 'tempest-TestShelveInstance-1063943176-router', 'tenant_id': '66cedbb00e294ca49bf37a7789202b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:34Z', 'updated_at': '2021-06-03T08:39:58Z', 'revision_number': 6, 'project_id': '66cedbb00e294ca49bf37a7789202b7f', 'gw_port_host': None}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:39:58.463408 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39998cf5-6ecd-4b84-9fd5-da25ac9cdb83 None None] The sync data for ids ['c27a2266-4ade-41da-82ca-580ead33a547'] in dv-cinder-787262-5-iscsi is: [{'id': 'c27a2266-4ade-41da-82ca-580ead33a547', 'name': 'tempest-TestShelveInstance-1063943176-router', 'tenant_id': '66cedbb00e294ca49bf37a7789202b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:33:34Z', 'updated_at': '2021-06-03T08:39:58Z', 'revision_number': 6, 'project_id': '66cedbb00e294ca49bf37a7789202b7f', 'gw_port_host': None}] {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:39:58.483465 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-aff23901-b0d9-433e-98b1-726c59293651 admin admin] Calling delete_port for 095583d3-03e5-4580-b9d0-ed2b9e85e4a7 owned by network:router_gateway {{(pid=92324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:39:58.722578 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-aff23901-b0d9-433e-98b1-726c59293651 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:58.727309 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-8189ee57-deb0-49eb-b179-2c0f903f7c88 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:58.802457 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aff23901-b0d9-433e-98b1-726c59293651 admin admin] Pushing event deleted for resources: {'Port': ['ID=095583d3-03e5-4580-b9d0-ed2b9e85e4a7,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:58.805229 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-aff23901-b0d9-433e-98b1-726c59293651 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:58.881445 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-aff23901-b0d9-433e-98b1-726c59293651 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-16327738'] for router_gateway, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:59.173511 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-aff23901-b0d9-433e-98b1-726c59293651 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-16388336', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2351'] for router, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:59.176775 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-aff23901-b0d9-433e-98b1-726c59293651 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:59.272004 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-aff23901-b0d9-433e-98b1-726c59293651 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-16388448'] for router, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:59.272526 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aff23901-b0d9-433e-98b1-726c59293651 admin admin] Fanout notify agent at l3_agent the message router_deleted on router c27a2266-4ade-41da-82ca-580ead33a547 {{(pid=92324) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 03 08:39:59.294166 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-aff23901-b0d9-433e-98b1-726c59293651 admin admin] Notify callbacks [] for router, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:59.295320 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-aff23901-b0d9-433e-98b1-726c59293651 admin admin] 10.222.0.11 "DELETE /v2.0/routers/c27a2266-4ade-41da-82ca-580ead33a547 HTTP/1.1" status: 204  len: 168 time: 1.6263356
Jun 03 08:39:59.297786 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56460) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:39:59.359608 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.db_base_plugin_v2 [None req-ab3d6f03-c986-4d03-b491-0f8e0c8651c9 admin admin] Deleting subnet 03214dfb-e3b6-4e72-b0b6-6d9e375b3f62 {{(pid=92324) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 03 08:39:59.363046 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ab3d6f03-c986-4d03-b491-0f8e0c8651c9 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:59.413078 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ab3d6f03-c986-4d03-b491-0f8e0c8651c9 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-15250429'] for subnet, precommit_delete_associations {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:59.504639 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ab3d6f03-c986-4d03-b491-0f8e0c8651c9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-862421'] for subnet, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:59.884020 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ab3d6f03-c986-4d03-b491-0f8e0c8651c9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-862434', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15641431', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14870376'] for subnet, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:59.888166 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:39:59.923790 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab3d6f03-c986-4d03-b491-0f8e0c8651c9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=03214dfb-e3b6-4e72-b0b6-6d9e375b3f62,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:39:59.926317 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-ab3d6f03-c986-4d03-b491-0f8e0c8651c9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:39:59.929217 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-ab3d6f03-c986-4d03-b491-0f8e0c8651c9 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:39:59.934250 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c05991f6-55e7-4ef9-aac7-243278d1be27 None None] Network 05b59006-52ce-4932-9534-4293d40c8ece requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:39:59.937919 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-ab3d6f03-c986-4d03-b491-0f8e0c8651c9 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/03214dfb-e3b6-4e72-b0b6-6d9e375b3f62 HTTP/1.1" status: 204  len: 168 time: 0.6391773
Jun 03 08:39:59.940978 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56472) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:00.052440 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-529010'] for network, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:00.133702 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] Deleting port e43bae4c-7900-439e-b7f0-47c23744c6f6 {{(pid=92324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:40:00.134068 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:00.195055 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0cc7f837-a6dd-4f7c-ba5a-04122b083663 None None] DHCP port deletion for 05b59006-52ce-4932-9534-4293d40c8ece request from dv-cinder-787262-5-iscsi {{(pid=92325) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 03 08:40:00.247512 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.db [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] For port e43bae4c-7900-439e-b7f0-47c23744c6f6, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=e43bae4c-7900-439e-b7f0-47c23744c6f6,segment=NetworkSegment(eb60ee44-2fee-4938-bb69-42ff628ee059),segment_id=eb60ee44-2fee-4938-bb69-42ff628ee059)] {{(pid=92324) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:40:00.247898 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:00.263099 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0cc7f837-a6dd-4f7c-ba5a-04122b083663 None None] Deleting port e43bae4c-7900-439e-b7f0-47c23744c6f6 {{(pid=92325) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:40:00.263479 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0cc7f837-a6dd-4f7c-ba5a-04122b083663 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:00.385034 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] Calling delete_port for e43bae4c-7900-439e-b7f0-47c23744c6f6 owned by network:dhcp {{(pid=92324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:40:00.386567 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0cc7f837-a6dd-4f7c-ba5a-04122b083663 None None] For port e43bae4c-7900-439e-b7f0-47c23744c6f6, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=e43bae4c-7900-439e-b7f0-47c23744c6f6,segment=NetworkSegment(eb60ee44-2fee-4938-bb69-42ff628ee059),segment_id=eb60ee44-2fee-4938-bb69-42ff628ee059)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:40:00.386968 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0cc7f837-a6dd-4f7c-ba5a-04122b083663 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:00.485535 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 11f176f0-69e3-4e65-9c89-e099ea83fe6a no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:40:00.529244 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:00.534126 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:00.572819 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0cc7f837-a6dd-4f7c-ba5a-04122b083663 None None] Calling delete_port for e43bae4c-7900-439e-b7f0-47c23744c6f6 owned by network:dhcp {{(pid=92325) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:40:00.589528 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: 11f176f0-69e3-4e65-9c89-e099ea83fe6a {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:40:00.589892 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 11f176f0-69e3-4e65-9c89-e099ea83fe6a not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:40:00.590320 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 095583d3-03e5-4580-b9d0-ed2b9e85e4a7 no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:40:00.603227 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] No DVR routers for this DVR port e43bae4c-7900-439e-b7f0-47c23744c6f6 on host dv-cinder-787262-5-iscsi {{(pid=92324) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:40:00.627014 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: 095583d3-03e5-4580-b9d0-ed2b9e85e4a7 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:40:00.627846 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 095583d3-03e5-4580-b9d0-ed2b9e85e4a7 not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:40:00.628278 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device e43bae4c-7900-439e-b7f0-47c23744c6f6 no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:40:00.669016 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] Pushing event deleted for resources: {'Port': ['ID=e43bae4c-7900-439e-b7f0-47c23744c6f6,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:00.671748 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:00.706092 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: e43bae4c-7900-439e-b7f0-47c23744c6f6 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:40:00.706446 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device e43bae4c-7900-439e-b7f0-47c23744c6f6 not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:40:00.734101 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0cc7f837-a6dd-4f7c-ba5a-04122b083663 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151'] for port, after_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:00.738398 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:00.758838 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-862046', 'neutron.services.segments.db._delete_segments_for_network-8774224358894'] for network, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:00.777655 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fae85e1bbe0>,) {'filters': {'network_id': ['05b59006-52ce-4932-9534-4293d40c8ece']}} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:40:00.781766 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cc7f837-a6dd-4f7c-ba5a-04122b083663 None None] Pushing event deleted for resources: {'Port': ['ID=e43bae4c-7900-439e-b7f0-47c23744c6f6,revision_number=None']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:00.785738 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0cc7f837-a6dd-4f7c-ba5a-04122b083663 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:00.786757 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0cc7f837-a6dd-4f7c-ba5a-04122b083663 None None] No DVR routers for this DVR port e43bae4c-7900-439e-b7f0-47c23744c6f6 on host dv-cinder-787262-5-iscsi {{(pid=92325) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:40:00.808122 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fae85e1bbe0>, 'eb60ee44-2fee-4938-bb69-42ff628ee059') {'for_net_delete': True} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:40:00.808122 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.services.segments.db [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fae85e1bbe0>, 'eb60ee44-2fee-4938-bb69-42ff628ee059') {} {{(pid=92324) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:40:00.808960 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8774224362253', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-15250406'] for segment, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:00.825243 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:00.832335 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] Releasing vlan 524 on physical network physnet1 to pool {{(pid=92324) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 03 08:40:00.832737 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15641405'] for segment, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]: Traceback (most recent call last):
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:     timer()
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:     cb(*args, **kw)
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:     return func(*args, **kwargs)
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:     self._notify()
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:     self.callback(batched_events)
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:     event.method(event)
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:     return f(self, *a, **k)
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self._get(url).json()
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:     return self.request(url, 'GET', **kwargs)
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 03 08:40:00.847143 dv-cinder-787262-5-iscsi neutron-server[92324]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 03 08:40:01.037889 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-862039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16327709'] for network, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:01.055349 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-eecbbde9-d422-4de9-9c8d-6b40ab72d848 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:01.060241 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:01.068663 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] Pushing event deleted for resources: {'Network': ['ID=05b59006-52ce-4932-9534-4293d40c8ece,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:01.072777 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:01.076330 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-1afe0ee7-1eea-465b-b609-607158aa03d4 admin admin] 10.222.0.11 "DELETE /v2.0/networks/05b59006-52ce-4932-9534-4293d40c8ece HTTP/1.1" status: 204  len: 168 time: 1.1342494
Jun 03 08:40:01.584306 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56548) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:01.638639 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-4ca435e3-213b-4db9-a1fc-83180594381c admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=0e5e096a327f421e9b0a02235740cc36&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0525448
Jun 03 08:40:01.643444 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 56552) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:01.714878 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1d0f885b-4487-47be-9708-abbc567e132f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:01.743071 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1d0f885b-4487-47be-9708-abbc567e132f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:01.946617 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1d0f885b-4487-47be-9708-abbc567e132f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:01.952126 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-34503ebd-428b-4a9f-b0d2-64bb50685072 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:01.966621 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d0f885b-4487-47be-9708-abbc567e132f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ca2183e8-72e0-4b3e-84c5-b603aad91a90,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:01.969147 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-1d0f885b-4487-47be-9708-abbc567e132f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:01.975421 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1d0f885b-4487-47be-9708-abbc567e132f admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:01.976562 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-1d0f885b-4487-47be-9708-abbc567e132f admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/ca2183e8-72e0-4b3e-84c5-b603aad91a90 HTTP/1.1" status: 204  len: 168 time: 0.3324945
Jun 03 08:40:02.264515 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-03b1d596-1bb2-43a5-9b23-bafde5a28ac4 req-857a2563-75f8-4797-9034-8bc7e548ab6b service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0835783
Jun 03 08:40:02.427108 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03b1d596-1bb2-43a5-9b23-bafde5a28ac4 req-2ffa9304-a923-480b-8f26-c91e8ae10a52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:40:02.428666 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-03b1d596-1bb2-43a5-9b23-bafde5a28ac4 req-2ffa9304-a923-480b-8f26-c91e8ae10a52 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=db653c0bf0ab42639863b4ea2268a265&device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 1099 time: 0.0848093
Jun 03 08:40:02.546144 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-959d37da-e499-44cc-8337-6d4fad4c5913 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:02.583811 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03b1d596-1bb2-43a5-9b23-bafde5a28ac4 req-956ac46e-d7b1-4f4d-b0c2-92ad4f2626df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:40:02.585311 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-03b1d596-1bb2-43a5-9b23-bafde5a28ac4 req-956ac46e-d7b1-4f4d-b0c2-92ad4f2626df service neutron] 10.222.0.55 "GET /v2.0/networks?id=7722e8fc-e6a8-422f-8456-a3c594da293a HTTP/1.1" status: 200  len: 913 time: 0.1376760
Jun 03 08:40:02.700853 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-03b1d596-1bb2-43a5-9b23-bafde5a28ac4 req-19f9ff98-994f-4911-8e95-afd62e5c4665 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=254571a2-c7f3-4505-bb99-ea3fbf4f484b HTTP/1.1" status: 200  len: 1002 time: 0.1074092
Jun 03 08:40:02.769609 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03b1d596-1bb2-43a5-9b23-bafde5a28ac4 req-5332daec-985b-4425-b862-65024e43c3d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:40:02.771208 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-03b1d596-1bb2-43a5-9b23-bafde5a28ac4 req-5332daec-985b-4425-b862-65024e43c3d0 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=3eb5b6e1-724c-48ab-a49b-2b1fa5adb401 HTTP/1.1" status: 200  len: 851 time: 0.0641048
Jun 03 08:40:02.848234 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03b1d596-1bb2-43a5-9b23-bafde5a28ac4 req-24470ef3-d946-4c38-8907-80e974c9d9a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:40:02.849701 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-03b1d596-1bb2-43a5-9b23-bafde5a28ac4 req-24470ef3-d946-4c38-8907-80e974c9d9a6 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=7722e8fc-e6a8-422f-8456-a3c594da293a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0715535
Jun 03 08:40:02.993171 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56618) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:02.999175 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-03b1d596-1bb2-43a5-9b23-bafde5a28ac4 req-c02c492a-493e-4a6f-9222-4a066a0718fc service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1423340
Jun 03 08:40:03.043332 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-6da0da4b-a3bf-475f-8404-429d95ebf0a6 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=66cedbb00e294ca49bf37a7789202b7f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0489163
Jun 03 08:40:03.045740 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56620) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:03.124615 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-347c91d6-8601-4538-b0f9-2e66c612db50 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:03.136179 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-03b1d596-1bb2-43a5-9b23-bafde5a28ac4 req-3797d42e-e801-4789-9457-efd12194d129 service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1292095
Jun 03 08:40:03.254853 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-347c91d6-8601-4538-b0f9-2e66c612db50 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:03.329165 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:40:03.529202 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-347c91d6-8601-4538-b0f9-2e66c612db50 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:03.533095 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-61ad7100-a988-4341-ae23-2065d835f472 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:03.548091 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-347c91d6-8601-4538-b0f9-2e66c612db50 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=603bdbfc-de30-4376-8820-20a98f093de4,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:03.552634 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-347c91d6-8601-4538-b0f9-2e66c612db50 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:03.555024 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-347c91d6-8601-4538-b0f9-2e66c612db50 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:03.556605 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-347c91d6-8601-4538-b0f9-2e66c612db50 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/603bdbfc-de30-4376-8820-20a98f093de4 HTTP/1.1" status: 204  len: 168 time: 0.5098007
Jun 03 08:40:03.921897 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56632) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:04.072165 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a1fba12a-f5a3-4322-bff9-bd54282a495c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:04.090916 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-a1fba12a-f5a3-4322-bff9-bd54282a495c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:40:04.096263 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-a1fba12a-f5a3-4322-bff9-bd54282a495c admin admin] Usage tracker for resource:security_group_rule and tenant:95000821047049e8b6fe57bafca3a825 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:40:04.100006 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-a1fba12a-f5a3-4322-bff9-bd54282a495c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:40:04.106610 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-a1fba12a-f5a3-4322-bff9-bd54282a495c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:40:04.205717 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a1fba12a-f5a3-4322-bff9-bd54282a495c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:04.283732 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-a1fba12a-f5a3-4322-bff9-bd54282a495c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:04.294835 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-57888798-b56e-4df2-9c68-15d441093b95 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:04.338585 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-a1fba12a-f5a3-4322-bff9-bd54282a495c admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=95000821047049e8b6fe57bafca3a825&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4154346
Jun 03 08:40:04.340359 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1fba12a-f5a3-4322-bff9-bd54282a495c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e216bcdf-d5ef-41d1-a4a6-31484b0fdc23,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:04.341530 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 56636) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:04.343530 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-a1fba12a-f5a3-4322-bff9-bd54282a495c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:04.405726 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-287644ac-1e02-40da-980d-35d2488ad64f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:04.432047 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-287644ac-1e02-40da-980d-35d2488ad64f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:04.649125 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-287644ac-1e02-40da-980d-35d2488ad64f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:04.652810 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c41d84ba-99d5-4183-bf74-fed25113e1c4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:04.663777 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-287644ac-1e02-40da-980d-35d2488ad64f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e216bcdf-d5ef-41d1-a4a6-31484b0fdc23,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:04.667729 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-287644ac-1e02-40da-980d-35d2488ad64f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:04.670990 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-287644ac-1e02-40da-980d-35d2488ad64f admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:04.672095 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-287644ac-1e02-40da-980d-35d2488ad64f admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/e216bcdf-d5ef-41d1-a4a6-31484b0fdc23 HTTP/1.1" status: 204  len: 168 time: 0.3291225
Jun 03 08:40:04.843405 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:05.344895 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-103c2e32-7f4f-42a4-b6c6-1cee0170fb38 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:05.674250 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56644) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:05.692604 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d9be4e35-96e3-43eb-b58f-0db042c40db3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:05.711304 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-d9be4e35-96e3-43eb-b58f-0db042c40db3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:40:05.715062 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-d9be4e35-96e3-43eb-b58f-0db042c40db3 admin admin] Usage tracker for resource:security_group_rule and tenant:bebb9d190ca4427aa2dd413e42c7569f is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:40:05.717834 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-d9be4e35-96e3-43eb-b58f-0db042c40db3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:40:05.724042 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-d9be4e35-96e3-43eb-b58f-0db042c40db3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:40:05.809908 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d9be4e35-96e3-43eb-b58f-0db042c40db3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:05.889276 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-d9be4e35-96e3-43eb-b58f-0db042c40db3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:05.897462 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e95138b5-d093-40e5-b85c-1a65266614fe admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:05.936744 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9be4e35-96e3-43eb-b58f-0db042c40db3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7fc8b15f-d4a0-40e0-90fd-04a032dd6dea,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:05.941903 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-d9be4e35-96e3-43eb-b58f-0db042c40db3 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=bebb9d190ca4427aa2dd413e42c7569f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2664282
Jun 03 08:40:05.942822 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-d9be4e35-96e3-43eb-b58f-0db042c40db3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:05.946327 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56646) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:06.005624 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-292a2d1f-5e26-4975-b597-854789c78bc3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:06.031149 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-292a2d1f-5e26-4975-b597-854789c78bc3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:06.191972 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-292a2d1f-5e26-4975-b597-854789c78bc3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:06.195874 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9c7d953c-4162-4dc8-8301-7787dbc3a05b tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:06.211928 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-292a2d1f-5e26-4975-b597-854789c78bc3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7fc8b15f-d4a0-40e0-90fd-04a032dd6dea,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:06.214186 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-292a2d1f-5e26-4975-b597-854789c78bc3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:06.222650 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-292a2d1f-5e26-4975-b597-854789c78bc3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:06.223907 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-292a2d1f-5e26-4975-b597-854789c78bc3 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/7fc8b15f-d4a0-40e0-90fd-04a032dd6dea HTTP/1.1" status: 204  len: 168 time: 0.2760367
Jun 03 08:40:06.266163 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:08.093509 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:15.018166 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56750) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:15.135520 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-513036e9-7eee-492e-8e4a-a6b44dcbae13 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:15.151553 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-513036e9-7eee-492e-8e4a-a6b44dcbae13 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:40:15.155364 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-513036e9-7eee-492e-8e4a-a6b44dcbae13 admin admin] Usage tracker for resource:security_group_rule and tenant:30fa248fff5f441a87e9bf6ac56f2550 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:40:15.158118 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-513036e9-7eee-492e-8e4a-a6b44dcbae13 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:40:15.164315 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-513036e9-7eee-492e-8e4a-a6b44dcbae13 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:40:15.244888 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-513036e9-7eee-492e-8e4a-a6b44dcbae13 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:15.334675 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-513036e9-7eee-492e-8e4a-a6b44dcbae13 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:15.345158 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-fc7c45ea-e2ba-4adb-a6f5-add0b82f2f4e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:15.382367 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-513036e9-7eee-492e-8e4a-a6b44dcbae13 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5a7f14e6-eb36-416a-b84e-abe9a4cb22c9,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:15.385617 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-513036e9-7eee-492e-8e4a-a6b44dcbae13 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:15.388236 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-513036e9-7eee-492e-8e4a-a6b44dcbae13 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=30fa248fff5f441a87e9bf6ac56f2550&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3690631
Jun 03 08:40:15.390864 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56754) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:15.447156 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-fe56aa36-9c82-4aec-a584-6f7da2c7c622 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:15.472381 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-fe56aa36-9c82-4aec-a584-6f7da2c7c622 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:15.597591 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-fe56aa36-9c82-4aec-a584-6f7da2c7c622 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:15.601951 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-a1fba12a-f5a3-4322-bff9-bd54282a495c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:15.613053 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe56aa36-9c82-4aec-a584-6f7da2c7c622 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5a7f14e6-eb36-416a-b84e-abe9a4cb22c9,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:15.617564 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-fe56aa36-9c82-4aec-a584-6f7da2c7c622 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:15.620997 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-fe56aa36-9c82-4aec-a584-6f7da2c7c622 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:15.622107 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-fe56aa36-9c82-4aec-a584-6f7da2c7c622 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/5a7f14e6-eb36-416a-b84e-abe9a4cb22c9 HTTP/1.1" status: 204  len: 168 time: 0.2303591
Jun 03 08:40:16.400737 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56762) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:16.428002 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e88a576b-8adc-4ed8-a14b-23bdb38cf825 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:16.442302 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-e88a576b-8adc-4ed8-a14b-23bdb38cf825 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:40:16.447228 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-e88a576b-8adc-4ed8-a14b-23bdb38cf825 admin admin] Usage tracker for resource:security_group_rule and tenant:0183dfb2a56c4092aca1f667749d0d44 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:40:16.449947 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-e88a576b-8adc-4ed8-a14b-23bdb38cf825 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:40:16.455541 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-e88a576b-8adc-4ed8-a14b-23bdb38cf825 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:40:16.535252 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e88a576b-8adc-4ed8-a14b-23bdb38cf825 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:16.603108 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-e88a576b-8adc-4ed8-a14b-23bdb38cf825 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:16.610124 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-4bb7432b-9634-4ac3-b1da-92702a74b887 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:16.649105 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e88a576b-8adc-4ed8-a14b-23bdb38cf825 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f5acfd56-1a58-440b-8663-dd4d624fd0a4,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:16.652111 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e88a576b-8adc-4ed8-a14b-23bdb38cf825 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:16.654716 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-e88a576b-8adc-4ed8-a14b-23bdb38cf825 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=0183dfb2a56c4092aca1f667749d0d44&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2529664
Jun 03 08:40:16.657326 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56764) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:16.719180 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-84c69239-ebb7-4cd5-bea4-1365cb5175bc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:16.746205 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-84c69239-ebb7-4cd5-bea4-1365cb5175bc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:16.883180 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-84c69239-ebb7-4cd5-bea4-1365cb5175bc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:16.886844 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-e227cbdc-fc74-4b6d-90bb-f8477bc51ee2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:16.897847 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84c69239-ebb7-4cd5-bea4-1365cb5175bc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f5acfd56-1a58-440b-8663-dd4d624fd0a4,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:16.900054 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-84c69239-ebb7-4cd5-bea4-1365cb5175bc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:16.906780 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-84c69239-ebb7-4cd5-bea4-1365cb5175bc admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:16.906780 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-84c69239-ebb7-4cd5-bea4-1365cb5175bc admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/f5acfd56-1a58-440b-8663-dd4d624fd0a4 HTTP/1.1" status: 204  len: 168 time: 0.2478304
Jun 03 08:40:20.336719 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56854) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:20.453325 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-41493486-c15f-4bac-9193-1f81c8364487 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:20.468456 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-41493486-c15f-4bac-9193-1f81c8364487 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:40:20.472305 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-41493486-c15f-4bac-9193-1f81c8364487 admin admin] Usage tracker for resource:security_group_rule and tenant:28b5ace835d94580a626f6e05faa18fa is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:40:20.475752 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-41493486-c15f-4bac-9193-1f81c8364487 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:40:20.481662 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-41493486-c15f-4bac-9193-1f81c8364487 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:40:20.564733 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-41493486-c15f-4bac-9193-1f81c8364487 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:20.637740 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-41493486-c15f-4bac-9193-1f81c8364487 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:20.645143 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-f9305e00-0956-4615-9575-aab3af256ec3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:20.687696 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-41493486-c15f-4bac-9193-1f81c8364487 admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=28b5ace835d94580a626f6e05faa18fa&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3498597
Jun 03 08:40:20.688711 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41493486-c15f-4bac-9193-1f81c8364487 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7e0cc3d0-f9e9-45e0-8e15-d8c89b96b728,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:20.690431 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 56862) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:20.692205 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-41493486-c15f-4bac-9193-1f81c8364487 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:20.750853 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-870ca0e8-3ce3-473f-9470-44f9e23a8e9c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:20.776871 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-870ca0e8-3ce3-473f-9470-44f9e23a8e9c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:20.940349 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-870ca0e8-3ce3-473f-9470-44f9e23a8e9c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:20.944115 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-52ac08ad-6e58-4655-84cf-ec6c87196fa4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:20.955007 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-870ca0e8-3ce3-473f-9470-44f9e23a8e9c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e0cc3d0-f9e9-45e0-8e15-d8c89b96b728,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:20.965316 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-870ca0e8-3ce3-473f-9470-44f9e23a8e9c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:20.965684 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-870ca0e8-3ce3-473f-9470-44f9e23a8e9c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:20.966042 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-870ca0e8-3ce3-473f-9470-44f9e23a8e9c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:20.966395 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-870ca0e8-3ce3-473f-9470-44f9e23a8e9c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:20.966770 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-870ca0e8-3ce3-473f-9470-44f9e23a8e9c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:20.967118 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-870ca0e8-3ce3-473f-9470-44f9e23a8e9c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:20.967462 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-870ca0e8-3ce3-473f-9470-44f9e23a8e9c admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:20.967803 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-870ca0e8-3ce3-473f-9470-44f9e23a8e9c admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:20.968172 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-870ca0e8-3ce3-473f-9470-44f9e23a8e9c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:20.968532 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-870ca0e8-3ce3-473f-9470-44f9e23a8e9c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:20.968855 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-870ca0e8-3ce3-473f-9470-44f9e23a8e9c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:20.969191 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-870ca0e8-3ce3-473f-9470-44f9e23a8e9c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:20.972096 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-870ca0e8-3ce3-473f-9470-44f9e23a8e9c admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:20.975393 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-870ca0e8-3ce3-473f-9470-44f9e23a8e9c admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/7e0cc3d0-f9e9-45e0-8e15-d8c89b96b728 HTTP/1.1" status: 204  len: 168 time: 0.2816393
Jun 03 08:40:20.975393 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-870ca0e8-3ce3-473f-9470-44f9e23a8e9c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:21.657944 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56872) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:21.680285 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2cade4dc-8e8c-45b4-a860-c362cbab147c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:21.694740 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-2cade4dc-8e8c-45b4-a860-c362cbab147c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:40:21.698430 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-2cade4dc-8e8c-45b4-a860-c362cbab147c admin admin] Usage tracker for resource:security_group_rule and tenant:abb963a309d842b68f6a28a185cdd05b is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:40:21.701153 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-2cade4dc-8e8c-45b4-a860-c362cbab147c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:40:21.706759 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-2cade4dc-8e8c-45b4-a860-c362cbab147c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:40:21.785862 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2cade4dc-8e8c-45b4-a860-c362cbab147c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:21.847366 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2cade4dc-8e8c-45b4-a860-c362cbab147c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:21.855130 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-347c91d6-8601-4538-b0f9-2e66c612db50 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:21.894118 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cade4dc-8e8c-45b4-a860-c362cbab147c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4d5dd096-40a1-4114-8e51-cb15195c80a4,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:21.897792 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-2cade4dc-8e8c-45b4-a860-c362cbab147c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:21.900479 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-2cade4dc-8e8c-45b4-a860-c362cbab147c admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=abb963a309d842b68f6a28a185cdd05b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2414589
Jun 03 08:40:21.903123 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56874) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:21.963189 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-acf5e8a9-b790-4832-8f49-1b6a63c6b625 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:21.988815 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-acf5e8a9-b790-4832-8f49-1b6a63c6b625 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:22.140734 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-acf5e8a9-b790-4832-8f49-1b6a63c6b625 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:22.144608 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-80ab399a-c71c-4238-8324-8774c963dc12 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:22.159325 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acf5e8a9-b790-4832-8f49-1b6a63c6b625 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4d5dd096-40a1-4114-8e51-cb15195c80a4,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:22.162256 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-acf5e8a9-b790-4832-8f49-1b6a63c6b625 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:22.169902 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-acf5e8a9-b790-4832-8f49-1b6a63c6b625 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:22.173492 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-acf5e8a9-b790-4832-8f49-1b6a63c6b625 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/4d5dd096-40a1-4114-8e51-cb15195c80a4 HTTP/1.1" status: 204  len: 168 time: 0.2672200
Jun 03 08:40:25.753637 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56926) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:25.872912 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-235cc718-5027-4aba-b2f8-f75bc063b80a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:25.887058 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-235cc718-5027-4aba-b2f8-f75bc063b80a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:40:25.890787 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-235cc718-5027-4aba-b2f8-f75bc063b80a admin admin] Usage tracker for resource:security_group_rule and tenant:28eb43ab79544c97b1cb07496537a158 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:40:25.893469 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-235cc718-5027-4aba-b2f8-f75bc063b80a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:40:25.899231 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-235cc718-5027-4aba-b2f8-f75bc063b80a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:40:25.978652 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-235cc718-5027-4aba-b2f8-f75bc063b80a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:26.065964 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-235cc718-5027-4aba-b2f8-f75bc063b80a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:26.076086 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-393b76a0-c15f-47c5-a84f-abfeae929b1c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:26.117274 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-235cc718-5027-4aba-b2f8-f75bc063b80a admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=28eb43ab79544c97b1cb07496537a158&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3625615
Jun 03 08:40:26.118930 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-235cc718-5027-4aba-b2f8-f75bc063b80a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2c7829fa-6f9d-46ee-b7de-22d5f85df18a,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:26.119928 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 56930) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:26.123940 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-235cc718-5027-4aba-b2f8-f75bc063b80a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:26.177342 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d08e1fda-06f3-4480-a1a4-aa426bb4bb77 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:26.180363 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:26.202357 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d08e1fda-06f3-4480-a1a4-aa426bb4bb77 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:26.408775 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d08e1fda-06f3-4480-a1a4-aa426bb4bb77 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:26.414571 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-e0098bed-3cc8-4367-a914-884d3f540cfc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:26.424476 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d08e1fda-06f3-4480-a1a4-aa426bb4bb77 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2c7829fa-6f9d-46ee-b7de-22d5f85df18a,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:26.428059 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-d08e1fda-06f3-4480-a1a4-aa426bb4bb77 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:26.431532 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d08e1fda-06f3-4480-a1a4-aa426bb4bb77 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:26.432649 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-d08e1fda-06f3-4480-a1a4-aa426bb4bb77 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/2c7829fa-6f9d-46ee-b7de-22d5f85df18a HTTP/1.1" status: 204  len: 168 time: 0.3117416
Jun 03 08:40:28.169672 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 56964) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:28.296076 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-eacbfb26-5341-4173-bf2d-9c3b84ba0e7b admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:28.310251 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-eacbfb26-5341-4173-bf2d-9c3b84ba0e7b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:40:28.314449 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-eacbfb26-5341-4173-bf2d-9c3b84ba0e7b admin admin] Usage tracker for resource:security_group_rule and tenant:57dc237c5c2f40b88077258f2d96adcd is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:40:28.317831 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-eacbfb26-5341-4173-bf2d-9c3b84ba0e7b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:40:28.323488 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-eacbfb26-5341-4173-bf2d-9c3b84ba0e7b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:40:28.408065 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-eacbfb26-5341-4173-bf2d-9c3b84ba0e7b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:28.510262 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-eacbfb26-5341-4173-bf2d-9c3b84ba0e7b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:28.516948 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-3b5c5377-c3ce-49d1-907b-67d7a4632e0b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:28.560031 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-eacbfb26-5341-4173-bf2d-9c3b84ba0e7b admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=57dc237c5c2f40b88077258f2d96adcd&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3892810
Jun 03 08:40:28.560957 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eacbfb26-5341-4173-bf2d-9c3b84ba0e7b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=31061f01-67c6-45fe-9241-659e21b676bd,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:28.562837 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 56970) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:28.568653 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eacbfb26-5341-4173-bf2d-9c3b84ba0e7b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:28.569037 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eacbfb26-5341-4173-bf2d-9c3b84ba0e7b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:28.569413 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eacbfb26-5341-4173-bf2d-9c3b84ba0e7b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:28.569784 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eacbfb26-5341-4173-bf2d-9c3b84ba0e7b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:28.570152 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eacbfb26-5341-4173-bf2d-9c3b84ba0e7b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:28.570534 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eacbfb26-5341-4173-bf2d-9c3b84ba0e7b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:28.570922 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eacbfb26-5341-4173-bf2d-9c3b84ba0e7b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:28.571295 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eacbfb26-5341-4173-bf2d-9c3b84ba0e7b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:28.571643 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eacbfb26-5341-4173-bf2d-9c3b84ba0e7b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:28.571994 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eacbfb26-5341-4173-bf2d-9c3b84ba0e7b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:28.572351 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eacbfb26-5341-4173-bf2d-9c3b84ba0e7b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:28.572725 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eacbfb26-5341-4173-bf2d-9c3b84ba0e7b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:40:28.576359 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-eacbfb26-5341-4173-bf2d-9c3b84ba0e7b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:28.621244 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-05b2c55d-32e2-4f8d-8ab6-fb41c9b1071d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:28.649448 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-05b2c55d-32e2-4f8d-8ab6-fb41c9b1071d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:28.904585 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-05b2c55d-32e2-4f8d-8ab6-fb41c9b1071d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:28.908322 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-09bcb55c-8ebf-470f-ad24-d9eea1c7a947 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:28.919201 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05b2c55d-32e2-4f8d-8ab6-fb41c9b1071d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=31061f01-67c6-45fe-9241-659e21b676bd,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:28.921367 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-05b2c55d-32e2-4f8d-8ab6-fb41c9b1071d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:28.929888 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-05b2c55d-32e2-4f8d-8ab6-fb41c9b1071d admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:28.929888 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-05b2c55d-32e2-4f8d-8ab6-fb41c9b1071d admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/31061f01-67c6-45fe-9241-659e21b676bd HTTP/1.1" status: 204  len: 168 time: 0.3638010
Jun 03 08:40:32.534568 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0981c851-e72c-4c3f-ba79-49f3385e4205 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:34.963303 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:35.277638 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-ef28df23-128d-48c2-af42-445559c53770 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:36.311647 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:38.064485 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:40.327306 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:40:46.457857 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 57168) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:46.580365 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-787b4513-1505-46f2-b00c-6a31ec7d38da admin admin] Notify callbacks [] for security_group, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:46.595110 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-787b4513-1505-46f2-b00c-6a31ec7d38da admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:40:46.599017 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-787b4513-1505-46f2-b00c-6a31ec7d38da admin admin] Usage tracker for resource:security_group_rule and tenant:50f83b6c08994a6bada2a71c47fe9673 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:40:46.601815 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-787b4513-1505-46f2-b00c-6a31ec7d38da admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:40:46.607673 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-787b4513-1505-46f2-b00c-6a31ec7d38da admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:40:46.688366 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-787b4513-1505-46f2-b00c-6a31ec7d38da admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:46.831499 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-787b4513-1505-46f2-b00c-6a31ec7d38da admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:46.840491 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f35824d0-db5a-4847-b3eb-a2c077086e0d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:46.882341 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-787b4513-1505-46f2-b00c-6a31ec7d38da admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=50f83b6c08994a6bada2a71c47fe9673&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4233418
Jun 03 08:40:46.883262 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-787b4513-1505-46f2-b00c-6a31ec7d38da admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7b9cd24a-b69f-4b92-979d-62b068ada17a,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:46.885062 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 57176) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:46.886325 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-787b4513-1505-46f2-b00c-6a31ec7d38da admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:46.950361 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-3a72b488-16ba-4886-b676-1c8a02a763ad admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:46.976333 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-3a72b488-16ba-4886-b676-1c8a02a763ad admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:47.083176 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-3a72b488-16ba-4886-b676-1c8a02a763ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:47.087970 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-c80a9f61-84c7-40c9-b52e-6a1a53320352 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:47.102154 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a72b488-16ba-4886-b676-1c8a02a763ad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7b9cd24a-b69f-4b92-979d-62b068ada17a,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:47.108048 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-3a72b488-16ba-4886-b676-1c8a02a763ad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:47.115003 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-3a72b488-16ba-4886-b676-1c8a02a763ad admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:47.116347 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-3a72b488-16ba-4886-b676-1c8a02a763ad admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/7b9cd24a-b69f-4b92-979d-62b068ada17a HTTP/1.1" status: 204  len: 168 time: 0.2300792
Jun 03 08:40:48.615632 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 57188) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:48.733004 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2f685a0a-181e-44f4-9cc7-adc0d33ce61f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:48.751208 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-2f685a0a-181e-44f4-9cc7-adc0d33ce61f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:40:48.754911 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-2f685a0a-181e-44f4-9cc7-adc0d33ce61f admin admin] Usage tracker for resource:security_group_rule and tenant:f1a6c36598e243f486936c14fe254fb4 is out of sync, need to count used quota {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:40:48.757723 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [None req-2f685a0a-181e-44f4-9cc7-adc0d33ce61f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92324) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:40:48.764673 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.db.quota.driver [None req-2f685a0a-181e-44f4-9cc7-adc0d33ce61f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92324) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:40:48.847500 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2f685a0a-181e-44f4-9cc7-adc0d33ce61f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:48.928428 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-2f685a0a-181e-44f4-9cc7-adc0d33ce61f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_create {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:48.935785 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-78f13790-0538-46f3-a50b-c3d2fab10d3e tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:48.977489 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f685a0a-181e-44f4-9cc7-adc0d33ce61f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b6e8d06a-dae5-4fa0-ad56-3728db2a871c,revision_number=1']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:48.981922 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-2f685a0a-181e-44f4-9cc7-adc0d33ce61f admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=f1a6c36598e243f486936c14fe254fb4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3652902
Jun 03 08:40:48.982826 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-2f685a0a-181e-44f4-9cc7-adc0d33ce61f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:48.984630 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 57192) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:40:49.041932 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-058b7e9a-fc35-43f7-8c81-afcc7f392984 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:49.067189 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-058b7e9a-fc35-43f7-8c81-afcc7f392984 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:49.209101 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-058b7e9a-fc35-43f7-8c81-afcc7f392984 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:49.212901 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-fe56aa36-9c82-4aec-a584-6f7da2c7c622 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:40:49.227886 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-058b7e9a-fc35-43f7-8c81-afcc7f392984 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b6e8d06a-dae5-4fa0-ad56-3728db2a871c,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:40:49.230101 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-058b7e9a-fc35-43f7-8c81-afcc7f392984 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:40:49.235817 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-058b7e9a-fc35-43f7-8c81-afcc7f392984 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:49.239033 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-058b7e9a-fc35-43f7-8c81-afcc7f392984 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/b6e8d06a-dae5-4fa0-ad56-3728db2a871c HTTP/1.1" status: 204  len: 168 time: 0.2508993
Jun 03 08:40:56.140188 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:40:59.400296 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37221f75-4bd4-4980-862e-5fe04eaa82cc req-e901062f-1ff7-460e-97fd-b932411d0f65 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:40:59.401759 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-37221f75-4bd4-4980-862e-5fe04eaa82cc req-e901062f-1ff7-460e-97fd-b932411d0f65 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 946 time: 0.2546980
Jun 03 08:40:59.446672 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-37221f75-4bd4-4980-862e-5fe04eaa82cc req-8baf646b-d52c-4aef-b864-f50ab2f43bba tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0391383
Jun 03 08:41:00.765295 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5334af8d-8bc4-4316-b206-730e954b7401 req-d0da621c-bb4f-418a-adec-2734199b8911 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:00.766681 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5334af8d-8bc4-4316-b206-730e954b7401 req-d0da621c-bb4f-418a-adec-2734199b8911 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 946 time: 0.1960139
Jun 03 08:41:00.774464 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-581b7e01-88fb-41cf-a128-c7233b32816b req-688a0065-c31a-4d5a-a0c9-fe6092bf9dc9 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:00.775806 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-581b7e01-88fb-41cf-a128-c7233b32816b req-688a0065-c31a-4d5a-a0c9-fe6092bf9dc9 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.55 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 946 time: 0.1168458
Jun 03 08:41:00.867812 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5334af8d-8bc4-4316-b206-730e954b7401 req-66f6a0ef-166b-4576-a391-b0e63972520f tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0910738
Jun 03 08:41:00.942126 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-581b7e01-88fb-41cf-a128-c7233b32816b req-668ba799-2344-4c55-8196-32a3172a89f6 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Deleting port 254571a2-c7f3-4505-bb99-ea3fbf4f484b {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:41:00.942470 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-581b7e01-88fb-41cf-a128-c7233b32816b req-668ba799-2344-4c55-8196-32a3172a89f6 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:01.074985 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-581b7e01-88fb-41cf-a128-c7233b32816b req-668ba799-2344-4c55-8196-32a3172a89f6 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] For port 254571a2-c7f3-4505-bb99-ea3fbf4f484b, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=254571a2-c7f3-4505-bb99-ea3fbf4f484b,segment=NetworkSegment(fd0545c3-e436-4d2f-9d2d-71983702d34f),segment_id=fd0545c3-e436-4d2f-9d2d-71983702d34f)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:41:01.075344 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-581b7e01-88fb-41cf-a128-c7233b32816b req-668ba799-2344-4c55-8196-32a3172a89f6 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:01.363104 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-581b7e01-88fb-41cf-a128-c7233b32816b req-668ba799-2344-4c55-8196-32a3172a89f6 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:01.363374 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-581b7e01-88fb-41cf-a128-c7233b32816b req-668ba799-2344-4c55-8196-32a3172a89f6 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16327919'] for floatingip, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:01.363700 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.db.l3_db [req-581b7e01-88fb-41cf-a128-c7233b32816b req-668ba799-2344-4c55-8196-32a3172a89f6 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Floating IP 8d72a0ec-fc93-4d28-ab68-b67c6c4fa370 disassociated. External IP: 172.27.0.172, port: 254571a2-c7f3-4505-bb99-ea3fbf4f484b.
Jun 03 08:41:01.364025 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-581b7e01-88fb-41cf-a128-c7233b32816b req-668ba799-2344-4c55-8196-32a3172a89f6 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Calling delete_port for 254571a2-c7f3-4505-bb99-ea3fbf4f484b owned by compute:nova {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:41:01.546112 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-581b7e01-88fb-41cf-a128-c7233b32816b req-668ba799-2344-4c55-8196-32a3172a89f6 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:01.552548 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f1531550-a901-4dca-8110-2d105e817599 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:41:01.600948 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-668ba799-2344-4c55-8196-32a3172a89f6 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event deleted for resources: {'Port': ['ID=254571a2-c7f3-4505-bb99-ea3fbf4f484b,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:41:01.603992 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-668ba799-2344-4c55-8196-32a3172a89f6 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:41:01.797098 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [req-581b7e01-88fb-41cf-a128-c7233b32816b req-668ba799-2344-4c55-8196-32a3172a89f6 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:41:01.990659 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-581b7e01-88fb-41cf-a128-c7233b32816b req-668ba799-2344-4c55-8196-32a3172a89f6 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:41:01.999864 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1be88d8c-a81f-4643-ad3e-406adc89aec0 None None] Sync routers for ids ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:41:02.011517 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1be88d8c-a81f-4643-ad3e-406adc89aec0 None None] Routers {'8d6b2faf-68a8-4edd-91ad-352b92d8cf84'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:41:02.012419 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-1be88d8c-a81f-4643-ad3e-406adc89aec0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86fb0e20>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:40:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:41:02.047854 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-1cfb622b-5d6c-42ce-84ea-9a1cb9b82f50 req-5d76bfd2-112f-4ff9-921c-3b5641baec71 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 210 time: 0.0498054
Jun 03 08:41:02.179136 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-581b7e01-88fb-41cf-a128-c7233b32816b req-668ba799-2344-4c55-8196-32a3172a89f6 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] No DVR routers for this DVR port 254571a2-c7f3-4505-bb99-ea3fbf4f484b on host hv-cinder-78726 {{(pid=92323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:41:02.181621 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-581b7e01-88fb-41cf-a128-c7233b32816b req-668ba799-2344-4c55-8196-32a3172a89f6 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:02.184473 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fb968b3c-aeca-41a4-b10a-1baf38dc4151', 'name': 'network-vif-deleted', 'tag': '254571a2-c7f3-4505-bb99-ea3fbf4f484b'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:41:02.186855 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-511ca4ee-525a-451b-bdcf-48a33660b56f" -d '{"events": [{"server_uuid": "fb968b3c-aeca-41a4-b10a-1baf38dc4151", "name": "network-vif-deleted", "tag": "254571a2-c7f3-4505-bb99-ea3fbf4f484b"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:41:02.219279 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-1be88d8c-a81f-4643-ad3e-406adc89aec0 None None] Set router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:41:02.230086 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:41:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-671c874e-9cba-4ca6-89e9-30f011cc1187 x-openstack-request-id: req-671c874e-9cba-4ca6-89e9-30f011cc1187 {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:41:02.230422 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fb968b3c-aeca-41a4-b10a-1baf38dc4151", "name": "network-vif-deleted", "tag": "254571a2-c7f3-4505-bb99-ea3fbf4f484b", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:41:02.230739 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-671c874e-9cba-4ca6-89e9-30f011cc1187 {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:41:02.231165 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fb968b3c-aeca-41a4-b10a-1baf38dc4151', 'name': 'network-vif-deleted', 'tag': '254571a2-c7f3-4505-bb99-ea3fbf4f484b', 'status': 'completed', 'code': 200}
Jun 03 08:41:02.391422 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-581b7e01-88fb-41cf-a128-c7233b32816b req-668ba799-2344-4c55-8196-32a3172a89f6 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.55 "DELETE /v2.0/ports/254571a2-c7f3-4505-bb99-ea3fbf4f484b HTTP/1.1" status: 204  len: 173 time: 1.5990875
Jun 03 08:41:02.542989 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-1be88d8c-a81f-4643-ad3e-406adc89aec0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86fb0e20>, [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '1b247c7f-4ca7-44d5-97b2-94031de25c6e', 'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'mac_address': 'fa:16:3e:f4:70:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:51Z', 'updated_at': '2021-06-03T08:37:59Z', 'revision_number': 5, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'subnets': [{'id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:41:02.546759 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1be88d8c-a81f-4643-ad3e-406adc89aec0 None None] Checking router: 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:41:02.555347 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1be88d8c-a81f-4643-ad3e-406adc89aec0 None None] Routers {'8d6b2faf-68a8-4edd-91ad-352b92d8cf84'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:41:02.556075 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-1be88d8c-a81f-4643-ad3e-406adc89aec0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86fb0e20>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:40:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:41:02.612062 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-be23fd35-0966-473b-b977-5fb3064eda80 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:02.733787 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-1be88d8c-a81f-4643-ad3e-406adc89aec0 None None] Set router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:41:03.082567 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-1be88d8c-a81f-4643-ad3e-406adc89aec0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86fb0e20>, [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '1b247c7f-4ca7-44d5-97b2-94031de25c6e', 'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'mac_address': 'fa:16:3e:f4:70:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:51Z', 'updated_at': '2021-06-03T08:37:59Z', 'revision_number': 5, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'subnets': [{'id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:41:03.086547 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1be88d8c-a81f-4643-ad3e-406adc89aec0 None None] The sync data for ids ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'] in dv-cinder-787262-5-iscsi is: [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '1b247c7f-4ca7-44d5-97b2-94031de25c6e', 'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'mac_address': 'fa:16:3e:f4:70:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:51Z', 'updated_at': '2021-06-03T08:37:59Z', 'revision_number': 5, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'subnets': [{'id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:41:03.225485 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a0993a48-2b8e-4948-a1a9-9787887b234c req-9cf32f08-b219-4978-94ed-45ef1b1b998e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 210 time: 0.0488503
Jun 03 08:41:03.264638 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1b138db6-ea1b-4375-be80-0343b40a3149 req-01b914f4-2548-45a8-b6f1-444714a1b2ab service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 210 time: 0.0889297
Jun 03 08:41:03.317352 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c99a9fb1-64d4-4b5a-87a2-5e0d95298acf None None] New status for floating IP 8d72a0ec-fc93-4d28-ab68-b67c6c4fa370: DOWN {{(pid=92326) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 03 08:41:03.355505 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 254571a2-c7f3-4505-bb99-ea3fbf4f484b no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:41:03.377090 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1b138db6-ea1b-4375-be80-0343b40a3149 req-9b246ce8-53fb-467b-82d4-85577e010ef3 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=db653c0bf0ab42639863b4ea2268a265&device_id=fb968b3c-aeca-41a4-b10a-1baf38dc4151 HTTP/1.1" status: 200  len: 210 time: 0.0431545
Jun 03 08:41:03.398470 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] No Port match for: 254571a2-c7f3-4505-bb99-ea3fbf4f484b {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:41:03.398790 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 254571a2-c7f3-4505-bb99-ea3fbf4f484b not bound to the agent host hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:41:03.556164 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b138db6-ea1b-4375-be80-0343b40a3149 req-55e0b071-db4b-4c59-b53f-924a44abb5ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:03.557624 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1b138db6-ea1b-4375-be80-0343b40a3149 req-55e0b071-db4b-4c59-b53f-924a44abb5ef service neutron] 10.222.0.55 "GET /v2.0/networks?tenant_id=db653c0bf0ab42639863b4ea2268a265&shared=False HTTP/1.1" status: 200  len: 913 time: 0.1527278
Jun 03 08:41:03.713972 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b138db6-ea1b-4375-be80-0343b40a3149 req-a21fe405-4d87-4db2-bc1c-a3aa35aff889 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:03.715514 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1b138db6-ea1b-4375-be80-0343b40a3149 req-a21fe405-4d87-4db2-bc1c-a3aa35aff889 service neutron] 10.222.0.55 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1516674
Jun 03 08:41:04.585030 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-05102ec4-1458-47a2-bdf0-5a7a51dc7a14 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1108931873&fields=id&tenant_id=db653c0bf0ab42639863b4ea2268a265 HTTP/1.1" status: 200  len: 267 time: 0.0408428
Jun 03 08:41:04.734300 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-7f1ac61b-f6eb-420a-a940-81bd1aefae88 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:04.735737 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-7f1ac61b-f6eb-420a-a940-81bd1aefae88 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/networks?id=7722e8fc-e6a8-422f-8456-a3c594da293a HTTP/1.1" status: 200  len: 812 time: 0.1443319
Jun 03 08:41:04.751320 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-c9fab120-009d-4580-912e-4f2eb8db04d7 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/quotas/db653c0bf0ab42639863b4ea2268a265 HTTP/1.1" status: 200  len: 375 time: 0.0091817
Jun 03 08:41:04.839610 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-b7a30953-1199-455c-a441-1f94c4097ecc tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=db653c0bf0ab42639863b4ea2268a265&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0822527
Jun 03 08:41:04.855080 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-10713ed0-7952-4039-b5bc-b933b480fa28 service neutron] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=92324) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 03 08:41:04.856007 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-10713ed0-7952-4039-b5bc-b933b480fa28 service neutron] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0050557
Jun 03 08:41:04.864647 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:05.070592 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-444b633d-ec3c-4006-9a3f-9de0c2f224ac service neutron] 10.222.0.11 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2093334
Jun 03 08:41:05.205941 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-97a1746b-bd88-4585-97c5-8c73f8b41508 service neutron] 10.222.0.11 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1294906
Jun 03 08:41:05.254441 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-8ea35b98-8de2-4afb-a85e-e8541b0ee5b7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:05.960711 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-5a7eed54-45b4-413f-a9a2-565138f922da req-e416cf4c-4567-41dd-9078-65b8bf585979 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Synchronizing usage tracker for tenant:db653c0bf0ab42639863b4ea2268a265 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:41:06.043182 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-5a7eed54-45b4-413f-a9a2-565138f922da req-e416cf4c-4567-41dd-9078-65b8bf585979 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Unset dirty status for tenant:db653c0bf0ab42639863b4ea2268a265 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:41:06.044362 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5a7eed54-45b4-413f-a9a2-565138f922da req-e416cf4c-4567-41dd-9078-65b8bf585979 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 210 time: 0.1304631
Jun 03 08:41:06.271784 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:07.195205 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-8c6a709c-837c-4002-8e1c-dae7e0ef07fd req-be370856-162b-4075-ac52-602ae9b3a71e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 210 time: 0.0435493
Jun 03 08:41:08.058271 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:08.290909 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-ee0b04f7-94ee-4fbb-948a-47f33f7efc30 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:08.292444 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-ee0b04f7-94ee-4fbb-948a-47f33f7efc30 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.55 "GET /v2.0/networks?id=7722e8fc-e6a8-422f-8456-a3c594da293a HTTP/1.1" status: 200  len: 812 time: 0.1507361
Jun 03 08:41:08.362705 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-45cf373f-07d1-43a8-9ce8-b1f0a5669851 req-4cb13f43-fdff-4bc1-8d6c-4abcca621e84 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 210 time: 0.0486300
Jun 03 08:41:08.388359 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-6353d0f6-a81c-48cc-a336-851c06818376 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.55 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=db653c0bf0ab42639863b4ea2268a265 HTTP/1.1" status: 200  len: 380 time: 0.0877352
Jun 03 08:41:08.396896 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-3c7dfe46-0b85-4cc2-899b-1d4c5289aec4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Request body: {'port': {'device_id': '09e60cc9-4136-4198-be52-80071a5c92f8', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'admin_state_up': True, 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'security_groups': ['fe784a5d-57d4-414f-8feb-b263c44efaf6']}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:41:08.538451 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-3c7dfe46-0b85-4cc2-899b-1d4c5289aec4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:41:08.547850 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-3c7dfe46-0b85-4cc2-899b-1d4c5289aec4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:41:08.704476 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-3c7dfe46-0b85-4cc2-899b-1d4c5289aec4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Made reservation on behalf of db653c0bf0ab42639863b4ea2268a265 for: {'port': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:41:08.708031 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-3c7dfe46-0b85-4cc2-899b-1d4c5289aec4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:08.875906 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-3c7dfe46-0b85-4cc2-899b-1d4c5289aec4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Allocated IP 172.20.0.11 (7722e8fc-e6a8-422f-8456-a3c594da293a/3eb5b6e1-724c-48ab-a49b-2b1fa5adb401/c2ddf4af-d3d3-4366-80d6-2912087aebc4) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:41:09.065261 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-3c7dfe46-0b85-4cc2-899b-1d4c5289aec4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:09.081881 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-3c7dfe46-0b85-4cc2-899b-1d4c5289aec4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Transition to ACTIVE for port object c2ddf4af-d3d3-4366-80d6-2912087aebc4 will not be triggered until provisioned by entity DHCP. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:41:09.150294 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-3c7dfe46-0b85-4cc2-899b-1d4c5289aec4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:09.156108 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-21078dfc-8c75-4746-840c-8757302158ae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:41:09.221572 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-3c7dfe46-0b85-4cc2-899b-1d4c5289aec4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Network 7722e8fc-e6a8-422f-8456-a3c594da293a is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:41:09.224797 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-3c7dfe46-0b85-4cc2-899b-1d4c5289aec4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:41:09.228622 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-3c7dfe46-0b85-4cc2-899b-1d4c5289aec4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:41:09.260391 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c7dfe46-0b85-4cc2-899b-1d4c5289aec4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event updated for resources: {'Port': ['ID=c2ddf4af-d3d3-4366-80d6-2912087aebc4,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:41:09.268054 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-3c7dfe46-0b85-4cc2-899b-1d4c5289aec4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:41:09.310365 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-3c7dfe46-0b85-4cc2-899b-1d4c5289aec4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:09.311453 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-3c7dfe46-0b85-4cc2-899b-1d4c5289aec4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:09.501444 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-3c7dfe46-0b85-4cc2-899b-1d4c5289aec4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.55 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.1083386
Jun 03 08:41:09.511707 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-18988a84-5c9e-48f8-8b56-bf11628f50c4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=92323) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 03 08:41:09.512681 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-18988a84-5c9e-48f8-8b56-bf11628f50c4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.55 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0054202
Jun 03 08:41:09.527760 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Request body: {'port': {'device_id': '09e60cc9-4136-4198-be52-80071a5c92f8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:41:09.558675 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e14e52e5-9d18-4b16-858c-4d670bcb7f83 req-bade8c3d-9c43-4170-b462-b598c8ed802d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:09.560355 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e14e52e5-9d18-4b16-858c-4d670bcb7f83 req-bade8c3d-9c43-4170-b462-b598c8ed802d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 932 time: 0.0809639
Jun 03 08:41:09.609604 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e14e52e5-9d18-4b16-858c-4d670bcb7f83 req-720e1da7-a58a-4a87-bf99-7f39313045ab tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0433466
Jun 03 08:41:09.645097 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:09.677933 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-c0a5cc70-a1ad-4ad1-9ef0-8a58e93cb7c5 None None] Provisioning for port c2ddf4af-d3d3-4366-80d6-2912087aebc4 completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:41:09.683434 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-c0a5cc70-a1ad-4ad1-9ef0-8a58e93cb7c5 None None] Provisioning complete for port c2ddf4af-d3d3-4366-80d6-2912087aebc4 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:41:09.683815 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-c0a5cc70-a1ad-4ad1-9ef0-8a58e93cb7c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:09.741449 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-c0a5cc70-a1ad-4ad1-9ef0-8a58e93cb7c5 None None] Port c2ddf4af-d3d3-4366-80d6-2912087aebc4 cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:41:09.991185 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c2ddf4af-d3d3-4366-80d6-2912087aebc4 {{(pid=92323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:41:09.998429 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:10.013007 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Transition to ACTIVE for port object c2ddf4af-d3d3-4366-80d6-2912087aebc4 will not be triggered until provisioned by entity L2. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:41:10.094999 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14211294'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:10.099581 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:41:10.373248 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Pushing event updated for resources: {'Port': ['ID=c2ddf4af-d3d3-4366-80d6-2912087aebc4,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:41:10.379796 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.281s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:41:10.457165 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Attempting to bind port c2ddf4af-d3d3-4366-80d6-2912087aebc4 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:41:10.457420 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Attempting to bind port c2ddf4af-d3d3-4366-80d6-2912087aebc4 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': 'fd0545c3-e436-4d2f-9d2d-71983702d34f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a'}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:41:10.457751 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Attempting to bind port c2ddf4af-d3d3-4366-80d6-2912087aebc4 on network 7722e8fc-e6a8-422f-8456-a3c594da293a {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:41:10.463723 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Port c2ddf4af-d3d3-4366-80d6-2912087aebc4 on network 7722e8fc-e6a8-422f-8456-a3c594da293a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 03 08:41:10.464253 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Attempting to bind port c2ddf4af-d3d3-4366-80d6-2912087aebc4 on network 7722e8fc-e6a8-422f-8456-a3c594da293a {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:41:10.470821 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Checking agent: {'id': '181c5753-100b-4f03-bda8-e34279b057f4', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'started_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 40, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:41:10.471154 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Checking segment: {'id': 'fd0545c3-e436-4d2f-9d2d-71983702d34f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:41:10.471534 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Bound using segment: {'id': 'fd0545c3-e436-4d2f-9d2d-71983702d34f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a'} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:41:10.471958 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Bound port: c2ddf4af-d3d3-4366-80d6-2912087aebc4, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fd0545c3-e436-4d2f-9d2d-71983702d34f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a'}}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:41:10.472302 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:10.561491 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] For port c2ddf4af-d3d3-4366-80d6-2912087aebc4, host hv-cinder-78726, cleared binding levels {{(pid=92323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:41:10.565944 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] For port c2ddf4af-d3d3-4366-80d6-2912087aebc4, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=c2ddf4af-d3d3-4366-80d6-2912087aebc4,segment=NetworkSegment(fd0545c3-e436-4d2f-9d2d-71983702d34f),segment_id=fd0545c3-e436-4d2f-9d2d-71983702d34f)] {{(pid=92323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:41:10.693140 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14211294'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:10.698626 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c5467d23-700d-4c62-a092-4fba813a70b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:41:10.793351 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:10.795275 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:10.795413 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] 10.222.0.55 "PUT /v2.0/ports/c2ddf4af-d3d3-4366-80d6-2912087aebc4 HTTP/1.1" status: 200  len: 1094 time: 1.2715588
Jun 03 08:41:10.804260 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '09e60cc9-4136-4198-be52-80071a5c92f8', 'tag': 'c2ddf4af-d3d3-4366-80d6-2912087aebc4'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:41:10.806638 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1712daee-f17b-4866-915e-e2554e9096b8" -d '{"events": [{"name": "network-changed", "server_uuid": "09e60cc9-4136-4198-be52-80071a5c92f8", "tag": "c2ddf4af-d3d3-4366-80d6-2912087aebc4"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:41:10.834932 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Pushing event updated for resources: {'Port': ['ID=c2ddf4af-d3d3-4366-80d6-2912087aebc4,revision_number=3']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:41:10.841186 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a51fd7eb-d173-4c83-b890-1cd319290440 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:41:10.867246 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1542bdd0-6263-4670-aa15-56cfbe558a91 req-a9e0f865-fe60-444c-b301-62ca1a13b329 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:10.868003 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-1542bdd0-6263-4670-aa15-56cfbe558a91 req-a9e0f865-fe60-444c-b301-62ca1a13b329 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Synchronizing usage tracker for tenant:db653c0bf0ab42639863b4ea2268a265 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:41:10.948646 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:41:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2400b194-5afe-482f-a756-8178099cdadb x-openstack-request-id: req-2400b194-5afe-482f-a756-8178099cdadb {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:41:10.948971 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "09e60cc9-4136-4198-be52-80071a5c92f8", "tag": "c2ddf4af-d3d3-4366-80d6-2912087aebc4", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:41:10.949446 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-2400b194-5afe-482f-a756-8178099cdadb {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:41:10.949667 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '09e60cc9-4136-4198-be52-80071a5c92f8', 'tag': 'c2ddf4af-d3d3-4366-80d6-2912087aebc4', 'status': 'completed', 'code': 200}
Jun 03 08:41:10.955400 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-1542bdd0-6263-4670-aa15-56cfbe558a91 req-a9e0f865-fe60-444c-b301-62ca1a13b329 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Unset dirty status for tenant:db653c0bf0ab42639863b4ea2268a265 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:41:10.963050 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1542bdd0-6263-4670-aa15-56cfbe558a91 req-a9e0f865-fe60-444c-b301-62ca1a13b329 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 944 time: 0.2274873
Jun 03 08:41:11.024261 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1542bdd0-6263-4670-aa15-56cfbe558a91 req-4347604f-ceca-4617-9ec0-be9ed9ad463b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0603490
Jun 03 08:41:11.036887 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-4c48ab40-3ff6-417f-ae4e-129ad4f14c34 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:11.039290 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-4c48ab40-3ff6-417f-ae4e-129ad4f14c34 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=db653c0bf0ab42639863b4ea2268a265&device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 1097 time: 0.1224062
Jun 03 08:41:11.107405 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-7b411a96-b8be-46af-957e-ca8915ebace0 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=c2ddf4af-d3d3-4366-80d6-2912087aebc4 HTTP/1.1" status: 200  len: 217 time: 0.0610752
Jun 03 08:41:11.173099 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-94a7d652-4fee-4d30-ab7c-e063ce0f3056 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:11.174570 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-94a7d652-4fee-4d30-ab7c-e063ce0f3056 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=3eb5b6e1-724c-48ab-a49b-2b1fa5adb401 HTTP/1.1" status: 200  len: 851 time: 0.0610089
Jun 03 08:41:11.248836 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-18b0fb03-db3e-43df-8989-1be22476e3e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:11.250355 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-18b0fb03-db3e-43df-8989-1be22476e3e5 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=7722e8fc-e6a8-422f-8456-a3c594da293a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0686178
Jun 03 08:41:11.379363 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-cd097589-6d07-4df2-bdfb-a0e98ee229bd service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1221561
Jun 03 08:41:11.508069 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fde2eeb9-599c-4608-a282-ba9be4a0d907 req-c5f44913-5d1c-4df5-82c8-9854cf537769 service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1226027
Jun 03 08:41:11.685615 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1712daee-f17b-4866-915e-e2554e9096b8 req-d87e8682-d9d7-4db6-8a48-767ae34d0704 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:11.687001 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1712daee-f17b-4866-915e-e2554e9096b8 req-d87e8682-d9d7-4db6-8a48-767ae34d0704 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=db653c0bf0ab42639863b4ea2268a265&device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 1097 time: 0.0740635
Jun 03 08:41:11.816924 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1712daee-f17b-4866-915e-e2554e9096b8 req-e1a564b0-4039-4838-a0e7-923284e68aa7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:11.819005 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1712daee-f17b-4866-915e-e2554e9096b8 req-e1a564b0-4039-4838-a0e7-923284e68aa7 service neutron] 10.222.0.55 "GET /v2.0/networks?id=7722e8fc-e6a8-422f-8456-a3c594da293a HTTP/1.1" status: 200  len: 913 time: 0.1253462
Jun 03 08:41:11.887611 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1712daee-f17b-4866-915e-e2554e9096b8 req-ea7c57e9-bb47-4b5a-9c5e-241315996660 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=c2ddf4af-d3d3-4366-80d6-2912087aebc4 HTTP/1.1" status: 200  len: 217 time: 0.0599763
Jun 03 08:41:11.950538 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1712daee-f17b-4866-915e-e2554e9096b8 req-38d8acb8-a248-45f8-b7d3-952c07c50fce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:11.951837 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1712daee-f17b-4866-915e-e2554e9096b8 req-38d8acb8-a248-45f8-b7d3-952c07c50fce service neutron] 10.222.0.55 "GET /v2.0/subnets?id=3eb5b6e1-724c-48ab-a49b-2b1fa5adb401 HTTP/1.1" status: 200  len: 851 time: 0.0585809
Jun 03 08:41:12.023752 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1712daee-f17b-4866-915e-e2554e9096b8 req-f64e7b94-4712-40ae-aeb8-d541779af816 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:12.025181 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1712daee-f17b-4866-915e-e2554e9096b8 req-f64e7b94-4712-40ae-aeb8-d541779af816 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=7722e8fc-e6a8-422f-8456-a3c594da293a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0674808
Jun 03 08:41:12.157544 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1712daee-f17b-4866-915e-e2554e9096b8 req-ff69de96-a933-47d3-b86c-7302450e53e8 service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1260736
Jun 03 08:41:12.214371 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83ed317b-06c3-415a-b231-776abb8d42bd req-cfe69b1f-fbbb-4f85-8a69-77a90f692dfc tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:12.215781 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-83ed317b-06c3-415a-b231-776abb8d42bd req-cfe69b1f-fbbb-4f85-8a69-77a90f692dfc tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 944 time: 0.0831554
Jun 03 08:41:12.264392 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-83ed317b-06c3-415a-b231-776abb8d42bd req-317bb9f2-0db4-45db-8df2-2cf958bfd051 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0427947
Jun 03 08:41:12.387832 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1712daee-f17b-4866-915e-e2554e9096b8 req-30ee5229-4a7c-4b0c-b0fc-849ec348e9fb service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2237735
Jun 03 08:41:13.449729 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3181a946-7c84-424e-ac88-751c921ccc89 req-4927785c-b298-40d2-9cf3-47bd996fb663 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:13.451118 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3181a946-7c84-424e-ac88-751c921ccc89 req-4927785c-b298-40d2-9cf3-47bd996fb663 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 944 time: 0.0827298
Jun 03 08:41:13.495431 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3181a946-7c84-424e-ac88-751c921ccc89 req-ac3b7a29-c8f9-497f-b3a2-98faa882398f tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0387123
Jun 03 08:41:14.690564 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-701fee1c-94bc-428b-9506-362c44ad44e7 req-2c9f3ddc-bec8-42e3-ae8e-76a41eef5676 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:14.691958 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-701fee1c-94bc-428b-9506-362c44ad44e7 req-2c9f3ddc-bec8-42e3-ae8e-76a41eef5676 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 944 time: 0.0843909
Jun 03 08:41:14.738202 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-701fee1c-94bc-428b-9506-362c44ad44e7 req-da541dff-07fe-417b-a0f4-0d36400a044c tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0400882
Jun 03 08:41:15.927148 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58d176a7-51ec-42b6-bfd3-3277985b2d29 req-0237f61d-c462-4be0-9d7d-161ef5a3c927 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:15.929428 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-58d176a7-51ec-42b6-bfd3-3277985b2d29 req-0237f61d-c462-4be0-9d7d-161ef5a3c927 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 944 time: 0.0840123
Jun 03 08:41:15.973576 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-58d176a7-51ec-42b6-bfd3-3277985b2d29 req-e762e4f3-5783-4fdf-9751-29afc5004990 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0385745
Jun 03 08:41:17.156885 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b37ddf1-e564-4ca6-b22c-6ee27090ac8a req-f82fbacb-1a29-4df4-8538-50a84833dde0 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:17.158325 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6b37ddf1-e564-4ca6-b22c-6ee27090ac8a req-f82fbacb-1a29-4df4-8538-50a84833dde0 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 944 time: 0.0819969
Jun 03 08:41:17.203830 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-6b37ddf1-e564-4ca6-b22c-6ee27090ac8a req-8e8b3c9b-ed29-4062-bff7-201caefaa50e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0392911
Jun 03 08:41:17.325979 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:41:18.388596 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a8b5f70-353e-4814-a876-d92475822ddd req-beebf10d-6621-4791-953d-4829caa96691 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:18.389961 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7a8b5f70-353e-4814-a876-d92475822ddd req-beebf10d-6621-4791-953d-4829caa96691 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 944 time: 0.0828571
Jun 03 08:41:18.433717 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7a8b5f70-353e-4814-a876-d92475822ddd req-54d138fc-efce-4506-b5b5-8ca892b72b61 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0382307
Jun 03 08:41:19.386910 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device c2ddf4af-d3d3-4366-80d6-2912087aebc4 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:41:19.523516 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port c2ddf4af-d3d3-4366-80d6-2912087aebc4, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=c2ddf4af-d3d3-4366-80d6-2912087aebc4,segment=NetworkSegment(fd0545c3-e436-4d2f-9d2d-71983702d34f),segment_id=fd0545c3-e436-4d2f-9d2d-71983702d34f)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:41:19.536413 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': 'c2ddf4af-d3d3-4366-80d6-2912087aebc4', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'port_id': 'c2ddf4af-d3d3-4366-80d6-2912087aebc4', 'mac_address': 'fa:16:3e:30:32:83', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 506, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:41:19.596740 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:19.613728 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c2ddf4af-d3d3-4366-80d6-2912087aebc4 {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:41:19.629333 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port c2ddf4af-d3d3-4366-80d6-2912087aebc4, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=c2ddf4af-d3d3-4366-80d6-2912087aebc4,segment=NetworkSegment(fd0545c3-e436-4d2f-9d2d-71983702d34f),segment_id=fd0545c3-e436-4d2f-9d2d-71983702d34f)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:41:19.629560 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7507001c-570b-46d5-8d23-3a1af2c81e91 req-f555b559-15d1-4b9a-8cf9-306c1a1cba9c tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:19.631453 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-7507001c-570b-46d5-8d23-3a1af2c81e91 req-f555b559-15d1-4b9a-8cf9-306c1a1cba9c tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 944 time: 0.0860288
Jun 03 08:41:19.675982 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-7507001c-570b-46d5-8d23-3a1af2c81e91 req-75f7ef6d-36f8-4c71-adf6-f68910e19688 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0387359
Jun 03 08:41:19.722894 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:19.725262 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:41:19.793251 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=c2ddf4af-d3d3-4366-80d6-2912087aebc4,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:41:19.800412 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:19.800752 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:19.801112 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:19.801445 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:19.801794 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:19.802118 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:19.802976 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:19.803334 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:19.803979 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:19.804300 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:19.804622 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:19.804936 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:19.808620 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:41:19.929030 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['c2ddf4af-d3d3-4366-80d6-2912087aebc4'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:41:20.858140 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-304566cc-8d81-4f51-b810-40150bae8138 req-6f8c64c1-7d73-4db3-a4d6-61bb76012696 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:20.859671 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-304566cc-8d81-4f51-b810-40150bae8138 req-6f8c64c1-7d73-4db3-a4d6-61bb76012696 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 945 time: 0.0807428
Jun 03 08:41:20.911041 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-304566cc-8d81-4f51-b810-40150bae8138 req-c893a1ca-0f6b-4baa-b729-6e5203c0d2e7 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0456231
Jun 03 08:41:21.386581 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device c2ddf4af-d3d3-4366-80d6-2912087aebc4 up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:41:21.523247 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning for port c2ddf4af-d3d3-4366-80d6-2912087aebc4 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:41:21.528003 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port c2ddf4af-d3d3-4366-80d6-2912087aebc4 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:41:21.528384 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:21.649477 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:21.675055 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '09e60cc9-4136-4198-be52-80071a5c92f8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c2ddf4af-d3d3-4366-80d6-2912087aebc4'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:41:21.679255 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8a681ea8-f7bd-4a72-82cf-aca658564ee3" -d '{"events": [{"server_uuid": "09e60cc9-4136-4198-be52-80071a5c92f8", "name": "network-vif-plugged", "status": "completed", "tag": "c2ddf4af-d3d3-4366-80d6-2912087aebc4"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:41:21.685149 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port c2ddf4af-d3d3-4366-80d6-2912087aebc4, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=c2ddf4af-d3d3-4366-80d6-2912087aebc4,segment=NetworkSegment(fd0545c3-e436-4d2f-9d2d-71983702d34f),segment_id=fd0545c3-e436-4d2f-9d2d-71983702d34f)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:41:21.720649 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:41:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c59ae903-60b1-4d49-9183-0da0febcb4d5 x-openstack-request-id: req-c59ae903-60b1-4d49-9183-0da0febcb4d5 {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:41:21.720956 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "09e60cc9-4136-4198-be52-80071a5c92f8", "name": "network-vif-plugged", "status": "completed", "tag": "c2ddf4af-d3d3-4366-80d6-2912087aebc4", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:41:21.721224 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-c59ae903-60b1-4d49-9183-0da0febcb4d5 {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:41:21.721621 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '09e60cc9-4136-4198-be52-80071a5c92f8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c2ddf4af-d3d3-4366-80d6-2912087aebc4', 'code': 200}
Jun 03 08:41:21.763020 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:21.765585 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:41:21.836106 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=c2ddf4af-d3d3-4366-80d6-2912087aebc4,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:41:21.839285 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:41:22.163500 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61605c1b-03ed-4095-a97d-d2356fb851cf req-94579844-7b01-4cf2-a5aa-ed9ba2359550 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:22.164978 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-61605c1b-03ed-4095-a97d-d2356fb851cf req-94579844-7b01-4cf2-a5aa-ed9ba2359550 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 946 time: 0.1418121
Jun 03 08:41:22.170904 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a3b887a-4d8b-4d68-877c-c0fd6cc40c52 req-89061ff4-b75f-4237-bcb6-bd846e2f78ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:22.172291 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1a3b887a-4d8b-4d68-877c-c0fd6cc40c52 req-89061ff4-b75f-4237-bcb6-bd846e2f78ab service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 1099 time: 0.1123471
Jun 03 08:41:22.242042 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-61605c1b-03ed-4095-a97d-d2356fb851cf req-7496fed7-96fa-4e98-9198-29201bc34e45 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0687623
Jun 03 08:41:22.243588 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-1a3b887a-4d8b-4d68-877c-c0fd6cc40c52 req-fc615047-3cf1-402d-9242-c271cea91d41 service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0564470
Jun 03 08:41:23.432888 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03d35b5b-12c7-4e79-8d17-89405f3cd5df req-babad8f3-e831-4758-881d-29afb1680a82 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:23.434237 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-03d35b5b-12c7-4e79-8d17-89405f3cd5df req-babad8f3-e831-4758-881d-29afb1680a82 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 946 time: 0.0811410
Jun 03 08:41:23.479239 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-03d35b5b-12c7-4e79-8d17-89405f3cd5df req-7c1a6897-92f7-48f7-a6a1-f5af88b5ff91 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0394671
Jun 03 08:41:23.660979 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a68f2ec-cd69-4d26-aa8f-58330ab9ad70 req-908a3143-7405-46cf-b3a9-fbb8eb0fcb6e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:23.662613 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4a68f2ec-cd69-4d26-aa8f-58330ab9ad70 req-908a3143-7405-46cf-b3a9-fbb8eb0fcb6e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 946 time: 0.0815728
Jun 03 08:41:23.706109 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-4a68f2ec-cd69-4d26-aa8f-58330ab9ad70 req-a29df795-7bc8-4f6e-8919-6ced46f8f427 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0379524
Jun 03 08:41:23.729784 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 57286) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:41:23.801829 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23933449-4878-4266-a39f-95d5eb7d0b01 tempest-TestVolumeBootPattern-1749998531 tempest-TestVolumeBootPattern-1749998531-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:23.804071 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-23933449-4878-4266-a39f-95d5eb7d0b01 tempest-TestVolumeBootPattern-1749998531 tempest-TestVolumeBootPattern-1749998531-project-admin] 10.222.0.11 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 1094 time: 0.0730665
Jun 03 08:41:23.806937 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 57288) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:41:23.811674 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Request body: {'floatingip': {'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'port_id': 'c2ddf4af-d3d3-4366-80d6-2912087aebc4', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'fixed_ip_address': '172.20.0.11'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:41:23.818465 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:41:23.822513 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Usage tracker for resource:floatingip and tenant:db653c0bf0ab42639863b4ea2268a265 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:41:23.825395 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:41:23.831439 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:41:23.946181 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for floatingip, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:24.087991 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:24.218454 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Allocated IP 172.27.0.20 (684ef871-89aa-450d-ae0d-e232bfaf51fb/e7b58fba-1ed5-483b-b341-7736b2ffb853/ddafe743-390c-4b76-aa43-bc8187a71cbb) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:41:24.368612 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:24.477855 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:24.481660 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-1883b8ec-6956-45c0-9b5a-c47684e61167 tempest-AttachVolumeShelveTestJSON-598377996 tempest-AttachVolumeShelveTestJSON-598377996-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:41:24.543096 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:41:24.545803 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:41:24.549308 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:41:24.582388 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event updated for resources: {'Port': ['ID=ddafe743-390c-4b76-aa43-bc8187a71cbb,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:41:24.602657 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:24.603038 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:24.603407 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:24.603771 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:24.604128 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:24.604486 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:24.604840 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:24.605192 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:24.605544 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:24.605893 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:24.606237 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:24.606860 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:41:24.611563 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:41:25.070083 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:25.210315 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:25.419273 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:25.475897 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14211294'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:25.479702 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-3c7dfe46-0b85-4cc2-899b-1d4c5289aec4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:41:25.584163 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event updated for resources: {'Port': ['ID=ddafe743-390c-4b76-aa43-bc8187a71cbb,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:41:25.588198 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:41:25.596409 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16327919'] for floatingip, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:25.777265 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.db.l3_db [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Floating IP a8b41950-06a8-4e80-963b-c82247c67bd2 associated. External IP: 172.27.0.20, port: c2ddf4af-d3d3-4366-80d6-2912087aebc4.
Jun 03 08:41:26.131055 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:41:26.151397 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:26.306081 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:41:26.316630 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-279db17e-1f13-4df8-bff8-a329a8842369 None None] Sync routers for ids ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:41:26.325654 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-279db17e-1f13-4df8-bff8-a329a8842369 None None] Routers {'8d6b2faf-68a8-4edd-91ad-352b92d8cf84'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:41:26.326270 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-279db17e-1f13-4df8-bff8-a329a8842369 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae85f1ef70>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:41:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:41:26.385932 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for floatingip, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:26.441445 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-a90b31fd-9460-465e-bc7a-065bfa2aa002 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 2.6333013
Jun 03 08:41:26.442097 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '09e60cc9-4136-4198-be52-80071a5c92f8', 'tag': 'c2ddf4af-d3d3-4366-80d6-2912087aebc4'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:41:26.444637 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-134ef9a6-fe99-473a-b8fb-d9f699bb3155" -d '{"events": [{"name": "network-changed", "server_uuid": "09e60cc9-4136-4198-be52-80071a5c92f8", "tag": "c2ddf4af-d3d3-4366-80d6-2912087aebc4"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:41:26.486053 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:41:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f11a879d-0c2a-42d2-829a-590187ddf268 x-openstack-request-id: req-f11a879d-0c2a-42d2-829a-590187ddf268 {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:41:26.486382 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "09e60cc9-4136-4198-be52-80071a5c92f8", "tag": "c2ddf4af-d3d3-4366-80d6-2912087aebc4", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:41:26.486701 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-f11a879d-0c2a-42d2-829a-590187ddf268 {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:41:26.491539 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '09e60cc9-4136-4198-be52-80071a5c92f8', 'tag': 'c2ddf4af-d3d3-4366-80d6-2912087aebc4', 'status': 'completed', 'code': 200}
Jun 03 08:41:26.505449 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-279db17e-1f13-4df8-bff8-a329a8842369 None None] Set router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:41:26.583469 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-134ef9a6-fe99-473a-b8fb-d9f699bb3155 req-85f60431-fc3c-43f4-b39d-3da798ded56d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:26.585006 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-134ef9a6-fe99-473a-b8fb-d9f699bb3155 req-85f60431-fc3c-43f4-b39d-3da798ded56d service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=db653c0bf0ab42639863b4ea2268a265&device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 1099 time: 0.0753167
Jun 03 08:41:26.837809 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-134ef9a6-fe99-473a-b8fb-d9f699bb3155 req-e62b4abb-17db-4e57-81b9-93593f57c2bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:26.839294 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-134ef9a6-fe99-473a-b8fb-d9f699bb3155 req-e62b4abb-17db-4e57-81b9-93593f57c2bc service neutron] 10.222.0.55 "GET /v2.0/networks?id=7722e8fc-e6a8-422f-8456-a3c594da293a HTTP/1.1" status: 200  len: 913 time: 0.2484863
Jun 03 08:41:26.895189 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-279db17e-1f13-4df8-bff8-a329a8842369 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae85f1ef70>, [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': 'a8b41950-06a8-4e80-963b-c82247c67bd2', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'floating_ip_address': '172.27.0.20', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'port_id': 'c2ddf4af-d3d3-4366-80d6-2912087aebc4', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'mac_address': 'fa:16:3e:30:32:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09e60cc9-4136-4198-be52-80071a5c92f8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:41:25Z', 'updated_at': '2021-06-03T08:41:25Z', 'revision_number': 0, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1b247c7f-4ca7-44d5-97b2-94031de25c6e', 'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'mac_address': 'fa:16:3e:f4:70:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:51Z', 'updated_at': '2021-06-03T08:37:59Z', 'revision_number': 5, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'subnets': [{'id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:41:26.899758 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-279db17e-1f13-4df8-bff8-a329a8842369 None None] Checking router: 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:41:26.908166 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-279db17e-1f13-4df8-bff8-a329a8842369 None None] Routers {'8d6b2faf-68a8-4edd-91ad-352b92d8cf84'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:41:26.908752 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-279db17e-1f13-4df8-bff8-a329a8842369 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae85f1ef70>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:41:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:41:26.941825 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-134ef9a6-fe99-473a-b8fb-d9f699bb3155 req-30a521dc-3953-485f-aa40-2e262b9943cb service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=c2ddf4af-d3d3-4366-80d6-2912087aebc4 HTTP/1.1" status: 200  len: 999 time: 0.0959523
Jun 03 08:41:27.003082 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-134ef9a6-fe99-473a-b8fb-d9f699bb3155 req-97c186fa-d692-4e69-9a28-b2486ba150a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:27.004516 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-134ef9a6-fe99-473a-b8fb-d9f699bb3155 req-97c186fa-d692-4e69-9a28-b2486ba150a2 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=3eb5b6e1-724c-48ab-a49b-2b1fa5adb401 HTTP/1.1" status: 200  len: 851 time: 0.0554428
Jun 03 08:41:27.080514 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-134ef9a6-fe99-473a-b8fb-d9f699bb3155 req-d220fdfe-f310-4c20-97ca-f974f60b15df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:41:27.081998 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-134ef9a6-fe99-473a-b8fb-d9f699bb3155 req-d220fdfe-f310-4c20-97ca-f974f60b15df service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=7722e8fc-e6a8-422f-8456-a3c594da293a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0701311
Jun 03 08:41:27.087794 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-279db17e-1f13-4df8-bff8-a329a8842369 None None] Set router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:41:27.215194 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-134ef9a6-fe99-473a-b8fb-d9f699bb3155 req-1f856b50-e137-43b8-98c8-3924ded2b5c4 service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1264820
Jun 03 08:41:27.348217 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-134ef9a6-fe99-473a-b8fb-d9f699bb3155 req-ada7163f-9f72-464c-9bf9-77248c6d8950 service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1271546
Jun 03 08:41:27.433370 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-279db17e-1f13-4df8-bff8-a329a8842369 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae85f1ef70>, [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': 'a8b41950-06a8-4e80-963b-c82247c67bd2', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'floating_ip_address': '172.27.0.20', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'port_id': 'c2ddf4af-d3d3-4366-80d6-2912087aebc4', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'mac_address': 'fa:16:3e:30:32:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09e60cc9-4136-4198-be52-80071a5c92f8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:41:25Z', 'updated_at': '2021-06-03T08:41:25Z', 'revision_number': 0, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1b247c7f-4ca7-44d5-97b2-94031de25c6e', 'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'mac_address': 'fa:16:3e:f4:70:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:51Z', 'updated_at': '2021-06-03T08:37:59Z', 'revision_number': 5, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'subnets': [{'id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:41:27.437204 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-279db17e-1f13-4df8-bff8-a329a8842369 None None] The sync data for ids ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'] in dv-cinder-787262-5-iscsi is: [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': 'a8b41950-06a8-4e80-963b-c82247c67bd2', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'floating_ip_address': '172.27.0.20', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'port_id': 'c2ddf4af-d3d3-4366-80d6-2912087aebc4', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'mac_address': 'fa:16:3e:30:32:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09e60cc9-4136-4198-be52-80071a5c92f8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:41:25Z', 'updated_at': '2021-06-03T08:41:25Z', 'revision_number': 0, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1b247c7f-4ca7-44d5-97b2-94031de25c6e', 'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'mac_address': 'fa:16:3e:f4:70:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:51Z', 'updated_at': '2021-06-03T08:37:59Z', 'revision_number': 5, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'subnets': [{'id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:41:27.608410 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b17dbca6-8810-4498-98d5-8630d94015d8 None None] New status for floating IP a8b41950-06a8-4e80-963b-c82247c67bd2: ACTIVE {{(pid=92326) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 03 08:41:32.511605 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-f50cd299-bbea-4d16-b828-e95daa8c04dd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:34.836978 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:35.287402 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-02fcd912-4c71-430a-a336-820454be83ba None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:36.226328 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:38.080659 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:41:54.324867 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:41:56.145789 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:42:02.517021 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-932544d7-c7c0-435a-8cd1-35a200220c8c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:42:04.819882 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:42:05.248986 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9a695f25-f44c-4507-a04a-428762c37254 req-1c8a9dde-6abe-4d6c-bdb7-67ea4e43fdfc service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0726464
Jun 03 08:42:05.258570 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-2b44ea6c-e1b9-488d-a420-c34e9d6eafef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:42:05.406773 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a695f25-f44c-4507-a04a-428762c37254 req-a4f1215d-6f0c-4468-adca-646aa847ad0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:42:05.408191 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9a695f25-f44c-4507-a04a-428762c37254 req-a4f1215d-6f0c-4468-adca-646aa847ad0b service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=db653c0bf0ab42639863b4ea2268a265&device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 1099 time: 0.0885665
Jun 03 08:42:05.566532 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a695f25-f44c-4507-a04a-428762c37254 req-e110390d-9041-42c2-81fd-2dde4801a7ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:42:05.568493 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9a695f25-f44c-4507-a04a-428762c37254 req-e110390d-9041-42c2-81fd-2dde4801a7ce service neutron] 10.222.0.55 "GET /v2.0/networks?id=7722e8fc-e6a8-422f-8456-a3c594da293a HTTP/1.1" status: 200  len: 913 time: 0.1360691
Jun 03 08:42:05.687096 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9a695f25-f44c-4507-a04a-428762c37254 req-6c89277f-4df7-4e43-87d1-6ba5689ee470 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=c2ddf4af-d3d3-4366-80d6-2912087aebc4 HTTP/1.1" status: 200  len: 1001 time: 0.1112003
Jun 03 08:42:05.758841 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a695f25-f44c-4507-a04a-428762c37254 req-b40cfd00-21e0-481f-8dda-081fa0ecfd2b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:42:05.760330 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9a695f25-f44c-4507-a04a-428762c37254 req-b40cfd00-21e0-481f-8dda-081fa0ecfd2b service neutron] 10.222.0.55 "GET /v2.0/subnets?id=3eb5b6e1-724c-48ab-a49b-2b1fa5adb401 HTTP/1.1" status: 200  len: 851 time: 0.0673370
Jun 03 08:42:05.841500 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a695f25-f44c-4507-a04a-428762c37254 req-4eb3d1d4-863c-4a93-a5e1-824a527098be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:42:05.843179 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9a695f25-f44c-4507-a04a-428762c37254 req-4eb3d1d4-863c-4a93-a5e1-824a527098be service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=7722e8fc-e6a8-422f-8456-a3c594da293a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0758917
Jun 03 08:42:05.994232 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9a695f25-f44c-4507-a04a-428762c37254 req-53e91fbe-2328-4f67-a619-e7eb34fdf7e4 service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1433725
Jun 03 08:42:06.158456 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9a695f25-f44c-4507-a04a-428762c37254 req-3c0abd29-2a4b-40e2-b81b-71183eaee5a8 service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1576116
Jun 03 08:42:06.252489 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:42:08.077155 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:42:26.157224 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:42:31.323691 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:42:32.511877 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-d6997a04-bc98-4094-bcfa-f13f4332cbcf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:42:34.842464 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:42:35.280335 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-9be3f33e-2fb9-4c9a-a817-6bd7bd600c17 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:42:36.234674 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:42:38.091741 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:42:56.168698 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:02.539514 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-d1e7e6a4-f790-4287-9ce8-8c7b8ac71289 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:03.387093 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7712a654-8859-4943-9e25-04de4d1a013e req-ffb767b3-a9fd-43eb-b2d5-313ce9f12062 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1108931873&fields=id&tenant_id=db653c0bf0ab42639863b4ea2268a265 HTTP/1.1" status: 200  len: 267 time: 0.0392060
Jun 03 08:43:03.541537 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7712a654-8859-4943-9e25-04de4d1a013e req-8e044891-e350-40bc-83bc-9ab268ad9519 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:03.542990 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7712a654-8859-4943-9e25-04de4d1a013e req-8e044891-e350-40bc-83bc-9ab268ad9519 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/networks?id=7722e8fc-e6a8-422f-8456-a3c594da293a HTTP/1.1" status: 200  len: 812 time: 0.1490829
Jun 03 08:43:03.557614 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7712a654-8859-4943-9e25-04de4d1a013e req-be7ba374-71ee-4cc7-afb0-70fcb7a48da6 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/quotas/db653c0bf0ab42639863b4ea2268a265 HTTP/1.1" status: 200  len: 375 time: 0.0088983
Jun 03 08:43:03.738975 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7712a654-8859-4943-9e25-04de4d1a013e req-c42bd31b-18b9-4958-91e9-c2217fbeeb62 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?tenant_id=db653c0bf0ab42639863b4ea2268a265&fields=id HTTP/1.1" status: 200  len: 440 time: 0.1761196
Jun 03 08:43:03.798427 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [req-7712a654-8859-4943-9e25-04de4d1a013e req-d7c03261-28cd-4159-9bb2-147d73f34ec6 service neutron] http://10.222.0.11:9696/v2.0/extensions returned with HTTP 200 {{(pid=92323) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 03 08:43:03.799434 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7712a654-8859-4943-9e25-04de4d1a013e req-d7c03261-28cd-4159-9bb2-147d73f34ec6 service neutron] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0487392
Jun 03 08:43:03.928814 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7712a654-8859-4943-9e25-04de4d1a013e req-9efc6fc9-ad21-4427-b860-78e10bfadb0c service neutron] 10.222.0.11 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1233366
Jun 03 08:43:04.056559 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7712a654-8859-4943-9e25-04de4d1a013e req-a5729dcf-9207-473f-b888-e776028b6077 service neutron] 10.222.0.11 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1218524
Jun 03 08:43:04.754827 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-ad679700-e66f-4f84-af42-1459ab8a3b42 req-5f6952d1-b262-4579-97d2-6ccb96366085 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 210 time: 0.0468197
Jun 03 08:43:04.843135 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:05.243058 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-34072af5-f9d2-4e1f-9c00-78628f94f59f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:05.932350 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3c3d9b12-eea2-4e07-ab59-54520377cdcf req-2160614b-87cd-445f-8aaf-a50117b849d0 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 210 time: 0.0531750
Jun 03 08:43:06.242954 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:06.326474 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5bd7593e-a06b-4aac-b074-0b5a3cc311e1 req-311c632b-2fb9-4904-ade4-176063c4b210 service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0723469
Jun 03 08:43:06.477391 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd7593e-a06b-4aac-b074-0b5a3cc311e1 req-a592a52f-096f-4b16-b2b1-633beab15f7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:06.479108 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5bd7593e-a06b-4aac-b074-0b5a3cc311e1 req-a592a52f-096f-4b16-b2b1-633beab15f7b service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=db653c0bf0ab42639863b4ea2268a265&device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 1099 time: 0.0727510
Jun 03 08:43:06.625220 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd7593e-a06b-4aac-b074-0b5a3cc311e1 req-02e77595-34b1-46fe-8f4b-b907e328abee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:06.626693 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5bd7593e-a06b-4aac-b074-0b5a3cc311e1 req-02e77595-34b1-46fe-8f4b-b907e328abee service neutron] 10.222.0.55 "GET /v2.0/networks?id=7722e8fc-e6a8-422f-8456-a3c594da293a HTTP/1.1" status: 200  len: 913 time: 0.1276579
Jun 03 08:43:06.730681 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5bd7593e-a06b-4aac-b074-0b5a3cc311e1 req-c8c76b85-445c-4c79-81b9-ec08335e0651 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=c2ddf4af-d3d3-4366-80d6-2912087aebc4 HTTP/1.1" status: 200  len: 1001 time: 0.0970931
Jun 03 08:43:06.807289 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd7593e-a06b-4aac-b074-0b5a3cc311e1 req-76e2cdc4-bb8a-41d5-a9d4-81bafefba114 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:06.808790 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5bd7593e-a06b-4aac-b074-0b5a3cc311e1 req-76e2cdc4-bb8a-41d5-a9d4-81bafefba114 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=3eb5b6e1-724c-48ab-a49b-2b1fa5adb401 HTTP/1.1" status: 200  len: 851 time: 0.0668414
Jun 03 08:43:06.888282 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd7593e-a06b-4aac-b074-0b5a3cc311e1 req-74ce2999-1c6f-4983-a972-395f91c703cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:06.889794 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5bd7593e-a06b-4aac-b074-0b5a3cc311e1 req-74ce2999-1c6f-4983-a972-395f91c703cf service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=7722e8fc-e6a8-422f-8456-a3c594da293a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0744691
Jun 03 08:43:07.051271 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5bd7593e-a06b-4aac-b074-0b5a3cc311e1 req-2c8bae96-dc5d-4a11-809a-b93aff899491 service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1553006
Jun 03 08:43:07.089054 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a7e13869-a6f2-4dc3-9cd3-5c4bb7eff26c req-60a28086-7fbc-4742-9849-d22521c17868 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 210 time: 0.0467048
Jun 03 08:43:07.270390 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7712a654-8859-4943-9e25-04de4d1a013e req-58bc1421-f748-4d31-b884-f93381378daf tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:07.272374 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7712a654-8859-4943-9e25-04de4d1a013e req-58bc1421-f748-4d31-b884-f93381378daf tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.55 "GET /v2.0/networks?id=7722e8fc-e6a8-422f-8456-a3c594da293a HTTP/1.1" status: 200  len: 812 time: 0.2511961
Jun 03 08:43:07.295207 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5bd7593e-a06b-4aac-b074-0b5a3cc311e1 req-931af616-8251-458d-9d2c-c6c4555a09a7 service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2291706
Jun 03 08:43:07.379355 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7712a654-8859-4943-9e25-04de4d1a013e req-3a300cee-c374-4577-829c-a4fb56fc93b8 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.55 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=db653c0bf0ab42639863b4ea2268a265 HTTP/1.1" status: 200  len: 380 time: 0.0945051
Jun 03 08:43:07.388811 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-7712a654-8859-4943-9e25-04de4d1a013e req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Request body: {'port': {'device_id': '4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'admin_state_up': True, 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'security_groups': ['fe784a5d-57d4-414f-8feb-b263c44efaf6']}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:43:07.526622 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-7712a654-8859-4943-9e25-04de4d1a013e req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:43:07.536961 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [req-7712a654-8859-4943-9e25-04de4d1a013e req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:43:07.614118 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7712a654-8859-4943-9e25-04de4d1a013e req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Made reservation on behalf of db653c0bf0ab42639863b4ea2268a265 for: {'port': 1} {{(pid=92323) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 03 08:43:07.617672 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-7712a654-8859-4943-9e25-04de4d1a013e req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:07.900381 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [req-7712a654-8859-4943-9e25-04de4d1a013e req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Allocated IP 172.20.0.12 (7722e8fc-e6a8-422f-8456-a3c594da293a/3eb5b6e1-724c-48ab-a49b-2b1fa5adb401/5470fb7d-d803-41b8-b8e5-9d842fa979b3) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:43:08.071296 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:08.096933 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-7712a654-8859-4943-9e25-04de4d1a013e req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:08.112238 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-7712a654-8859-4943-9e25-04de4d1a013e req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Transition to ACTIVE for port object 5470fb7d-d803-41b8-b8e5-9d842fa979b3 will not be triggered until provisioned by entity DHCP. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:43:08.188799 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-7712a654-8859-4943-9e25-04de4d1a013e req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:08.195779 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-b2ea83ef-5464-404b-8256-c70b0909f9eb tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:43:08.318180 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7712a654-8859-4943-9e25-04de4d1a013e req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Network 7722e8fc-e6a8-422f-8456-a3c594da293a is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:43:08.323421 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [req-7712a654-8859-4943-9e25-04de4d1a013e req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:43:08.323583 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:43:08.326384 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-7712a654-8859-4943-9e25-04de4d1a013e req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:43:08.377382 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event updated for resources: {'Port': ['ID=5470fb7d-d803-41b8-b8e5-9d842fa979b3,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:43:08.399445 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:08.399848 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:08.400177 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:08.400531 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:08.400881 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:08.401232 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:08.401577 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:08.401923 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:08.402270 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:08.402639 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:08.403018 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:08.403367 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:08.407229 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:43:08.426976 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7712a654-8859-4943-9e25-04de4d1a013e req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:08.427589 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-7712a654-8859-4943-9e25-04de4d1a013e req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:08.467270 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce839867-2f70-41cf-b031-c3c6681d6488 req-698ec11b-b4c9-4738-a6c7-11fbcffbd2a3 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:08.467270 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-ce839867-2f70-41cf-b031-c3c6681d6488 req-698ec11b-b4c9-4738-a6c7-11fbcffbd2a3 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Synchronizing usage tracker for tenant:db653c0bf0ab42639863b4ea2268a265 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:43:08.545503 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7712a654-8859-4943-9e25-04de4d1a013e req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.55 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.1603508
Jun 03 08:43:08.556648 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [req-7712a654-8859-4943-9e25-04de4d1a013e req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Request body: {'port': {'device_id': '4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:43:08.624139 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-34c771e2-141c-422e-9dd6-d7185e0165cb None None] Provisioning for port 5470fb7d-d803-41b8-b8e5-9d842fa979b3 completed by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:43:08.629484 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-34c771e2-141c-422e-9dd6-d7185e0165cb None None] Provisioning complete for port 5470fb7d-d803-41b8-b8e5-9d842fa979b3 triggered by entity DHCP. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:43:08.633553 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-34c771e2-141c-422e-9dd6-d7185e0165cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:08.663149 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-ce839867-2f70-41cf-b031-c3c6681d6488 req-698ec11b-b4c9-4738-a6c7-11fbcffbd2a3 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Unset dirty status for tenant:db653c0bf0ab42639863b4ea2268a265 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:43:08.670216 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ce839867-2f70-41cf-b031-c3c6681d6488 req-698ec11b-b4c9-4738-a6c7-11fbcffbd2a3 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 932 time: 0.4219620
Jun 03 08:43:08.683136 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-34c771e2-141c-422e-9dd6-d7185e0165cb None None] Port 5470fb7d-d803-41b8-b8e5-9d842fa979b3 cannot update to ACTIVE because it is not bound. {{(pid=92325) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 03 08:43:08.695523 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-7712a654-8859-4943-9e25-04de4d1a013e req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:08.771957 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ce839867-2f70-41cf-b031-c3c6681d6488 req-0fee84e1-70b0-47c6-9ee1-3cb520f3b489 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1001129
Jun 03 08:43:09.054486 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [req-7712a654-8859-4943-9e25-04de4d1a013e req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5470fb7d-d803-41b8-b8e5-9d842fa979b3 {{(pid=92323) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:43:09.061806 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-7712a654-8859-4943-9e25-04de4d1a013e req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:09.075879 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.provisioning_blocks [req-7712a654-8859-4943-9e25-04de4d1a013e req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Transition to ACTIVE for port object 5470fb7d-d803-41b8-b8e5-9d842fa979b3 will not be triggered until provisioned by entity L2. {{(pid=92323) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 03 08:43:09.177315 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-7712a654-8859-4943-9e25-04de4d1a013e req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14211294'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:09.181609 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-679147f8-ffab-4dc2-b53d-06a632fb5784 tempest-AttachVolumeTestJSON-1233849334 tempest-AttachVolumeTestJSON-1233849334-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:43:09.337873 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Pushing event updated for resources: {'Port': ['ID=5470fb7d-d803-41b8-b8e5-9d842fa979b3,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:43:09.346357 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:43:09.420077 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-7712a654-8859-4943-9e25-04de4d1a013e req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Attempting to bind port 5470fb7d-d803-41b8-b8e5-9d842fa979b3 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 03 08:43:09.423418 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-7712a654-8859-4943-9e25-04de4d1a013e req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Attempting to bind port 5470fb7d-d803-41b8-b8e5-9d842fa979b3 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': 'fd0545c3-e436-4d2f-9d2d-71983702d34f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a'}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 03 08:43:09.423418 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7712a654-8859-4943-9e25-04de4d1a013e req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Attempting to bind port 5470fb7d-d803-41b8-b8e5-9d842fa979b3 on network 7722e8fc-e6a8-422f-8456-a3c594da293a {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:43:09.425349 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7712a654-8859-4943-9e25-04de4d1a013e req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Port 5470fb7d-d803-41b8-b8e5-9d842fa979b3 on network 7722e8fc-e6a8-422f-8456-a3c594da293a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 03 08:43:09.425675 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7712a654-8859-4943-9e25-04de4d1a013e req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Attempting to bind port 5470fb7d-d803-41b8-b8e5-9d842fa979b3 on network 7722e8fc-e6a8-422f-8456-a3c594da293a {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 03 08:43:09.431104 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7712a654-8859-4943-9e25-04de4d1a013e req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Checking agent: {'id': '181c5753-100b-4f03-bda8-e34279b057f4', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'started_at': datetime.datetime(2021, 6, 3, 8, 28, 56), 'heartbeat_timestamp': datetime.datetime(2021, 6, 3, 8, 42, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 03 08:43:09.431443 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7712a654-8859-4943-9e25-04de4d1a013e req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Checking segment: {'id': 'fd0545c3-e436-4d2f-9d2d-71983702d34f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92323) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 03 08:43:09.431825 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7712a654-8859-4943-9e25-04de4d1a013e req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Bound using segment: {'id': 'fd0545c3-e436-4d2f-9d2d-71983702d34f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a'} {{(pid=92323) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 03 08:43:09.432248 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.managers [req-7712a654-8859-4943-9e25-04de4d1a013e req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Bound port: 5470fb7d-d803-41b8-b8e5-9d842fa979b3, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fd0545c3-e436-4d2f-9d2d-71983702d34f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 506, 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a'}}] {{(pid=92323) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 03 08:43:09.432594 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-7712a654-8859-4943-9e25-04de4d1a013e req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:09.522150 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-7712a654-8859-4943-9e25-04de4d1a013e req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] For port 5470fb7d-d803-41b8-b8e5-9d842fa979b3, host hv-cinder-78726, cleared binding levels {{(pid=92323) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 03 08:43:09.525048 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-7712a654-8859-4943-9e25-04de4d1a013e req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] For port 5470fb7d-d803-41b8-b8e5-9d842fa979b3, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=5470fb7d-d803-41b8-b8e5-9d842fa979b3,segment=NetworkSegment(fd0545c3-e436-4d2f-9d2d-71983702d34f),segment_id=fd0545c3-e436-4d2f-9d2d-71983702d34f)] {{(pid=92323) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 03 08:43:09.591798 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-7712a654-8859-4943-9e25-04de4d1a013e req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14211294'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:09.596150 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-44bd37b7-fd86-43cb-9814-58f8782453d4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:43:09.655169 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7712a654-8859-4943-9e25-04de4d1a013e req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:09.655782 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-7712a654-8859-4943-9e25-04de4d1a013e req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:09.657147 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7712a654-8859-4943-9e25-04de4d1a013e req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] 10.222.0.55 "PUT /v2.0/ports/5470fb7d-d803-41b8-b8e5-9d842fa979b3 HTTP/1.1" status: 200  len: 1094 time: 1.1047595
Jun 03 08:43:09.657661 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7', 'tag': '5470fb7d-d803-41b8-b8e5-9d842fa979b3'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:43:09.659955 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6f11f0e6-55b7-457f-8ca9-7eafc7edcd79" -d '{"events": [{"name": "network-changed", "server_uuid": "4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7", "tag": "5470fb7d-d803-41b8-b8e5-9d842fa979b3"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:43:09.682085 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Pushing event updated for resources: {'Port': ['ID=5470fb7d-d803-41b8-b8e5-9d842fa979b3,revision_number=3']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:43:09.685782 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-a800b46d-1984-4e88-870f-0de32d6ae774 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:43:09.708904 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:43:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e06cbcfd-8c86-46a8-8971-e15e734fbb8b x-openstack-request-id: req-e06cbcfd-8c86-46a8-8971-e15e734fbb8b {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:43:09.709238 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7", "tag": "5470fb7d-d803-41b8-b8e5-9d842fa979b3", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:43:09.709527 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-e06cbcfd-8c86-46a8-8971-e15e734fbb8b {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:43:09.709961 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7', 'tag': '5470fb7d-d803-41b8-b8e5-9d842fa979b3', 'status': 'completed', 'code': 200}
Jun 03 08:43:09.801403 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f11f0e6-55b7-457f-8ca9-7eafc7edcd79 req-3f2f882b-4fca-4748-bdf0-c402ed11e2bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:09.802599 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6f11f0e6-55b7-457f-8ca9-7eafc7edcd79 req-3f2f882b-4fca-4748-bdf0-c402ed11e2bf service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=db653c0bf0ab42639863b4ea2268a265&device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 1097 time: 0.0732431
Jun 03 08:43:10.093302 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f11f0e6-55b7-457f-8ca9-7eafc7edcd79 req-64d80452-5097-4afb-b11b-cfdca3ed4233 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:10.094760 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6f11f0e6-55b7-457f-8ca9-7eafc7edcd79 req-64d80452-5097-4afb-b11b-cfdca3ed4233 service neutron] 10.222.0.55 "GET /v2.0/networks?tenant_id=db653c0bf0ab42639863b4ea2268a265&shared=False HTTP/1.1" status: 200  len: 913 time: 0.2837982
Jun 03 08:43:10.133864 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65d98983-5e3b-4af8-a887-e2662621f535 req-4fbf28c0-0f71-4644-8fa8-e0b6416df654 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:10.135342 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-65d98983-5e3b-4af8-a887-e2662621f535 req-4fbf28c0-0f71-4644-8fa8-e0b6416df654 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 944 time: 0.2369485
Jun 03 08:43:10.258027 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-65d98983-5e3b-4af8-a887-e2662621f535 req-b1488e2c-2d27-4420-b2ad-929900541e43 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1163180
Jun 03 08:43:10.277209 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f11f0e6-55b7-457f-8ca9-7eafc7edcd79 req-a5fbdf9b-03e9-44df-9d19-a8fcf2405958 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:10.279213 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-6f11f0e6-55b7-457f-8ca9-7eafc7edcd79 req-a5fbdf9b-03e9-44df-9d19-a8fcf2405958 service neutron] 10.222.0.55 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1768081
Jun 03 08:43:10.380482 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7712a654-8859-4943-9e25-04de4d1a013e req-3dd7c6de-a7fa-4e4f-9fb5-d4bd9ce2b03e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:10.381930 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7712a654-8859-4943-9e25-04de4d1a013e req-3dd7c6de-a7fa-4e4f-9fb5-d4bd9ce2b03e service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=db653c0bf0ab42639863b4ea2268a265&device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 1097 time: 0.0691988
Jun 03 08:43:10.452681 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7712a654-8859-4943-9e25-04de4d1a013e req-1ec9bbd9-5226-4195-ab9b-8277cc99a060 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=5470fb7d-d803-41b8-b8e5-9d842fa979b3 HTTP/1.1" status: 200  len: 217 time: 0.0631108
Jun 03 08:43:10.517460 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7712a654-8859-4943-9e25-04de4d1a013e req-b8cc6e45-3ba5-4276-9632-b40e678de828 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:10.518810 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7712a654-8859-4943-9e25-04de4d1a013e req-b8cc6e45-3ba5-4276-9632-b40e678de828 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=3eb5b6e1-724c-48ab-a49b-2b1fa5adb401 HTTP/1.1" status: 200  len: 851 time: 0.0601943
Jun 03 08:43:10.596170 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7712a654-8859-4943-9e25-04de4d1a013e req-3f65e7ea-51b4-42c9-8bbd-8c37f8a80c7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:10.597639 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7712a654-8859-4943-9e25-04de4d1a013e req-3f65e7ea-51b4-42c9-8bbd-8c37f8a80c7a service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=7722e8fc-e6a8-422f-8456-a3c594da293a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0705929
Jun 03 08:43:10.733171 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7712a654-8859-4943-9e25-04de4d1a013e req-4940fd6e-8755-49ab-8d2e-e6090d978a4e service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1273003
Jun 03 08:43:10.866569 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-7712a654-8859-4943-9e25-04de4d1a013e req-fcf379ca-a36f-45b8-9370-51ed15c6a359 service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1271157
Jun 03 08:43:11.445553 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daa508a7-8984-468b-b1f1-1dab193f68a4 req-2e74da0e-461d-4939-b7a4-d539228e8725 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:11.446929 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-daa508a7-8984-468b-b1f1-1dab193f68a4 req-2e74da0e-461d-4939-b7a4-d539228e8725 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 944 time: 0.0805082
Jun 03 08:43:11.491937 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-daa508a7-8984-468b-b1f1-1dab193f68a4 req-10332e2d-44be-4b81-8360-4a21c6de3e5a tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0386839
Jun 03 08:43:12.671927 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09046ff6-9045-4711-b212-ef50fd24a29f req-cad7a373-efe8-4a4a-b28c-bcd35e9952d0 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:12.673380 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-09046ff6-9045-4711-b212-ef50fd24a29f req-cad7a373-efe8-4a4a-b28c-bcd35e9952d0 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 944 time: 0.0794308
Jun 03 08:43:12.720836 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-09046ff6-9045-4711-b212-ef50fd24a29f req-c66fafc3-917f-4671-8c0a-b574a2f5758f tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0415235
Jun 03 08:43:13.908697 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4032658e-1ac0-466b-8707-3a3564d0dd7d req-af0f185e-45dc-4916-88eb-f1b488e37c43 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:13.910570 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-4032658e-1ac0-466b-8707-3a3564d0dd7d req-af0f185e-45dc-4916-88eb-f1b488e37c43 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 944 time: 0.0826020
Jun 03 08:43:13.956583 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-4032658e-1ac0-466b-8707-3a3564d0dd7d req-069400e5-a052-4a9a-88e2-90cd0f0fe181 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0407104
Jun 03 08:43:15.143996 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9872be22-36ad-4e07-ad9a-be9272ac9bcc req-ae257991-16a5-4efd-bd72-3797caaf5fc5 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:15.145456 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9872be22-36ad-4e07-ad9a-be9272ac9bcc req-ae257991-16a5-4efd-bd72-3797caaf5fc5 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 944 time: 0.0804787
Jun 03 08:43:15.190792 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-9872be22-36ad-4e07-ad9a-be9272ac9bcc req-ca5c8921-ae27-4d14-9cc0-c59f6ba89f4e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0396664
Jun 03 08:43:16.371603 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe2147c1-f8a8-43a3-9cee-a795b811a4e5 req-5a08b4cd-8ab4-42f7-85f0-af585579f7e0 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:16.373056 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-fe2147c1-f8a8-43a3-9cee-a795b811a4e5 req-5a08b4cd-8ab4-42f7-85f0-af585579f7e0 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 944 time: 0.0790820
Jun 03 08:43:16.418055 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-fe2147c1-f8a8-43a3-9cee-a795b811a4e5 req-0c95efb5-a37c-4ade-9e46-018a4b0fd8b3 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0385778
Jun 03 08:43:17.601724 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23289d9d-4f2a-4063-a338-26a3466039c1 req-cb5414b0-6b7c-4b27-a767-2cc3626723a0 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:17.604629 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-23289d9d-4f2a-4063-a338-26a3466039c1 req-cb5414b0-6b7c-4b27-a767-2cc3626723a0 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 944 time: 0.0832438
Jun 03 08:43:17.648345 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-23289d9d-4f2a-4063-a338-26a3466039c1 req-af309540-d1d8-4d02-8396-2e0d27d5eb51 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0378900
Jun 03 08:43:17.978439 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 5470fb7d-d803-41b8-b8e5-9d842fa979b3 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92325) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 03 08:43:18.108029 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 5470fb7d-d803-41b8-b8e5-9d842fa979b3, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=5470fb7d-d803-41b8-b8e5-9d842fa979b3,segment=NetworkSegment(fd0545c3-e436-4d2f-9d2d-71983702d34f),segment_id=fd0545c3-e436-4d2f-9d2d-71983702d34f)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:43:18.121207 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Returning: {'device': '5470fb7d-d803-41b8-b8e5-9d842fa979b3', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'port_id': '5470fb7d-d803-41b8-b8e5-9d842fa979b3', 'mac_address': 'fa:16:3e:2f:fd:09', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 506, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92325) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 03 08:43:18.178857 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:18.194810 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5470fb7d-d803-41b8-b8e5-9d842fa979b3 {{(pid=92325) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 03 08:43:18.210253 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 5470fb7d-d803-41b8-b8e5-9d842fa979b3, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=5470fb7d-d803-41b8-b8e5-9d842fa979b3,segment=NetworkSegment(fd0545c3-e436-4d2f-9d2d-71983702d34f),segment_id=fd0545c3-e436-4d2f-9d2d-71983702d34f)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:43:18.317001 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:18.318888 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:43:18.384649 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=5470fb7d-d803-41b8-b8e5-9d842fa979b3,revision_number=4']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:43:18.392918 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:18.393264 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:18.393601 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:18.393938 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:18.394263 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:18.394622 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:18.394947 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:18.395300 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:18.395624 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:18.395945 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:18.396265 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:18.396581 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:43:18.400459 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:43:18.529493 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] get_ports_and_sgs() called for port_ids ['5470fb7d-d803-41b8-b8e5-9d842fa979b3'] {{(pid=92325) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 03 08:43:18.835558 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c4ad5f1-04ac-476a-8e49-192d93512e29 req-a86948f9-cbb5-41e2-afc4-d118561b758a tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:18.837053 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-7c4ad5f1-04ac-476a-8e49-192d93512e29 req-a86948f9-cbb5-41e2-afc4-d118561b758a tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 945 time: 0.0842266
Jun 03 08:43:18.881203 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-7c4ad5f1-04ac-476a-8e49-192d93512e29 req-998062a9-401d-48cd-86fb-0bb3cad506ea tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0385561
Jun 03 08:43:20.011110 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 5470fb7d-d803-41b8-b8e5-9d842fa979b3 up at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 03 08:43:20.068288 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94339a7b-ce93-41c8-9cbc-d7eb6884584a req-6c4961f7-c3ad-4935-ace8-c04697c3f779 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:20.069846 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-94339a7b-ce93-41c8-9cbc-d7eb6884584a req-6c4961f7-c3ad-4935-ace8-c04697c3f779 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 945 time: 0.0836341
Jun 03 08:43:20.118686 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-94339a7b-ce93-41c8-9cbc-d7eb6884584a req-b3f56563-fffb-4ff3-bece-64696d83f5c4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0425341
Jun 03 08:43:20.148711 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning for port 5470fb7d-d803-41b8-b8e5-9d842fa979b3 completed by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 03 08:43:20.153480 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.provisioning_blocks [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Provisioning complete for port 5470fb7d-d803-41b8-b8e5-9d842fa979b3 triggered by entity L2. {{(pid=92325) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 03 08:43:20.153860 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-859493'] for port, provisioning_complete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:20.271112 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:20.297226 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5470fb7d-d803-41b8-b8e5-9d842fa979b3'}] {{(pid=92325) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:43:20.299502 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eae8dde068253564e52727256735f8a304c0a00dafbfed664093fb0ae38609f2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0e1875ff-618a-4b56-9e1b-34d3fc8b1567" -d '{"events": [{"server_uuid": "4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7", "name": "network-vif-plugged", "status": "completed", "tag": "5470fb7d-d803-41b8-b8e5-9d842fa979b3"}]}' {{(pid=92325) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:43:20.307403 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] For port 5470fb7d-d803-41b8-b8e5-9d842fa979b3, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=5470fb7d-d803-41b8-b8e5-9d842fa979b3,segment=NetworkSegment(fd0545c3-e436-4d2f-9d2d-71983702d34f),segment_id=fd0545c3-e436-4d2f-9d2d-71983702d34f)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:43:20.396866 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205'] for port, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:20.399692 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:43:20.434918 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:43:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b7e47be9-43cb-4fb3-b27d-b695b758b292 x-openstack-request-id: req-b7e47be9-43cb-4fb3-b27d-b695b758b292 {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:43:20.435217 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7", "name": "network-vif-plugged", "status": "completed", "tag": "5470fb7d-d803-41b8-b8e5-9d842fa979b3", "code": 200}]} {{(pid=92325) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:43:20.435480 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-b7e47be9-43cb-4fb3-b27d-b695b758b292 {{(pid=92325) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:43:20.435873 dv-cinder-787262-5-iscsi neutron-server[92325]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5470fb7d-d803-41b8-b8e5-9d842fa979b3', 'code': 200}
Jun 03 08:43:20.468618 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Pushing event updated for resources: {'Port': ['ID=5470fb7d-d803-41b8-b8e5-9d842fa979b3,revision_number=5']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:43:20.471553 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:43:20.845379 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1499587-b93b-424b-ba89-9d5d05f51ce0 req-1f9fc7b1-7bcb-4af8-a0a6-0902da6e2cf7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:20.846856 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f1499587-b93b-424b-ba89-9d5d05f51ce0 req-1f9fc7b1-7bcb-4af8-a0a6-0902da6e2cf7 service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 1099 time: 0.0727112
Jun 03 08:43:20.886227 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-f1499587-b93b-424b-ba89-9d5d05f51ce0 req-62d8cfe2-b435-4018-b48c-be29f6544df7 service neutron] 10.222.0.55 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0335386
Jun 03 08:43:21.301920 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddc300ae-aff7-460e-a2b1-5770b6454c2b req-12daa0fa-2cce-4c55-a419-10e44df267db tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:21.303655 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ddc300ae-aff7-460e-a2b1-5770b6454c2b req-12daa0fa-2cce-4c55-a419-10e44df267db tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 946 time: 0.0789888
Jun 03 08:43:21.349015 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ddc300ae-aff7-460e-a2b1-5770b6454c2b req-9879a405-9fb4-4c80-8a10-d16a27a912a3 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0398026
Jun 03 08:43:22.537575 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4cc1238-53f9-4b2f-b076-bedfd068187c req-d835b90d-1a05-4d86-8156-9b7f08ed3186 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:22.539338 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a4cc1238-53f9-4b2f-b076-bedfd068187c req-d835b90d-1a05-4d86-8156-9b7f08ed3186 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 946 time: 0.0792575
Jun 03 08:43:22.586924 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-a4cc1238-53f9-4b2f-b076-bedfd068187c req-b81cf732-ad57-485e-8a3d-8d029a2fa14e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0422180
Jun 03 08:43:22.769708 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9d4e5a-69d9-420e-abfb-c58872a7a723 req-67315878-2130-409d-885e-fa2660ae1a1d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:22.771097 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5b9d4e5a-69d9-420e-abfb-c58872a7a723 req-67315878-2130-409d-885e-fa2660ae1a1d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 946 time: 0.0817485
Jun 03 08:43:22.815813 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-5b9d4e5a-69d9-420e-abfb-c58872a7a723 req-afc5b6f5-cefb-4f83-84ab-9ac4dde54194 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0391288
Jun 03 08:43:22.837935 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 57422) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:43:22.907272 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99499aff-5ad2-44b4-8d4a-678aef3d64f0 tempest-TestVolumeBootPattern-1749998531 tempest-TestVolumeBootPattern-1749998531-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:22.907973 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-99499aff-5ad2-44b4-8d4a-678aef3d64f0 tempest-TestVolumeBootPattern-1749998531 tempest-TestVolumeBootPattern-1749998531-project-admin] Synchronizing usage tracker for tenant:b51f5fefb5f6423fa63fde3f8d7c6b71 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:43:23.005665 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-99499aff-5ad2-44b4-8d4a-678aef3d64f0 tempest-TestVolumeBootPattern-1749998531 tempest-TestVolumeBootPattern-1749998531-project-admin] Unset dirty status for tenant:b51f5fefb5f6423fa63fde3f8d7c6b71 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:43:23.006873 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-99499aff-5ad2-44b4-8d4a-678aef3d64f0 tempest-TestVolumeBootPattern-1749998531 tempest-TestVolumeBootPattern-1749998531-project-admin] 10.222.0.11 "GET /v2.0/ports?device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 1094 time: 0.1679225
Jun 03 08:43:23.009690 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 57424) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:43:23.014110 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.v2.base [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Request body: {'floatingip': {'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'port_id': '5470fb7d-d803-41b8-b8e5-9d842fa979b3', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'fixed_ip_address': '172.20.0.12'}} {{(pid=92323) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 03 08:43:23.020533 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 03 08:43:23.024227 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Usage tracker for resource:floatingip and tenant:db653c0bf0ab42639863b4ea2268a265 is out of sync, need to count used quota {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 03 08:43:23.027027 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Quota usage for floatingip was recalculated. Used quota:2. {{(pid=92323) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 03 08:43:23.033515 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.quota.driver [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attempting to reserve 1 items for resource floatingip. Total usage: 2; quota limit: 50; headroom:48 {{(pid=92323) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 03 08:43:23.122976 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for floatingip, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:23.255477 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:23.488992 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_common [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Allocated IP 172.27.0.194 (684ef871-89aa-450d-ae0d-e232bfaf51fb/e7b58fba-1ed5-483b-b341-7736b2ffb853/c18d6d08-5ea9-4e0f-9c45-ff8e761d1893) {{(pid=92323) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 03 08:43:23.634858 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for port, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:23.720683 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8774223842142', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:23.724536 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-cb29bace-184c-4546-9403-dc882ae26505 tempest-TestShelveInstance-1147051073 tempest-TestShelveInstance-1147051073-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:43:23.798694 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Network 684ef871-89aa-450d-ae0d-e232bfaf51fb is already hosted by enough agents. {{(pid=92323) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 03 08:43:23.801459 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.base_scheduler [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Resources bound (agent type, host, resource id):  {{(pid=92323) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 03 08:43:23.805267 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Received port after_create {{(pid=92323) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 03 08:43:23.835259 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event updated for resources: {'Port': ['ID=c18d6d08-5ea9-4e0f-9c45-ff8e761d1893,revision_number=1']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:43:23.841117 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:43:24.217703 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:24.359309 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-676046'] for port, before_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:24.559355 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for port, precommit_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:24.619676 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8774224329539', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8774223842160', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8774223842205', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14211294'] for port, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:24.623207 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-d27ef856-a351-4a59-9dfb-cd7f39420f86 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:43:24.726311 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event updated for resources: {'Port': ['ID=c18d6d08-5ea9-4e0f-9c45-ff8e761d1893,revision_number=2']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:43:24.730163 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:43:24.738964 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-16327919'] for floatingip, after_update {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:24.904489 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.db.l3_db [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Floating IP 49891f14-d522-42f3-bbf1-bb10699350c1 associated. External IP: 172.27.0.194, port: 5470fb7d-d803-41b8-b8e5-9d842fa979b3.
Jun 03 08:43:25.352084 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:43:25.536813 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:43:25.545805 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60ca8dab-af1b-4a9f-9bb4-1dcd172ef156 None None] Sync routers for ids ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:43:25.555006 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60ca8dab-af1b-4a9f-9bb4-1dcd172ef156 None None] Routers {'8d6b2faf-68a8-4edd-91ad-352b92d8cf84'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:43:25.555622 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-60ca8dab-af1b-4a9f-9bb4-1dcd172ef156 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86d245b0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:43:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:43:25.642968 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for floatingip, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:25.699222 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-396396b9-addb-4332-878c-f55a1335b305 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 2.6885133
Jun 03 08:43:25.699872 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7', 'tag': '5470fb7d-d803-41b8-b8e5-9d842fa979b3'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:43:25.702155 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b34f60e1-4975-4dac-92ac-92e119da7a64" -d '{"events": [{"name": "network-changed", "server_uuid": "4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7", "tag": "5470fb7d-d803-41b8-b8e5-9d842fa979b3"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:43:25.734031 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-60ca8dab-af1b-4a9f-9bb4-1dcd172ef156 None None] Set router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:43:25.744128 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:43:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-31ea1aab-ac7a-4e97-af10-9960f7be84b2 x-openstack-request-id: req-31ea1aab-ac7a-4e97-af10-9960f7be84b2 {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:43:25.744391 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7", "tag": "5470fb7d-d803-41b8-b8e5-9d842fa979b3", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:43:25.744677 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-31ea1aab-ac7a-4e97-af10-9960f7be84b2 {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:43:25.745106 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7', 'tag': '5470fb7d-d803-41b8-b8e5-9d842fa979b3', 'status': 'completed', 'code': 200}
Jun 03 08:43:25.839741 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b34f60e1-4975-4dac-92ac-92e119da7a64 req-d8514232-6dfb-478d-8d48-53002f847236 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:25.841163 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b34f60e1-4975-4dac-92ac-92e119da7a64 req-d8514232-6dfb-478d-8d48-53002f847236 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=db653c0bf0ab42639863b4ea2268a265&device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 1099 time: 0.0735250
Jun 03 08:43:25.972612 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b34f60e1-4975-4dac-92ac-92e119da7a64 req-79d02dba-6e21-42fe-bbbd-d11a4512e4ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:25.974045 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b34f60e1-4975-4dac-92ac-92e119da7a64 req-79d02dba-6e21-42fe-bbbd-d11a4512e4ca service neutron] 10.222.0.55 "GET /v2.0/networks?id=7722e8fc-e6a8-422f-8456-a3c594da293a HTTP/1.1" status: 200  len: 913 time: 0.1264265
Jun 03 08:43:26.077955 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b34f60e1-4975-4dac-92ac-92e119da7a64 req-b3ed1679-216a-4d9d-a6d4-739bea73dc86 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=5470fb7d-d803-41b8-b8e5-9d842fa979b3 HTTP/1.1" status: 200  len: 1000 time: 0.0966403
Jun 03 08:43:26.085216 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-60ca8dab-af1b-4a9f-9bb4-1dcd172ef156 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86d245b0>, [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': '49891f14-d522-42f3-bbf1-bb10699350c1', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'floating_ip_address': '172.27.0.194', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'port_id': '5470fb7d-d803-41b8-b8e5-9d842fa979b3', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'mac_address': 'fa:16:3e:2f:fd:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:43:24Z', 'updated_at': '2021-06-03T08:43:24Z', 'revision_number': 0, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'fixed_ip_address_scope': None}, {'id': 'a8b41950-06a8-4e80-963b-c82247c67bd2', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'floating_ip_address': '172.27.0.20', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'port_id': 'c2ddf4af-d3d3-4366-80d6-2912087aebc4', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'mac_address': 'fa:16:3e:30:32:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09e60cc9-4136-4198-be52-80071a5c92f8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:41:25Z', 'updated_at': '2021-06-03T08:41:27Z', 'revision_number': 1, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1b247c7f-4ca7-44d5-97b2-94031de25c6e', 'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'mac_address': 'fa:16:3e:f4:70:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:51Z', 'updated_at': '2021-06-03T08:37:59Z', 'revision_number': 5, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'subnets': [{'id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:43:26.089075 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60ca8dab-af1b-4a9f-9bb4-1dcd172ef156 None None] Checking router: 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:43:26.097594 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60ca8dab-af1b-4a9f-9bb4-1dcd172ef156 None None] Routers {'8d6b2faf-68a8-4edd-91ad-352b92d8cf84'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:43:26.098123 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-60ca8dab-af1b-4a9f-9bb4-1dcd172ef156 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86d245b0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:43:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:43:26.138793 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b34f60e1-4975-4dac-92ac-92e119da7a64 req-df8c6378-d92b-4c80-83de-133a7d049bbf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:26.140813 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b34f60e1-4975-4dac-92ac-92e119da7a64 req-df8c6378-d92b-4c80-83de-133a7d049bbf service neutron] 10.222.0.55 "GET /v2.0/subnets?id=3eb5b6e1-724c-48ab-a49b-2b1fa5adb401 HTTP/1.1" status: 200  len: 851 time: 0.0572438
Jun 03 08:43:26.216848 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b34f60e1-4975-4dac-92ac-92e119da7a64 req-f471fd1a-6a2b-4fd9-9473-3036804a328f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:43:26.218371 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b34f60e1-4975-4dac-92ac-92e119da7a64 req-f471fd1a-6a2b-4fd9-9473-3036804a328f service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=7722e8fc-e6a8-422f-8456-a3c594da293a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0714719
Jun 03 08:43:26.256483 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:26.283677 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-60ca8dab-af1b-4a9f-9bb4-1dcd172ef156 None None] Set router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:43:26.352149 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b34f60e1-4975-4dac-92ac-92e119da7a64 req-3559704c-bd0e-41e1-b46c-bbc316d26f61 service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1277101
Jun 03 08:43:26.501212 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-b34f60e1-4975-4dac-92ac-92e119da7a64 req-d73f9461-7794-4f2b-864e-1f20979a1745 service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1400878
Jun 03 08:43:26.665170 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-60ca8dab-af1b-4a9f-9bb4-1dcd172ef156 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86d245b0>, [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': '49891f14-d522-42f3-bbf1-bb10699350c1', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'floating_ip_address': '172.27.0.194', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'port_id': '5470fb7d-d803-41b8-b8e5-9d842fa979b3', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'mac_address': 'fa:16:3e:2f:fd:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:43:24Z', 'updated_at': '2021-06-03T08:43:24Z', 'revision_number': 0, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'fixed_ip_address_scope': None}, {'id': 'a8b41950-06a8-4e80-963b-c82247c67bd2', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'floating_ip_address': '172.27.0.20', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'port_id': 'c2ddf4af-d3d3-4366-80d6-2912087aebc4', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'mac_address': 'fa:16:3e:30:32:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09e60cc9-4136-4198-be52-80071a5c92f8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:41:25Z', 'updated_at': '2021-06-03T08:41:27Z', 'revision_number': 1, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1b247c7f-4ca7-44d5-97b2-94031de25c6e', 'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'mac_address': 'fa:16:3e:f4:70:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:51Z', 'updated_at': '2021-06-03T08:37:59Z', 'revision_number': 5, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'subnets': [{'id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:43:26.668941 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60ca8dab-af1b-4a9f-9bb4-1dcd172ef156 None None] The sync data for ids ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'] in dv-cinder-787262-5-iscsi is: [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': '49891f14-d522-42f3-bbf1-bb10699350c1', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'floating_ip_address': '172.27.0.194', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'port_id': '5470fb7d-d803-41b8-b8e5-9d842fa979b3', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'mac_address': 'fa:16:3e:2f:fd:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:43:24Z', 'updated_at': '2021-06-03T08:43:24Z', 'revision_number': 0, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'fixed_ip_address_scope': None}, {'id': 'a8b41950-06a8-4e80-963b-c82247c67bd2', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'floating_ip_address': '172.27.0.20', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'port_id': 'c2ddf4af-d3d3-4366-80d6-2912087aebc4', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'mac_address': 'fa:16:3e:30:32:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09e60cc9-4136-4198-be52-80071a5c92f8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:41:25Z', 'updated_at': '2021-06-03T08:41:27Z', 'revision_number': 1, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1b247c7f-4ca7-44d5-97b2-94031de25c6e', 'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'mac_address': 'fa:16:3e:f4:70:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:51Z', 'updated_at': '2021-06-03T08:37:59Z', 'revision_number': 5, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'subnets': [{'id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:43:26.851628 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f43c1d9f-d5e4-4947-8106-4981e09d4d0c None None] New status for floating IP 49891f14-d522-42f3-bbf1-bb10699350c1: ACTIVE {{(pid=92326) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 03 08:43:32.542951 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-9f2c5ab8-9804-4322-9ac5-15fa870c29f0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:34.848377 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:35.308560 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5a23a038-c9e3-4c35-a750-399c107d691f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:36.254026 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:38.091154 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:43:45.322653 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:43:56.502560 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:02.585222 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-dd9de788-bb2c-438e-9be3-565e74c5d25d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:04.882370 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:05.245560 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-08627451-4b38-4f22-9c52-afbfbd931177 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:06.262679 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:07.249236 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fde8b2dd-32f5-4530-980b-0e6420d3a7e7 req-ed2b56c3-9725-4f67-a4e3-7df6a5ffb246 service neutron] 10.222.0.55 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0728745
Jun 03 08:44:07.385515 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde8b2dd-32f5-4530-980b-0e6420d3a7e7 req-4c9883de-1ba5-46e3-81e6-c0eb9c25d47b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:44:07.386937 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fde8b2dd-32f5-4530-980b-0e6420d3a7e7 req-4c9883de-1ba5-46e3-81e6-c0eb9c25d47b service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=db653c0bf0ab42639863b4ea2268a265&device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 1099 time: 0.0702040
Jun 03 08:44:07.532261 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde8b2dd-32f5-4530-980b-0e6420d3a7e7 req-bc317db1-3aec-4304-9d55-ad74bebada15 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:44:07.533678 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fde8b2dd-32f5-4530-980b-0e6420d3a7e7 req-bc317db1-3aec-4304-9d55-ad74bebada15 service neutron] 10.222.0.55 "GET /v2.0/networks?id=7722e8fc-e6a8-422f-8456-a3c594da293a HTTP/1.1" status: 200  len: 913 time: 0.1269429
Jun 03 08:44:07.733830 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fde8b2dd-32f5-4530-980b-0e6420d3a7e7 req-6cf89e2c-f6b5-4ef7-a142-48f2de2a43bf service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=c2ddf4af-d3d3-4366-80d6-2912087aebc4 HTTP/1.1" status: 200  len: 1001 time: 0.1933789
Jun 03 08:44:07.797090 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde8b2dd-32f5-4530-980b-0e6420d3a7e7 req-999d9cf9-e190-47fd-bb2a-ec3a52ea61b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:44:07.798481 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fde8b2dd-32f5-4530-980b-0e6420d3a7e7 req-999d9cf9-e190-47fd-bb2a-ec3a52ea61b3 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=3eb5b6e1-724c-48ab-a49b-2b1fa5adb401 HTTP/1.1" status: 200  len: 851 time: 0.0586834
Jun 03 08:44:07.881019 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde8b2dd-32f5-4530-980b-0e6420d3a7e7 req-34e0b950-dc17-4d5c-b88c-4c8caffd1da1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:44:07.882471 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fde8b2dd-32f5-4530-980b-0e6420d3a7e7 req-34e0b950-dc17-4d5c-b88c-4c8caffd1da1 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=7722e8fc-e6a8-422f-8456-a3c594da293a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0773096
Jun 03 08:44:08.013471 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fde8b2dd-32f5-4530-980b-0e6420d3a7e7 req-2ce9cc86-0b24-4342-a86b-ede9df2fa9b4 service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1228347
Jun 03 08:44:08.088222 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:08.151454 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-fde8b2dd-32f5-4530-980b-0e6420d3a7e7 req-e9d4dcb0-cbfc-4d43-82b5-c2de1d7344ef service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1307561
Jun 03 08:44:22.321518 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:44:26.211124 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:32.527954 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-ebab8a06-249d-4598-bb6b-4502d187d511 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:34.853958 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:35.236390 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-b86030ac-6dfc-4374-b620-e734abf818f1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:36.265341 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:38.090457 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:53.205587 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 57460) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:44:53.561280 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Deleting port c18d6d08-5ea9-4e0f-9c45-ff8e761d1893 {{(pid=92324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:44:53.561622 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:53.678074 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:53.678399 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:53.802564 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Calling delete_port for c18d6d08-5ea9-4e0f-9c45-ff8e761d1893 owned by network:floatingip {{(pid=92324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:44:53.996459 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:54.000019 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-81fd06d7-391e-494f-967b-14377d8ff791 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:44:54.043718 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event deleted for resources: {'Port': ['ID=c18d6d08-5ea9-4e0f-9c45-ff8e761d1893,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:44:54.085490 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:54.085876 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:54.086251 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:54.086648 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:54.087029 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:54.087381 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:54.087740 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:54.088098 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:54.088457 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:54.088813 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:54.089165 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:54.089516 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92324) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:54.119397 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:44:54.149124 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for floatingip, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:54.149455 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.l3_db [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Floating IP 49891f14-d522-42f3-bbf1-bb10699350c1 disassociated (deleted). External IP: 172.27.0.194, port: 5470fb7d-d803-41b8-b8e5-9d842fa979b3.
Jun 03 08:44:54.497962 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:44:54.677641 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:44:54.686970 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47f191bc-13e2-4ca1-bc98-c9f8b717ec1f None None] Sync routers for ids ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:44:54.694452 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for floatingip, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:54.697260 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47f191bc-13e2-4ca1-bc98-c9f8b717ec1f None None] Routers {'8d6b2faf-68a8-4edd-91ad-352b92d8cf84'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:44:54.697875 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-47f191bc-13e2-4ca1-bc98-c9f8b717ec1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae87ae2be0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:44:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:44:54.749208 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-edc0c3fe-5969-49d3-bae1-52f4ea9de16d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "DELETE /v2.0/floatingips/49891f14-d522-42f3-bbf1-bb10699350c1 HTTP/1.1" status: 204  len: 168 time: 1.5424769
Jun 03 08:44:54.749810 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7', 'tag': '5470fb7d-d803-41b8-b8e5-9d842fa979b3'}] {{(pid=92324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:44:54.752202 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}25ad023063ed160b339e2d2d51ef3e5c51250aece1f4db0a35843dff1b64291a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-20115ee2-ba98-4dd8-8aa9-d1ceb84a7352" -d '{"events": [{"name": "network-changed", "server_uuid": "4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7", "tag": "5470fb7d-d803-41b8-b8e5-9d842fa979b3"}]}' {{(pid=92324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:44:54.879809 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-47f191bc-13e2-4ca1-bc98-c9f8b717ec1f None None] Set router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:44:54.943065 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:44:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-74c5f614-b8c4-40f0-a63a-4650b214228d x-openstack-request-id: req-74c5f614-b8c4-40f0-a63a-4650b214228d {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:44:54.943400 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7", "tag": "5470fb7d-d803-41b8-b8e5-9d842fa979b3", "status": "completed", "code": 200}]} {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:44:54.943701 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-74c5f614-b8c4-40f0-a63a-4650b214228d {{(pid=92324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:44:54.944141 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7', 'tag': '5470fb7d-d803-41b8-b8e5-9d842fa979b3', 'status': 'completed', 'code': 200}
Jun 03 08:44:55.041598 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20115ee2-ba98-4dd8-8aa9-d1ceb84a7352 req-7dc84cbf-546b-446e-8640-5b55dfbf042f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:44:55.043155 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-20115ee2-ba98-4dd8-8aa9-d1ceb84a7352 req-7dc84cbf-546b-446e-8640-5b55dfbf042f service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=db653c0bf0ab42639863b4ea2268a265&device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 1099 time: 0.0787432
Jun 03 08:44:55.185063 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20115ee2-ba98-4dd8-8aa9-d1ceb84a7352 req-54a57d47-b7d3-4bca-aa9e-311c83ecae89 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:44:55.186661 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-20115ee2-ba98-4dd8-8aa9-d1ceb84a7352 req-54a57d47-b7d3-4bca-aa9e-311c83ecae89 service neutron] 10.222.0.55 "GET /v2.0/networks?id=7722e8fc-e6a8-422f-8456-a3c594da293a HTTP/1.1" status: 200  len: 913 time: 0.1365888
Jun 03 08:44:55.242331 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-47f191bc-13e2-4ca1-bc98-c9f8b717ec1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae87ae2be0>, [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': 'a8b41950-06a8-4e80-963b-c82247c67bd2', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'floating_ip_address': '172.27.0.20', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'port_id': 'c2ddf4af-d3d3-4366-80d6-2912087aebc4', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'mac_address': 'fa:16:3e:30:32:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09e60cc9-4136-4198-be52-80071a5c92f8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:41:25Z', 'updated_at': '2021-06-03T08:41:27Z', 'revision_number': 1, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1b247c7f-4ca7-44d5-97b2-94031de25c6e', 'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'mac_address': 'fa:16:3e:f4:70:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:51Z', 'updated_at': '2021-06-03T08:37:59Z', 'revision_number': 5, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'subnets': [{'id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:44:55.246207 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47f191bc-13e2-4ca1-bc98-c9f8b717ec1f None None] Checking router: 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:44:55.255202 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47f191bc-13e2-4ca1-bc98-c9f8b717ec1f None None] Routers {'8d6b2faf-68a8-4edd-91ad-352b92d8cf84'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:44:55.255373 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-20115ee2-ba98-4dd8-8aa9-d1ceb84a7352 req-6604ccf2-56f3-49a4-89b2-939556fb5912 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=5470fb7d-d803-41b8-b8e5-9d842fa979b3 HTTP/1.1" status: 200  len: 217 time: 0.0613506
Jun 03 08:44:55.255810 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-47f191bc-13e2-4ca1-bc98-c9f8b717ec1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae87ae2be0>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:44:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:44:55.322410 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20115ee2-ba98-4dd8-8aa9-d1ceb84a7352 req-79e6ef18-2956-44be-a055-0722a8accf95 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:44:55.323904 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-20115ee2-ba98-4dd8-8aa9-d1ceb84a7352 req-79e6ef18-2956-44be-a055-0722a8accf95 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=3eb5b6e1-724c-48ab-a49b-2b1fa5adb401 HTTP/1.1" status: 200  len: 851 time: 0.0631287
Jun 03 08:44:55.400092 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20115ee2-ba98-4dd8-8aa9-d1ceb84a7352 req-2e8ffb51-7ab9-4d0a-ad3c-25ce98446073 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:44:55.401587 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-20115ee2-ba98-4dd8-8aa9-d1ceb84a7352 req-2e8ffb51-7ab9-4d0a-ad3c-25ce98446073 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=7722e8fc-e6a8-422f-8456-a3c594da293a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0710425
Jun 03 08:44:55.440368 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-47f191bc-13e2-4ca1-bc98-c9f8b717ec1f None None] Set router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:44:55.473032 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aaefae2-acdd-4259-bccb-5691cfb24e3b req-f77fd65a-1cde-4843-8437-7a8d5c9c2dca tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:44:55.473740 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-0aaefae2-acdd-4259-bccb-5691cfb24e3b req-f77fd65a-1cde-4843-8437-7a8d5c9c2dca tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Synchronizing usage tracker for tenant:db653c0bf0ab42639863b4ea2268a265 on resource:port {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:44:55.537744 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-20115ee2-ba98-4dd8-8aa9-d1ceb84a7352 req-ca696565-defc-465d-ad9c-e20bea103add service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1282387
Jun 03 08:44:55.573736 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-0aaefae2-acdd-4259-bccb-5691cfb24e3b req-f77fd65a-1cde-4843-8437-7a8d5c9c2dca tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Unset dirty status for tenant:db653c0bf0ab42639863b4ea2268a265 on resource:port {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:44:55.574894 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0aaefae2-acdd-4259-bccb-5691cfb24e3b req-f77fd65a-1cde-4843-8437-7a8d5c9c2dca tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 946 time: 0.1830025
Jun 03 08:44:55.627157 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-0aaefae2-acdd-4259-bccb-5691cfb24e3b req-a735d46a-f462-4dff-9cbc-837f321d98c5 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0462375
Jun 03 08:44:55.674604 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-20115ee2-ba98-4dd8-8aa9-d1ceb84a7352 req-ef29a2f8-2de2-44d8-9401-f9686bb478f8 service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1301458
Jun 03 08:44:55.848468 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-47f191bc-13e2-4ca1-bc98-c9f8b717ec1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae87ae2be0>, [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': 'a8b41950-06a8-4e80-963b-c82247c67bd2', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'floating_ip_address': '172.27.0.20', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'port_id': 'c2ddf4af-d3d3-4366-80d6-2912087aebc4', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'mac_address': 'fa:16:3e:30:32:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09e60cc9-4136-4198-be52-80071a5c92f8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:41:25Z', 'updated_at': '2021-06-03T08:41:27Z', 'revision_number': 1, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1b247c7f-4ca7-44d5-97b2-94031de25c6e', 'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'mac_address': 'fa:16:3e:f4:70:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:51Z', 'updated_at': '2021-06-03T08:37:59Z', 'revision_number': 5, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'subnets': [{'id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:44:55.852562 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47f191bc-13e2-4ca1-bc98-c9f8b717ec1f None None] The sync data for ids ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'] in dv-cinder-787262-5-iscsi is: [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_floatingips': [{'id': 'a8b41950-06a8-4e80-963b-c82247c67bd2', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'floating_ip_address': '172.27.0.20', 'floating_network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'router_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'port_id': 'c2ddf4af-d3d3-4366-80d6-2912087aebc4', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'mac_address': 'fa:16:3e:30:32:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '09e60cc9-4136-4198-be52-80071a5c92f8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-03T08:41:25Z', 'updated_at': '2021-06-03T08:41:27Z', 'revision_number': 1, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1b247c7f-4ca7-44d5-97b2-94031de25c6e', 'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'mac_address': 'fa:16:3e:f4:70:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:51Z', 'updated_at': '2021-06-03T08:37:59Z', 'revision_number': 5, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'subnets': [{'id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:44:56.169303 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d12f409-1050-44e3-9885-a63f44a11c6a None None] New status for floating IP 49891f14-d522-42f3-bbf1-bb10699350c1: DOWN {{(pid=92326) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 03 08:44:56.199498 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:56.898451 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-178dbd5f-31ff-4b06-a53b-e5fdba09e23b req-f6944c6d-5112-4b63-84b8-fcf26fa96b4e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:44:56.899929 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-178dbd5f-31ff-4b06-a53b-e5fdba09e23b req-f6944c6d-5112-4b63-84b8-fcf26fa96b4e tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 946 time: 0.1420343
Jun 03 08:44:56.907965 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35b3b2e8-6268-4316-8a65-f00bac96e0c5 req-56ede2fc-d292-4c3a-96ca-25fbc8864a54 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:44:56.909266 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-35b3b2e8-6268-4316-8a65-f00bac96e0c5 req-56ede2fc-d292-4c3a-96ca-25fbc8864a54 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.55 "GET /v2.0/ports?device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 946 time: 0.1157410
Jun 03 08:44:57.030056 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-178dbd5f-31ff-4b06-a53b-e5fdba09e23b req-3defdcbc-6de3-4caf-86d9-9917f2e3ea47 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1192560
Jun 03 08:44:57.099603 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-35b3b2e8-6268-4316-8a65-f00bac96e0c5 req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Deleting port 5470fb7d-d803-41b8-b8e5-9d842fa979b3 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:44:57.099940 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-35b3b2e8-6268-4316-8a65-f00bac96e0c5 req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:57.322590 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-35b3b2e8-6268-4316-8a65-f00bac96e0c5 req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] For port 5470fb7d-d803-41b8-b8e5-9d842fa979b3, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=5470fb7d-d803-41b8-b8e5-9d842fa979b3,segment=NetworkSegment(fd0545c3-e436-4d2f-9d2d-71983702d34f),segment_id=fd0545c3-e436-4d2f-9d2d-71983702d34f)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:44:57.322944 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-35b3b2e8-6268-4316-8a65-f00bac96e0c5 req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:57.442609 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-35b3b2e8-6268-4316-8a65-f00bac96e0c5 req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Calling delete_port for 5470fb7d-d803-41b8-b8e5-9d842fa979b3 owned by compute:nova {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:44:57.619597 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-35b3b2e8-6268-4316-8a65-f00bac96e0c5 req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:57.625155 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c0f10e1c-4eab-4658-adf6-234f7d54e671 tempest-TestMinimumBasicScenario-1904771854 tempest-TestMinimumBasicScenario-1904771854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:44:57.669821 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event deleted for resources: {'Port': ['ID=5470fb7d-d803-41b8-b8e5-9d842fa979b3,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:44:57.718707 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:57.718707 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:57.718707 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:57.718707 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:57.718707 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:57.718707 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:57.718707 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:57.718707 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:57.718707 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:57.718707 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:57.718707 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:57.718707 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92323) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:44:57.724980 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:44:57.761268 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-35b3b2e8-6268-4316-8a65-f00bac96e0c5 req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] No DVR routers for this DVR port 5470fb7d-d803-41b8-b8e5-9d842fa979b3 on host hv-cinder-78726 {{(pid=92323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:44:57.763748 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-35b3b2e8-6268-4316-8a65-f00bac96e0c5 req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:44:57.766235 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7', 'name': 'network-vif-deleted', 'tag': '5470fb7d-d803-41b8-b8e5-9d842fa979b3'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:44:57.768535 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4acf151b-d30f-471d-a300-5e5242e43f3a" -d '{"events": [{"server_uuid": "4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7", "name": "network-vif-deleted", "tag": "5470fb7d-d803-41b8-b8e5-9d842fa979b3"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:44:57.823600 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:44:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-76cad7b1-76ee-484e-8d70-8acf046d941b x-openstack-request-id: req-76cad7b1-76ee-484e-8d70-8acf046d941b {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:44:57.824157 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7", "name": "network-vif-deleted", "tag": "5470fb7d-d803-41b8-b8e5-9d842fa979b3", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:44:57.824528 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-76cad7b1-76ee-484e-8d70-8acf046d941b {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:44:57.824969 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7', 'name': 'network-vif-deleted', 'tag': '5470fb7d-d803-41b8-b8e5-9d842fa979b3', 'status': 'completed', 'code': 200}
Jun 03 08:44:57.914839 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-35b3b2e8-6268-4316-8a65-f00bac96e0c5 req-00a900d7-ff84-4054-b07c-d82b276b3b20 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.55 "DELETE /v2.0/ports/5470fb7d-d803-41b8-b8e5-9d842fa979b3 HTTP/1.1" status: 204  len: 173 time: 0.9904521
Jun 03 08:44:58.184980 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-ea6b67b4-38c2-4ced-8285-9820555d911a req-35872135-47b5-4dba-9283-f9fa7611702c tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Synchronizing usage tracker for tenant:db653c0bf0ab42639863b4ea2268a265 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:44:58.307618 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-ea6b67b4-38c2-4ced-8285-9820555d911a req-35872135-47b5-4dba-9283-f9fa7611702c tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Unset dirty status for tenant:db653c0bf0ab42639863b4ea2268a265 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:44:58.308812 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-ea6b67b4-38c2-4ced-8285-9820555d911a req-35872135-47b5-4dba-9283-f9fa7611702c tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=4b39aea6-e9d9-478d-bac2-1b2bfba7d1f7 HTTP/1.1" status: 200  len: 210 time: 0.1673436
Jun 03 08:44:59.320882 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:45:00.539665 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 5470fb7d-d803-41b8-b8e5-9d842fa979b3 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:45:00.577373 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] No Port match for: 5470fb7d-d803-41b8-b8e5-9d842fa979b3 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:45:00.577725 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device 5470fb7d-d803-41b8-b8e5-9d842fa979b3 not bound to the agent host hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:45:02.063698 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 57508) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:45:02.427117 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-9d1b50b1-6620-4d60-a044-ca9722d026f7 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Deleting port ddafe743-390c-4b76-aa43-bc8187a71cbb {{(pid=92324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:45:02.427359 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9d1b50b1-6620-4d60-a044-ca9722d026f7 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:02.545232 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9d1b50b1-6620-4d60-a044-ca9722d026f7 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:02.545556 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9d1b50b1-6620-4d60-a044-ca9722d026f7 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:02.553637 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-f522f69a-6900-4d69-a893-316f07f7169b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:02.667493 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-9d1b50b1-6620-4d60-a044-ca9722d026f7 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Calling delete_port for ddafe743-390c-4b76-aa43-bc8187a71cbb owned by network:floatingip {{(pid=92324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:45:02.893654 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9d1b50b1-6620-4d60-a044-ca9722d026f7 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:02.897997 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9d8aec13-f453-4412-8608-e7f44b23c616 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:45:02.945755 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d1b50b1-6620-4d60-a044-ca9722d026f7 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event deleted for resources: {'Port': ['ID=ddafe743-390c-4b76-aa43-bc8187a71cbb,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:45:02.948305 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-9d1b50b1-6620-4d60-a044-ca9722d026f7 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:45:03.038415 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9d1b50b1-6620-4d60-a044-ca9722d026f7 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for floatingip, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:03.038876 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.db.l3_db [None req-9d1b50b1-6620-4d60-a044-ca9722d026f7 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Floating IP a8b41950-06a8-4e80-963b-c82247c67bd2 disassociated (deleted). External IP: 172.27.0.20, port: c2ddf4af-d3d3-4366-80d6-2912087aebc4.
Jun 03 08:45:03.390154 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9d1b50b1-6620-4d60-a044-ca9722d026f7 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92324) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:45:03.574076 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9d1b50b1-6620-4d60-a044-ca9722d026f7 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92324) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:45:03.583843 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e440e27-6afa-4385-ad6a-309df1a5e475 None None] Sync routers for ids ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:45:03.593412 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e440e27-6afa-4385-ad6a-309df1a5e475 None None] Routers {'8d6b2faf-68a8-4edd-91ad-352b92d8cf84'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:45:03.595530 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-4e440e27-6afa-4385-ad6a-309df1a5e475 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86da6f40>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:44:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:45:03.665755 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-9d1b50b1-6620-4d60-a044-ca9722d026f7 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for floatingip, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:03.723953 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-9d1b50b1-6620-4d60-a044-ca9722d026f7 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "DELETE /v2.0/floatingips/a8b41950-06a8-4e80-963b-c82247c67bd2 HTTP/1.1" status: 204  len: 168 time: 1.6583412
Jun 03 08:45:03.724512 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '09e60cc9-4136-4198-be52-80071a5c92f8', 'tag': 'c2ddf4af-d3d3-4366-80d6-2912087aebc4'}] {{(pid=92324) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:45:03.728338 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}25ad023063ed160b339e2d2d51ef3e5c51250aece1f4db0a35843dff1b64291a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-79e1678f-1bf0-4c2f-aa93-514fa9447f5d" -d '{"events": [{"name": "network-changed", "server_uuid": "09e60cc9-4136-4198-be52-80071a5c92f8", "tag": "c2ddf4af-d3d3-4366-80d6-2912087aebc4"}]}' {{(pid=92324) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:45:03.781555 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-4e440e27-6afa-4385-ad6a-309df1a5e475 None None] Set router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:45:03.789579 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 03 Jun 2021 08:45:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f25a613c-1282-4922-83c0-da4c71dd5efb x-openstack-request-id: req-f25a613c-1282-4922-83c0-da4c71dd5efb {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:45:03.789972 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "09e60cc9-4136-4198-be52-80071a5c92f8", "tag": "c2ddf4af-d3d3-4366-80d6-2912087aebc4", "status": "completed", "code": 200}]} {{(pid=92324) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:45:03.790403 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-f25a613c-1282-4922-83c0-da4c71dd5efb {{(pid=92324) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:45:03.790944 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '09e60cc9-4136-4198-be52-80071a5c92f8', 'tag': 'c2ddf4af-d3d3-4366-80d6-2912087aebc4', 'status': 'completed', 'code': 200}
Jun 03 08:45:03.898706 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79e1678f-1bf0-4c2f-aa93-514fa9447f5d req-cb2c6e38-0141-4132-9102-ed16e8503638 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:45:03.900491 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-79e1678f-1bf0-4c2f-aa93-514fa9447f5d req-cb2c6e38-0141-4132-9102-ed16e8503638 service neutron] 10.222.0.55 "GET /v2.0/ports?tenant_id=db653c0bf0ab42639863b4ea2268a265&device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 1099 time: 0.0896032
Jun 03 08:45:04.035252 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79e1678f-1bf0-4c2f-aa93-514fa9447f5d req-a83f5c65-9872-46ce-9c8b-b1e700edfa7f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:45:04.037304 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-79e1678f-1bf0-4c2f-aa93-514fa9447f5d req-a83f5c65-9872-46ce-9c8b-b1e700edfa7f service neutron] 10.222.0.55 "GET /v2.0/networks?id=7722e8fc-e6a8-422f-8456-a3c594da293a HTTP/1.1" status: 200  len: 913 time: 0.1302328
Jun 03 08:45:04.104837 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-79e1678f-1bf0-4c2f-aa93-514fa9447f5d req-4e128687-c47c-42e0-8aa6-95440be8e007 service neutron] 10.222.0.55 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=c2ddf4af-d3d3-4366-80d6-2912087aebc4 HTTP/1.1" status: 200  len: 217 time: 0.0611231
Jun 03 08:45:04.116048 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-4e440e27-6afa-4385-ad6a-309df1a5e475 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86da6f40>, [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '1b247c7f-4ca7-44d5-97b2-94031de25c6e', 'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'mac_address': 'fa:16:3e:f4:70:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:51Z', 'updated_at': '2021-06-03T08:37:59Z', 'revision_number': 5, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'subnets': [{'id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:45:04.120114 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e440e27-6afa-4385-ad6a-309df1a5e475 None None] Checking router: 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:45:04.128566 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e440e27-6afa-4385-ad6a-309df1a5e475 None None] Routers {'8d6b2faf-68a8-4edd-91ad-352b92d8cf84'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:45:04.129171 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-4e440e27-6afa-4385-ad6a-309df1a5e475 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86da6f40>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:44:35Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:45:04.176350 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79e1678f-1bf0-4c2f-aa93-514fa9447f5d req-a3c557bd-16dc-452a-a433-2367dc555070 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:45:04.182055 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-79e1678f-1bf0-4c2f-aa93-514fa9447f5d req-a3c557bd-16dc-452a-a433-2367dc555070 service neutron] 10.222.0.55 "GET /v2.0/subnets?id=3eb5b6e1-724c-48ab-a49b-2b1fa5adb401 HTTP/1.1" status: 200  len: 851 time: 0.0660117
Jun 03 08:45:04.259809 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79e1678f-1bf0-4c2f-aa93-514fa9447f5d req-5ad4ad69-77b2-480e-93f8-8170ca43d569 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:45:04.261440 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-79e1678f-1bf0-4c2f-aa93-514fa9447f5d req-5ad4ad69-77b2-480e-93f8-8170ca43d569 service neutron] 10.222.0.55 "GET /v2.0/ports?network_id=7722e8fc-e6a8-422f-8456-a3c594da293a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0726850
Jun 03 08:45:04.316118 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1292fe4-4942-4549-b546-863e63cf5931 req-bf2cdf12-ca05-4092-ba3d-f01a854869ae tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92324) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:45:04.316917 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-e1292fe4-4942-4549-b546-863e63cf5931 req-bf2cdf12-ca05-4092-ba3d-f01a854869ae tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Synchronizing usage tracker for tenant:db653c0bf0ab42639863b4ea2268a265 on resource:port {{(pid=92324) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:45:04.323028 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-4e440e27-6afa-4385-ad6a-309df1a5e475 None None] Set router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:45:04.396600 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.quota.resource [req-e1292fe4-4942-4549-b546-863e63cf5931 req-bf2cdf12-ca05-4092-ba3d-f01a854869ae tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Unset dirty status for tenant:db653c0bf0ab42639863b4ea2268a265 on resource:port {{(pid=92324) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:45:04.398012 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e1292fe4-4942-4549-b546-863e63cf5931 req-bf2cdf12-ca05-4092-ba3d-f01a854869ae tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 946 time: 0.1640358
Jun 03 08:45:04.401351 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-79e1678f-1bf0-4c2f-aa93-514fa9447f5d req-f308325b-d90b-4971-b742-7b45d2f71b10 service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1328683
Jun 03 08:45:04.445382 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [req-e1292fe4-4942-4549-b546-863e63cf5931 req-0d559a09-1d31-49c6-9360-ec8e5f858ab9 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0414257
Jun 03 08:45:04.540054 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-79e1678f-1bf0-4c2f-aa93-514fa9447f5d req-d3579920-a060-4eea-b30a-f22322c8cdb8 service neutron] 10.222.0.55 "GET /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1308098
Jun 03 08:45:04.640922 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-4e440e27-6afa-4385-ad6a-309df1a5e475 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86da6f40>, [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '1b247c7f-4ca7-44d5-97b2-94031de25c6e', 'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'mac_address': 'fa:16:3e:f4:70:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:51Z', 'updated_at': '2021-06-03T08:37:59Z', 'revision_number': 5, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'subnets': [{'id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:45:04.644725 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e440e27-6afa-4385-ad6a-309df1a5e475 None None] The sync data for ids ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'] in dv-cinder-787262-5-iscsi is: [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:37:52Z', 'revision_number': 4, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi', '_interfaces': [{'id': '1b247c7f-4ca7-44d5-97b2-94031de25c6e', 'name': '', 'network_id': '7722e8fc-e6a8-422f-8456-a3c594da293a', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'mac_address': 'fa:16:3e:f4:70:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_interface', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:51Z', 'updated_at': '2021-06-03T08:37:59Z', 'revision_number': 5, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'subnets': [{'id': '3eb5b6e1-724c-48ab-a49b-2b1fa5adb401', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:45:04.842578 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:04.848287 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-397de94d-62d3-4d87-a159-dd37b0d6ac52 None None] New status for floating IP a8b41950-06a8-4e80-963b-c82247c67bd2: DOWN {{(pid=92326) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 03 08:45:05.250262 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-57d66872-b4c3-4dfa-9dac-6f74bfcb6766 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:05.637596 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ee4c2b0-c7b5-4de3-ad7c-7f93e34a7b62 req-34c86d40-55d7-42f0-bcd0-7725caba080b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:45:05.639067 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3ee4c2b0-c7b5-4de3-ad7c-7f93e34a7b62 req-34c86d40-55d7-42f0-bcd0-7725caba080b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 946 time: 0.0828755
Jun 03 08:45:05.721039 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-3ee4c2b0-c7b5-4de3-ad7c-7f93e34a7b62 req-c2edb3d7-228d-470c-9cad-fbc3b0a8f3a2 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/security-groups?id=fe784a5d-57d4-414f-8feb-b263c44efaf6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0764229
Jun 03 08:45:05.756611 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e95a8496-2745-4acc-8391-4bb9621a58d9 req-1ba5f995-d20a-4a35-9f59-4063838cddc5 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92323) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 03 08:45:05.758049 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e95a8496-2745-4acc-8391-4bb9621a58d9 req-1ba5f995-d20a-4a35-9f59-4063838cddc5 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.55 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 946 time: 0.0862947
Jun 03 08:45:05.901234 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-e95a8496-2745-4acc-8391-4bb9621a58d9 req-c89e80db-0675-41a4-bde3-c2765e2d041b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Deleting port c2ddf4af-d3d3-4366-80d6-2912087aebc4 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:45:05.901478 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e95a8496-2745-4acc-8391-4bb9621a58d9 req-c89e80db-0675-41a4-bde3-c2765e2d041b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:06.123360 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [req-e95a8496-2745-4acc-8391-4bb9621a58d9 req-c89e80db-0675-41a4-bde3-c2765e2d041b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] For port c2ddf4af-d3d3-4366-80d6-2912087aebc4, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=c2ddf4af-d3d3-4366-80d6-2912087aebc4,segment=NetworkSegment(fd0545c3-e436-4d2f-9d2d-71983702d34f),segment_id=fd0545c3-e436-4d2f-9d2d-71983702d34f)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:45:06.123713 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e95a8496-2745-4acc-8391-4bb9621a58d9 req-c89e80db-0675-41a4-bde3-c2765e2d041b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:06.248325 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [req-e95a8496-2745-4acc-8391-4bb9621a58d9 req-c89e80db-0675-41a4-bde3-c2765e2d041b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Calling delete_port for c2ddf4af-d3d3-4366-80d6-2912087aebc4 owned by compute:nova {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:45:06.284928 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:06.430651 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e95a8496-2745-4acc-8391-4bb9621a58d9 req-c89e80db-0675-41a4-bde3-c2765e2d041b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:06.436371 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-61f44226-b55c-4f05-adce-9213e0298dd4 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:45:06.481576 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c89e80db-0675-41a4-bde3-c2765e2d041b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event deleted for resources: {'Port': ['ID=c2ddf4af-d3d3-4366-80d6-2912087aebc4,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:45:06.484662 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c89e80db-0675-41a4-bde3-c2765e2d041b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:45:06.558791 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [req-e95a8496-2745-4acc-8391-4bb9621a58d9 req-c89e80db-0675-41a4-bde3-c2765e2d041b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] No DVR routers for this DVR port c2ddf4af-d3d3-4366-80d6-2912087aebc4 on host hv-cinder-78726 {{(pid=92323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:45:06.561200 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [req-e95a8496-2745-4acc-8391-4bb9621a58d9 req-c89e80db-0675-41a4-bde3-c2765e2d041b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for port, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:06.563730 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '09e60cc9-4136-4198-be52-80071a5c92f8', 'name': 'network-vif-deleted', 'tag': 'c2ddf4af-d3d3-4366-80d6-2912087aebc4'}] {{(pid=92323) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 03 08:45:06.565961 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.11/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4921428f79512b02dd643851ec6043a8b87c746a0546a3fa41ede59d22b489b3" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7b1f8979-0712-4d3b-89d4-afbcbc106f5c" -d '{"events": [{"server_uuid": "09e60cc9-4136-4198-be52-80071a5c92f8", "name": "network-vif-deleted", "tag": "c2ddf4af-d3d3-4366-80d6-2912087aebc4"}]}' {{(pid=92323) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 03 08:45:06.607242 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 03 Jun 2021 08:45:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e80e99a4-cb2f-483d-a647-a8dab6578973 x-openstack-request-id: req-e80e99a4-cb2f-483d-a647-a8dab6578973 {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 03 08:45:06.607570 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "09e60cc9-4136-4198-be52-80071a5c92f8", "name": "network-vif-deleted", "tag": "c2ddf4af-d3d3-4366-80d6-2912087aebc4", "status": "completed", "code": 200}]} {{(pid=92323) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 03 08:45:06.607859 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.11/compute/v2.1/os-server-external-events used request id req-e80e99a4-cb2f-483d-a647-a8dab6578973 {{(pid=92323) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 03 08:45:06.608282 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '09e60cc9-4136-4198-be52-80071a5c92f8', 'name': 'network-vif-deleted', 'tag': 'c2ddf4af-d3d3-4366-80d6-2912087aebc4', 'status': 'completed', 'code': 200}
Jun 03 08:45:06.654229 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-e95a8496-2745-4acc-8391-4bb9621a58d9 req-c89e80db-0675-41a4-bde3-c2765e2d041b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.55 "DELETE /v2.0/ports/c2ddf4af-d3d3-4366-80d6-2912087aebc4 HTTP/1.1" status: 204  len: 173 time: 0.8850806
Jun 03 08:45:06.874021 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-06e503e1-688a-42c2-8e13-515fdebe5b7b req-7b30309d-3d28-494f-accd-173e1e455505 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Synchronizing usage tracker for tenant:db653c0bf0ab42639863b4ea2268a265 on resource:port {{(pid=92323) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 03 08:45:06.956629 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.quota.resource [req-06e503e1-688a-42c2-8e13-515fdebe5b7b req-7b30309d-3d28-494f-accd-173e1e455505 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Unset dirty status for tenant:db653c0bf0ab42639863b4ea2268a265 on resource:port {{(pid=92323) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 03 08:45:06.957883 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [req-06e503e1-688a-42c2-8e13-515fdebe5b7b req-7b30309d-3d28-494f-accd-173e1e455505 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "GET /v2.0/ports?device_id=09e60cc9-4136-4198-be52-80071a5c92f8 HTTP/1.1" status: 200  len: 210 time: 0.1267259
Jun 03 08:45:08.051325 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 57524) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:45:08.088349 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:08.359749 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-da831c28-fa8f-47cc-aeac-a2a13d9f1d46 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Deleting port 52a19d3c-91d9-424b-8343-8fdc0cf11c2c {{(pid=92324) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:45:08.360095 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-da831c28-fa8f-47cc-aeac-a2a13d9f1d46 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:08.486626 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-da831c28-fa8f-47cc-aeac-a2a13d9f1d46 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:08.486958 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-da831c28-fa8f-47cc-aeac-a2a13d9f1d46 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:08.661215 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.plugins.ml2.plugin [None req-da831c28-fa8f-47cc-aeac-a2a13d9f1d46 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Calling delete_port for 52a19d3c-91d9-424b-8343-8fdc0cf11c2c owned by network:floatingip {{(pid=92324) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:45:08.905435 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-da831c28-fa8f-47cc-aeac-a2a13d9f1d46 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15641344'] for port, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:08.909385 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-ad48bf35-84d6-41ff-bfd4-956b9e679c31 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:45:08.959962 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da831c28-fa8f-47cc-aeac-a2a13d9f1d46 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event deleted for resources: {'Port': ['ID=52a19d3c-91d9-424b-8343-8fdc0cf11c2c,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:45:08.963291 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-da831c28-fa8f-47cc-aeac-a2a13d9f1d46 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:45:09.055454 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-da831c28-fa8f-47cc-aeac-a2a13d9f1d46 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for floatingip, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:09.166903 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-da831c28-fa8f-47cc-aeac-a2a13d9f1d46 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-496544'] for floatingip, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:09.168538 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-da831c28-fa8f-47cc-aeac-a2a13d9f1d46 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "DELETE /v2.0/floatingips/8d72a0ec-fc93-4d28-ab68-b67c6c4fa370 HTTP/1.1" status: 204  len: 168 time: 1.1158795
Jun 03 08:45:10.570713 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device c2ddf4af-d3d3-4366-80d6-2912087aebc4 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:45:10.604110 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] No Port match for: c2ddf4af-d3d3-4366-80d6-2912087aebc4 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:45:10.604454 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Device c2ddf4af-d3d3-4366-80d6-2912087aebc4 not bound to the agent host hv-cinder-78726 {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:45:10.695787 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [-] (92324) accepted ('10.222.0.11', 57536) {{(pid=92324) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:45:10.766211 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-16b9e4d7-c42c-47fc-b67f-65cdd601eb6d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group, before_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:10.796392 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-16b9e4d7-c42c-47fc-b67f-65cdd601eb6d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:10.953099 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-16b9e4d7-c42c-47fc-b67f-65cdd601eb6d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:10.956982 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-2cade4dc-8e8c-45b4-a860-c362cbab147c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:45:10.972388 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16b9e4d7-c42c-47fc-b67f-65cdd601eb6d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe784a5d-57d4-414f-8feb-b263c44efaf6,revision_number=None']} {{(pid=92324) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:45:10.975696 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG oslo_concurrency.lockutils [None req-16b9e4d7-c42c-47fc-b67f-65cdd601eb6d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:45:11.041980 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron_lib.callbacks.manager [None req-16b9e4d7-c42c-47fc-b67f-65cdd601eb6d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Notify callbacks [] for security_group, before_response {{(pid=92324) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:11.043165 dv-cinder-787262-5-iscsi neutron-server[92324]: INFO neutron.wsgi [None req-16b9e4d7-c42c-47fc-b67f-65cdd601eb6d tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] 10.222.0.11 "DELETE /v2.0/security-groups/fe784a5d-57d4-414f-8feb-b263c44efaf6 HTTP/1.1" status: 204  len: 168 time: 0.3463414
Jun 03 08:45:11.158830 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 57540) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:45:11.839979 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bb780261-ef82-47e3-9fd7-cae650e61508 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-16328733'] for router_interface, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:12.372778 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-bb780261-ef82-47e3-9fd7-cae650e61508 admin admin] Deleting port 1b247c7f-4ca7-44d5-97b2-94031de25c6e {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:45:12.373491 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bb780261-ef82-47e3-9fd7-cae650e61508 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:12.491840 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [None req-bb780261-ef82-47e3-9fd7-cae650e61508 admin admin] For port 1b247c7f-4ca7-44d5-97b2-94031de25c6e, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=1b247c7f-4ca7-44d5-97b2-94031de25c6e,segment=NetworkSegment(fd0545c3-e436-4d2f-9d2d-71983702d34f),segment_id=fd0545c3-e436-4d2f-9d2d-71983702d34f)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:45:12.492135 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bb780261-ef82-47e3-9fd7-cae650e61508 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:12.619008 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-bb780261-ef82-47e3-9fd7-cae650e61508 admin admin] Calling delete_port for 1b247c7f-4ca7-44d5-97b2-94031de25c6e owned by network:router_interface {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:45:12.834041 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bb780261-ef82-47e3-9fd7-cae650e61508 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:12.837810 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-43c377a0-484f-428d-b90e-da8d9225aa74 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:45:12.880926 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb780261-ef82-47e3-9fd7-cae650e61508 admin admin] Pushing event deleted for resources: {'Port': ['ID=1b247c7f-4ca7-44d5-97b2-94031de25c6e,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:45:12.884146 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-bb780261-ef82-47e3-9fd7-cae650e61508 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:45:13.147462 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bb780261-ef82-47e3-9fd7-cae650e61508 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-16344783', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-16328833'] for router_interface, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:13.494641 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bb780261-ef82-47e3-9fd7-cae650e61508 admin admin] Router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:45:13.663467 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bb780261-ef82-47e3-9fd7-cae650e61508 admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:45:13.672371 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4226bcf2-bb9c-45df-b04b-dc4498b0e961 None None] Sync routers for ids ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'] in dv-cinder-787262-5-iscsi {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:45:13.678348 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-bb780261-ef82-47e3-9fd7-cae650e61508 admin admin] 10.222.0.11 "PUT /v2.0/routers/8d6b2faf-68a8-4edd-91ad-352b92d8cf84/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.5155742
Jun 03 08:45:13.678609 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 57544) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:45:13.682053 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4226bcf2-bb9c-45df-b04b-dc4498b0e961 None None] Routers {'8d6b2faf-68a8-4edd-91ad-352b92d8cf84'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:45:13.682698 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-4226bcf2-bb9c-45df-b04b-dc4498b0e961 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae870c4a30>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:45:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:45:13.907392 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-4226bcf2-bb9c-45df-b04b-dc4498b0e961 None None] Set router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:45:13.964155 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4e66480e-ad58-4af5-938d-8306c82dc3e3 admin admin] Notify callbacks [] for router, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:14.138099 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4e66480e-ad58-4af5-938d-8306c82dc3e3 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:14.197840 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-4226bcf2-bb9c-45df-b04b-dc4498b0e961 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae870c4a30>, [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121'}], 'enable_snat': True}, 'gw_port_id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:45:12Z', 'revision_number': 5, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port': {'id': 'a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:ff:49:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:48Z', 'updated_at': '2021-06-03T08:37:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:45:14.201584 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4226bcf2-bb9c-45df-b04b-dc4498b0e961 None None] Checking router: 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 for host: dv-cinder-787262-5-iscsi {{(pid=92325) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:45:14.210007 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4226bcf2-bb9c-45df-b04b-dc4498b0e961 None None] Routers {'8d6b2faf-68a8-4edd-91ad-352b92d8cf84'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92325) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:45:14.210649 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-4226bcf2-bb9c-45df-b04b-dc4498b0e961 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae870c4a30>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:45:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'], 'active': True} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:45:14.270418 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-4e66480e-ad58-4af5-938d-8306c82dc3e3 admin admin] Deleting port a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:45:14.270787 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4e66480e-ad58-4af5-938d-8306c82dc3e3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:14.361221 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvr_db [None req-4226bcf2-bb9c-45df-b04b-dc4498b0e961 None None] Set router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 gateway port host: None {{(pid=92325) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:45:14.391798 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [None req-4e66480e-ad58-4af5-938d-8306c82dc3e3 admin admin] For port a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:45:14.392181 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4e66480e-ad58-4af5-938d-8306c82dc3e3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:14.467577 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_hamode_db [None req-4226bcf2-bb9c-45df-b04b-dc4498b0e961 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae870c4a30>, [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:45:14Z', 'revision_number': 6, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port_host': None}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92325) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:45:14.471439 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4226bcf2-bb9c-45df-b04b-dc4498b0e961 None None] The sync data for ids ['8d6b2faf-68a8-4edd-91ad-352b92d8cf84'] in dv-cinder-787262-5-iscsi is: [{'id': '8d6b2faf-68a8-4edd-91ad-352b92d8cf84', 'name': 'tempest-TestVolumeBootPattern-1897754947-router', 'tenant_id': 'db653c0bf0ab42639863b4ea2268a265', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:47Z', 'updated_at': '2021-06-03T08:45:14Z', 'revision_number': 6, 'project_id': 'db653c0bf0ab42639863b4ea2268a265', 'gw_port_host': None}] {{(pid=92325) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:45:14.518983 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-4e66480e-ad58-4af5-938d-8306c82dc3e3 admin admin] Calling delete_port for a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36 owned by network:router_gateway {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:45:14.727809 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4e66480e-ad58-4af5-938d-8306c82dc3e3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:14.731637 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-9ed86300-7131-4db6-8e1f-baf2f671840e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:45:14.774745 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e66480e-ad58-4af5-938d-8306c82dc3e3 admin admin] Pushing event deleted for resources: {'Port': ['ID=a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:45:14.778579 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-4e66480e-ad58-4af5-938d-8306c82dc3e3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:45:14.875810 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4e66480e-ad58-4af5-938d-8306c82dc3e3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-16327738'] for router_gateway, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:15.048343 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4e66480e-ad58-4af5-938d-8306c82dc3e3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-16388336', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2351'] for router, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:15.050520 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4e66480e-ad58-4af5-938d-8306c82dc3e3 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:15.122505 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4e66480e-ad58-4af5-938d-8306c82dc3e3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-16388448'] for router, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:15.123050 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4e66480e-ad58-4af5-938d-8306c82dc3e3 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 8d6b2faf-68a8-4edd-91ad-352b92d8cf84 {{(pid=92323) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 03 08:45:15.135806 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4e66480e-ad58-4af5-938d-8306c82dc3e3 admin admin] Notify callbacks [] for router, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:15.136920 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-4e66480e-ad58-4af5-938d-8306c82dc3e3 admin admin] 10.222.0.11 "DELETE /v2.0/routers/8d6b2faf-68a8-4edd-91ad-352b92d8cf84 HTTP/1.1" status: 204  len: 168 time: 1.4574172
Jun 03 08:45:15.139351 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 57546) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:45:15.200527 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_v2 [None req-8c07f379-2040-43f4-9e77-c5a35d1c73e9 admin admin] Deleting subnet 3eb5b6e1-724c-48ab-a49b-2b1fa5adb401 {{(pid=92323) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 03 08:45:15.202587 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8c07f379-2040-43f4-9e77-c5a35d1c73e9 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:15.229540 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 1b247c7f-4ca7-44d5-97b2-94031de25c6e no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:45:15.263064 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8c07f379-2040-43f4-9e77-c5a35d1c73e9 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14518184'] for subnet, precommit_delete_associations {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:15.266154 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: 1b247c7f-4ca7-44d5-97b2-94031de25c6e {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:45:15.270205 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 1b247c7f-4ca7-44d5-97b2-94031de25c6e not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:45:15.353364 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8c07f379-2040-43f4-9e77-c5a35d1c73e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-862421'] for subnet, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:15.810692 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8c07f379-2040-43f4-9e77-c5a35d1c73e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-862434', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14211216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14857862'] for subnet, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:15.814626 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:45:15.847057 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c07f379-2040-43f4-9e77-c5a35d1c73e9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3eb5b6e1-724c-48ab-a49b-2b1fa5adb401,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:45:15.850745 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-8c07f379-2040-43f4-9e77-c5a35d1c73e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:45:15.853401 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8c07f379-2040-43f4-9e77-c5a35d1c73e9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:15.859026 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6cc88221-6684-4bb9-be62-0de9008ff4fc None None] Network 7722e8fc-e6a8-422f-8456-a3c594da293a requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:45:15.860110 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-8c07f379-2040-43f4-9e77-c5a35d1c73e9 admin admin] 10.222.0.11 "DELETE /v2.0/subnets/3eb5b6e1-724c-48ab-a49b-2b1fa5adb401 HTTP/1.1" status: 204  len: 168 time: 0.7198174
Jun 03 08:45:15.862694 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 57548) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:45:15.976039 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-529010'] for network, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:16.051923 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] Deleting port e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:45:16.052269 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:16.116085 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d2f39d59-c451-4f53-b9b7-fc27ed53d57c None None] DHCP port deletion for 7722e8fc-e6a8-422f-8456-a3c594da293a request from dv-cinder-787262-5-iscsi {{(pid=92325) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 03 08:45:16.158852 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] For port e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5,segment=NetworkSegment(fd0545c3-e436-4d2f-9d2d-71983702d34f),segment_id=fd0545c3-e436-4d2f-9d2d-71983702d34f)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:45:16.159234 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:16.180810 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-d2f39d59-c451-4f53-b9b7-fc27ed53d57c None None] Deleting port e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5 {{(pid=92325) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:45:16.181194 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-d2f39d59-c451-4f53-b9b7-fc27ed53d57c None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:16.279964 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-d2f39d59-c451-4f53-b9b7-fc27ed53d57c None None] For port e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5,segment=NetworkSegment(fd0545c3-e436-4d2f-9d2d-71983702d34f),segment_id=fd0545c3-e436-4d2f-9d2d-71983702d34f)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:45:16.280688 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-d2f39d59-c451-4f53-b9b7-fc27ed53d57c None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:16.282635 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] Calling delete_port for e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5 owned by network:dhcp {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:45:16.400957 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-d2f39d59-c451-4f53-b9b7-fc27ed53d57c None None] Calling delete_port for e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5 owned by network:dhcp {{(pid=92325) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:45:16.462167 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:16.467077 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-bb780261-ef82-47e3-9fd7-cae650e61508 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:45:16.467521 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-d2f39d59-c451-4f53-b9b7-fc27ed53d57c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151'] for port, after_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:16.471151 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:45:16.512434 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] No DVR routers for this DVR port e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5 on host dv-cinder-787262-5-iscsi {{(pid=92323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:45:16.514160 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] Pushing event deleted for resources: {'Port': ['ID=e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:45:16.543855 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:45:16.563718 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2f39d59-c451-4f53-b9b7-fc27ed53d57c None None] Pushing event deleted for resources: {'Port': ['ID=e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5,revision_number=None']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:45:16.569108 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2f39d59-c451-4f53-b9b7-fc27ed53d57c None None] No DVR routers for this DVR port e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5 on host dv-cinder-787262-5-iscsi {{(pid=92325) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:45:16.575263 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f39d59-c451-4f53-b9b7-fc27ed53d57c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:45:16.575621 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f39d59-c451-4f53-b9b7-fc27ed53d57c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:45:16.579312 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f39d59-c451-4f53-b9b7-fc27ed53d57c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:45:16.579312 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f39d59-c451-4f53-b9b7-fc27ed53d57c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:45:16.579312 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f39d59-c451-4f53-b9b7-fc27ed53d57c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:45:16.579312 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f39d59-c451-4f53-b9b7-fc27ed53d57c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:45:16.579312 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f39d59-c451-4f53-b9b7-fc27ed53d57c None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:45:16.579312 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f39d59-c451-4f53-b9b7-fc27ed53d57c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:45:16.579312 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f39d59-c451-4f53-b9b7-fc27ed53d57c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:45:16.579312 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f39d59-c451-4f53-b9b7-fc27ed53d57c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:45:16.579312 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f39d59-c451-4f53-b9b7-fc27ed53d57c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:45:16.579312 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f39d59-c451-4f53-b9b7-fc27ed53d57c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-5-iscsi {{(pid=92325) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 03 08:45:16.587113 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-d2f39d59-c451-4f53-b9b7-fc27ed53d57c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:45:16.597127 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5 no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:45:16.631497 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:45:16.631848 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device e5c34a77-d8ec-4a4c-b6d5-0cbe3c4964c5 not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:45:16.632268 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36 no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:45:16.644786 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-862046', 'neutron.services.segments.db._delete_segments_for_network-8774224358894'] for network, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:16.661406 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fae86bc0670>,) {'filters': {'network_id': ['7722e8fc-e6a8-422f-8456-a3c594da293a']}} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:45:16.664304 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:45:16.664663 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device a4668a64-1e9e-4d0f-bdcd-e7fbd79bed36 not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:45:16.674723 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fae86bc0670>, 'fd0545c3-e436-4d2f-9d2d-71983702d34f') {'for_net_delete': True} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:45:16.675022 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fae86bc0670>, 'fd0545c3-e436-4d2f-9d2d-71983702d34f') {} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:45:16.687213 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8774224362253', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14518195'] for segment, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:16.703402 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:16.709257 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] Releasing vlan 506 on physical network physnet1 to pool {{(pid=92323) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 03 08:45:16.709641 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14211322'] for segment, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]: Traceback (most recent call last):
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:     timer()
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:     cb(*args, **kw)
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:     return func(*args, **kwargs)
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:     self._notify()
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:     self.callback(batched_events)
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:     event.method(event)
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:     return f(self, *a, **k)
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self._get(url).json()
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self.request(url, 'GET', **kwargs)
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 03 08:45:16.722572 dv-cinder-787262-5-iscsi neutron-server[92323]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 03 08:45:16.893946 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-862039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16327709'] for network, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:16.897697 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:45:16.914822 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:16.927249 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] Pushing event deleted for resources: {'Network': ['ID=7722e8fc-e6a8-422f-8456-a3c594da293a,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:45:16.931390 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:45:16.985976 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-bde1492a-b91f-49c2-958a-2a1c86d52973 admin admin] 10.222.0.11 "DELETE /v2.0/networks/7722e8fc-e6a8-422f-8456-a3c594da293a HTTP/1.1" status: 204  len: 168 time: 1.1222999
Jun 03 08:45:16.989396 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 57550) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:45:17.624336 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d3d8ae30-c60e-4047-94be-d46faf6c599e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-16328733'] for router_interface, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:18.043464 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-d3d8ae30-c60e-4047-94be-d46faf6c599e admin admin] Deleting port fff590ab-c371-42b9-8c37-d90f872164d1 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:45:18.044163 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d3d8ae30-c60e-4047-94be-d46faf6c599e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:18.164251 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [None req-d3d8ae30-c60e-4047-94be-d46faf6c599e admin admin] For port fff590ab-c371-42b9-8c37-d90f872164d1, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=fff590ab-c371-42b9-8c37-d90f872164d1,segment=NetworkSegment(70d8683e-3f23-44dc-9902-dc5fa4f11976),segment_id=70d8683e-3f23-44dc-9902-dc5fa4f11976)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:45:18.164623 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d3d8ae30-c60e-4047-94be-d46faf6c599e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:18.303015 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-d3d8ae30-c60e-4047-94be-d46faf6c599e admin admin] Calling delete_port for fff590ab-c371-42b9-8c37-d90f872164d1 owned by network:router_interface {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:45:18.533714 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d3d8ae30-c60e-4047-94be-d46faf6c599e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:18.538340 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-668ba799-2344-4c55-8196-32a3172a89f6 tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:45:18.587491 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3d8ae30-c60e-4047-94be-d46faf6c599e admin admin] Pushing event deleted for resources: {'Port': ['ID=fff590ab-c371-42b9-8c37-d90f872164d1,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:45:18.625996 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-d3d8ae30-c60e-4047-94be-d46faf6c599e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:45:18.861127 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-d3d8ae30-c60e-4047-94be-d46faf6c599e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-16344783', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-16328833'] for router_interface, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:19.331510 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d3d8ae30-c60e-4047-94be-d46faf6c599e admin admin] Router d0b46164-c766-44a8-ab69-459f2a5ccff8 has already been hosted by L3 agent 458a021f-64ea-464e-8c5a-e46237e7d850 {{(pid=92323) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 03 08:45:19.506886 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d3d8ae30-c60e-4047-94be-d46faf6c599e admin admin] Notify agent at l3_agent.dv-cinder-787262-5-iscsi the message routers_updated {{(pid=92323) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 03 08:45:19.515048 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db40ee35-aec1-4b57-9869-5c32f144fdbf None None] Sync routers for ids ['d0b46164-c766-44a8-ab69-459f2a5ccff8'] in dv-cinder-787262-5-iscsi {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 03 08:45:19.524517 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db40ee35-aec1-4b57-9869-5c32f144fdbf None None] Routers {'d0b46164-c766-44a8-ab69-459f2a5ccff8'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:45:19.525123 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-db40ee35-aec1-4b57-9869-5c32f144fdbf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86d34c10>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:45:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['d0b46164-c766-44a8-ab69-459f2a5ccff8'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:45:19.606799 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-d3d8ae30-c60e-4047-94be-d46faf6c599e admin admin] 10.222.0.11 "PUT /v2.0/routers/d0b46164-c766-44a8-ab69-459f2a5ccff8/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6163139
Jun 03 08:45:19.609163 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 57552) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:45:19.697878 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-db40ee35-aec1-4b57-9869-5c32f144fdbf None None] Set router d0b46164-c766-44a8-ab69-459f2a5ccff8 gateway port host: dv-cinder-787262-5-iscsi {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:45:19.784926 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4b44bbee-21cc-43f1-88b7-0a172bb04f62 admin admin] Notify callbacks [] for router, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:19.956228 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4b44bbee-21cc-43f1-88b7-0a172bb04f62 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:19.970343 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-db40ee35-aec1-4b57-9869-5c32f144fdbf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86d34c10>, [{'id': 'd0b46164-c766-44a8-ab69-459f2a5ccff8', 'name': 'tempest-TestVolumeBootPattern-547033604-router', 'tenant_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'external_fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.120'}], 'enable_snat': True}, 'gw_port_id': 'be25e631-c897-43d4-a1a3-8e5bc9176a7d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:57Z', 'updated_at': '2021-06-03T08:45:18Z', 'revision_number': 5, 'project_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'gw_port': {'id': 'be25e631-c897-43d4-a1a3-8e5bc9176a7d', 'name': '', 'network_id': '684ef871-89aa-450d-ae0d-e232bfaf51fb', 'tenant_id': '', 'mac_address': 'fa:16:3e:25:a9:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0b46164-c766-44a8-ab69-459f2a5ccff8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 571, 'fixed_ips': [{'subnet_id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'ip_address': '172.27.0.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-03T08:37:58Z', 'updated_at': '2021-06-03T08:38:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e7b58fba-1ed5-483b-b341-7736b2ffb853', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-5-iscsi'}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:45:19.975206 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db40ee35-aec1-4b57-9869-5c32f144fdbf None None] Checking router: d0b46164-c766-44a8-ab69-459f2a5ccff8 for host: dv-cinder-787262-5-iscsi {{(pid=92326) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 03 08:45:19.983513 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db40ee35-aec1-4b57-9869-5c32f144fdbf None None] Routers {'d0b46164-c766-44a8-ab69-459f2a5ccff8'} bound to L3 agent in host dv-cinder-787262-5-iscsi {{(pid=92326) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 03 08:45:19.984115 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-db40ee35-aec1-4b57-9869-5c32f144fdbf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fae86d34c10>, 'dv-cinder-787262-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-03T08:22:35Z,description=<?>,heartbeat_timestamp=2021-06-03T08:45:05Z,host='dv-cinder-787262-5-iscsi',id=458a021f-64ea-464e-8c5a-e46237e7d850,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-03T08:22:35Z,topic='l3_agent')) {'router_ids': ['d0b46164-c766-44a8-ab69-459f2a5ccff8'], 'active': True} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:45:20.131447 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-4b44bbee-21cc-43f1-88b7-0a172bb04f62 admin admin] Deleting port be25e631-c897-43d4-a1a3-8e5bc9176a7d {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:45:20.131791 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4b44bbee-21cc-43f1-88b7-0a172bb04f62 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:20.238337 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_dvr_db [None req-db40ee35-aec1-4b57-9869-5c32f144fdbf None None] Set router d0b46164-c766-44a8-ab69-459f2a5ccff8 gateway port host: None {{(pid=92326) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 03 08:45:20.254243 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [None req-4b44bbee-21cc-43f1-88b7-0a172bb04f62 admin admin] For port be25e631-c897-43d4-a1a3-8e5bc9176a7d, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=be25e631-c897-43d4-a1a3-8e5bc9176a7d,segment=NetworkSegment(746be0df-b9f5-40e2-acc1-2d2d9b9e7d06),segment_id=746be0df-b9f5-40e2-acc1-2d2d9b9e7d06)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:45:20.254443 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4b44bbee-21cc-43f1-88b7-0a172bb04f62 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:20.352807 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.l3_hamode_db [None req-db40ee35-aec1-4b57-9869-5c32f144fdbf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fae86d34c10>, [{'id': 'd0b46164-c766-44a8-ab69-459f2a5ccff8', 'name': 'tempest-TestVolumeBootPattern-547033604-router', 'tenant_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:57Z', 'updated_at': '2021-06-03T08:45:19Z', 'revision_number': 6, 'project_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'gw_port_host': None}], 'dv-cinder-787262-5-iscsi', False) {} {{(pid=92326) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:45:20.359784 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db40ee35-aec1-4b57-9869-5c32f144fdbf None None] The sync data for ids ['d0b46164-c766-44a8-ab69-459f2a5ccff8'] in dv-cinder-787262-5-iscsi is: [{'id': 'd0b46164-c766-44a8-ab69-459f2a5ccff8', 'name': 'tempest-TestVolumeBootPattern-547033604-router', 'tenant_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-03T08:37:57Z', 'updated_at': '2021-06-03T08:45:19Z', 'revision_number': 6, 'project_id': 'b51f5fefb5f6423fa63fde3f8d7c6b71', 'gw_port_host': None}] {{(pid=92326) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 03 08:45:20.376308 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-4b44bbee-21cc-43f1-88b7-0a172bb04f62 admin admin] Calling delete_port for be25e631-c897-43d4-a1a3-8e5bc9176a7d owned by network:router_gateway {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:45:20.591044 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4b44bbee-21cc-43f1-88b7-0a172bb04f62 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:20.594684 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-c89e80db-0675-41a4-bde3-c2765e2d041b tempest-TestVolumeBootPattern-1223530461 tempest-TestVolumeBootPattern-1223530461-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:45:20.638464 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b44bbee-21cc-43f1-88b7-0a172bb04f62 admin admin] Pushing event deleted for resources: {'Port': ['ID=be25e631-c897-43d4-a1a3-8e5bc9176a7d,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:45:20.663372 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-4b44bbee-21cc-43f1-88b7-0a172bb04f62 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:45:20.842803 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4b44bbee-21cc-43f1-88b7-0a172bb04f62 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-16327738'] for router_gateway, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:21.010587 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4b44bbee-21cc-43f1-88b7-0a172bb04f62 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-16388336', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2351'] for router, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:21.012642 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4b44bbee-21cc-43f1-88b7-0a172bb04f62 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:21.104007 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device fff590ab-c371-42b9-8c37-d90f872164d1 no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:45:21.119143 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4b44bbee-21cc-43f1-88b7-0a172bb04f62 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-16388448'] for router, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:21.119761 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4b44bbee-21cc-43f1-88b7-0a172bb04f62 admin admin] Fanout notify agent at l3_agent the message router_deleted on router d0b46164-c766-44a8-ab69-459f2a5ccff8 {{(pid=92323) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 03 08:45:21.136861 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-4b44bbee-21cc-43f1-88b7-0a172bb04f62 admin admin] Notify callbacks [] for router, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:21.136861 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-4b44bbee-21cc-43f1-88b7-0a172bb04f62 admin admin] 10.222.0.11 "DELETE /v2.0/routers/d0b46164-c766-44a8-ab69-459f2a5ccff8 HTTP/1.1" status: 204  len: 168 time: 1.5241690
Jun 03 08:45:21.137092 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 57554) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:45:21.142387 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: fff590ab-c371-42b9-8c37-d90f872164d1 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:45:21.142793 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device fff590ab-c371-42b9-8c37-d90f872164d1 not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:45:21.199066 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.db_base_plugin_v2 [None req-8bf7afb7-8693-4b5a-ae71-a2ff0bca7d6f admin admin] Deleting subnet 6b0564e9-f803-4af7-9957-04aa3130c69c {{(pid=92323) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 03 08:45:21.202071 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8bf7afb7-8693-4b5a-ae71-a2ff0bca7d6f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:21.254108 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8bf7afb7-8693-4b5a-ae71-a2ff0bca7d6f admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14518184'] for subnet, precommit_delete_associations {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:21.334580 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8bf7afb7-8693-4b5a-ae71-a2ff0bca7d6f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-862421'] for subnet, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:21.656397 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8bf7afb7-8693-4b5a-ae71-a2ff0bca7d6f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-862434', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-338707', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14211216', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14857862'] for subnet, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:21.660243 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:45:21.695059 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bf7afb7-8693-4b5a-ae71-a2ff0bca7d6f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6b0564e9-f803-4af7-9957-04aa3130c69c,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:45:21.698702 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-8bf7afb7-8693-4b5a-ae71-a2ff0bca7d6f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for subnet, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:21.701121 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-8bf7afb7-8693-4b5a-ae71-a2ff0bca7d6f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:45:21.704767 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85813f27-2f16-481b-bcce-5ccca3e27245 None None] Network 2108ca94-1a9c-41e5-9409-225af0444c35 requested from dv-cinder-787262-5-iscsi {{(pid=92325) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 03 08:45:21.707085 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-8bf7afb7-8693-4b5a-ae71-a2ff0bca7d6f admin admin] 10.222.0.11 "DELETE /v2.0/subnets/6b0564e9-f803-4af7-9957-04aa3130c69c HTTP/1.1" status: 204  len: 168 time: 0.5689094
Jun 03 08:45:21.707757 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 57556) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:45:21.812346 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-529010'] for network, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:21.886845 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] Deleting port 8396de25-d3bc-4d29-80fd-33743e76bc92 {{(pid=92323) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:45:21.887191 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:21.949167 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc0e9a72-cf09-482e-b605-24d3034ff0db None None] DHCP port deletion for 2108ca94-1a9c-41e5-9409-225af0444c35 request from dv-cinder-787262-5-iscsi {{(pid=92325) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 03 08:45:21.985093 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.db [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] For port 8396de25-d3bc-4d29-80fd-33743e76bc92, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=8396de25-d3bc-4d29-80fd-33743e76bc92,segment=NetworkSegment(70d8683e-3f23-44dc-9902-dc5fa4f11976),segment_id=70d8683e-3f23-44dc-9902-dc5fa4f11976)] {{(pid=92323) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:45:21.985655 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:22.013285 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-fc0e9a72-cf09-482e-b605-24d3034ff0db None None] Deleting port 8396de25-d3bc-4d29-80fd-33743e76bc92 {{(pid=92325) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 03 08:45:22.013669 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-fc0e9a72-cf09-482e-b605-24d3034ff0db None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8774224322771'] for port, before_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:22.117929 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.db [None req-fc0e9a72-cf09-482e-b605-24d3034ff0db None None] For port 8396de25-d3bc-4d29-80fd-33743e76bc92, host dv-cinder-787262-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-5-iscsi',level=0,port_id=8396de25-d3bc-4d29-80fd-33743e76bc92,segment=NetworkSegment(70d8683e-3f23-44dc-9902-dc5fa4f11976),segment_id=70d8683e-3f23-44dc-9902-dc5fa4f11976)] {{(pid=92325) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 03 08:45:22.118640 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-fc0e9a72-cf09-482e-b605-24d3034ff0db None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-16327463'] for port, precommit_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:22.122664 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.plugin [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] Calling delete_port for 8396de25-d3bc-4d29-80fd-33743e76bc92 owned by network:dhcp {{(pid=92323) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:45:22.243770 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-fc0e9a72-cf09-482e-b605-24d3034ff0db None None] Calling delete_port for 8396de25-d3bc-4d29-80fd-33743e76bc92 owned by network:dhcp {{(pid=92325) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 03 08:45:22.250567 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14211271'] for port, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:22.255548 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-0c4ecf54-3398-4397-9bf1-3c80d21230ba service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:45:22.285884 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-fc0e9a72-cf09-482e-b605-24d3034ff0db None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-675999', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-365439', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-16344829', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8774224329521', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8774223842151'] for port, after_delete {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:22.290245 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:45:22.299351 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] No DVR routers for this DVR port 8396de25-d3bc-4d29-80fd-33743e76bc92 on host dv-cinder-787262-5-iscsi {{(pid=92323) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:45:22.301951 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] Pushing event deleted for resources: {'Port': ['ID=8396de25-d3bc-4d29-80fd-33743e76bc92,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:45:22.327485 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:45:22.333935 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc0e9a72-cf09-482e-b605-24d3034ff0db None None] Pushing event deleted for resources: {'Port': ['ID=8396de25-d3bc-4d29-80fd-33743e76bc92,revision_number=None']} {{(pid=92325) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:45:22.335794 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc0e9a72-cf09-482e-b605-24d3034ff0db None None] No DVR routers for this DVR port 8396de25-d3bc-4d29-80fd-33743e76bc92 on host dv-cinder-787262-5-iscsi {{(pid=92325) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 03 08:45:22.338185 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG oslo_concurrency.lockutils [None req-fc0e9a72-cf09-482e-b605-24d3034ff0db None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92325) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:45:22.421415 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-862046', 'neutron.services.segments.db._delete_segments_for_network-8774224358894'] for network, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:22.435136 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fae85d643d0>,) {'filters': {'network_id': ['2108ca94-1a9c-41e5-9409-225af0444c35']}} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:45:22.446738 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fae85d643d0>, '70d8683e-3f23-44dc-9902-dc5fa4f11976') {'for_net_delete': True} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:45:22.447029 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.services.segments.db [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fae85d643d0>, '70d8683e-3f23-44dc-9902-dc5fa4f11976') {} {{(pid=92323) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 03 08:45:22.458262 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8774224362253', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14518195'] for segment, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:22.474083 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605'] for segment, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:22.479978 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] Releasing vlan 528 on physical network physnet1 to pool {{(pid=92323) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 03 08:45:22.480352 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-658605', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14211322'] for segment, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]: Traceback (most recent call last):
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:     timer()
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:     cb(*args, **kw)
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:     return func(*args, **kwargs)
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:     self._notify()
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:     self.callback(batched_events)
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:     event.method(event)
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:     return f(self, *a, **k)
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self._get(url).json()
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:     return self.request(url, 'GET', **kwargs)
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 03 08:45:22.493435 dv-cinder-787262-5-iscsi neutron-server[92323]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 03 08:45:22.583793 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device be25e631-c897-43d4-a1a3-8e5bc9176a7d no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:45:22.623038 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: be25e631-c897-43d4-a1a3-8e5bc9176a7d {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:45:22.623311 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device be25e631-c897-43d4-a1a3-8e5bc9176a7d not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:45:22.623734 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 8396de25-d3bc-4d29-80fd-33743e76bc92 no longer exists at agent ovs-agent-dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 03 08:45:22.658807 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.plugin [None req-158451c6-6729-4259-9765-082b44ee0938 None None] No Port match for: 8396de25-d3bc-4d29-80fd-33743e76bc92 {{(pid=92325) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 03 08:45:22.659155 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron.plugins.ml2.rpc [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Device 8396de25-d3bc-4d29-80fd-33743e76bc92 not bound to the agent host dv-cinder-787262-5-iscsi {{(pid=92325) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 03 08:45:22.750674 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-862039', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-16375303', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-16344820', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-16327709'] for network, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:22.754593 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:45:22.767591 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-16344723'] for network, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:22.780387 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] Pushing event deleted for resources: {'Network': ['ID=2108ca94-1a9c-41e5-9409-225af0444c35,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:45:22.783878 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:45:22.794024 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-f40970f3-6bb1-4a14-9803-f908528875e7 admin admin] 10.222.0.11 "DELETE /v2.0/networks/2108ca94-1a9c-41e5-9409-225af0444c35 HTTP/1.1" status: 204  len: 168 time: 1.0771141
Jun 03 08:45:23.199430 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 57560) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:45:23.248366 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-e1071651-8c91-4c0b-820a-b74d1633fe3f admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=db653c0bf0ab42639863b4ea2268a265&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0477107
Jun 03 08:45:23.250655 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 57562) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:45:23.313618 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1bc881a2-ce26-4026-b02d-6081c03f8d80 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:23.339330 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1bc881a2-ce26-4026-b02d-6081c03f8d80 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:23.473223 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1bc881a2-ce26-4026-b02d-6081c03f8d80 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:23.476960 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-287644ac-1e02-40da-980d-35d2488ad64f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:45:23.489835 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bc881a2-ce26-4026-b02d-6081c03f8d80 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=110b3102-8777-4870-bec9-05faee9383a6,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:45:23.492299 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-1bc881a2-ce26-4026-b02d-6081c03f8d80 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:45:23.499266 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-1bc881a2-ce26-4026-b02d-6081c03f8d80 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:23.500377 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-1bc881a2-ce26-4026-b02d-6081c03f8d80 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/110b3102-8777-4870-bec9-05faee9383a6 HTTP/1.1" status: 204  len: 168 time: 0.2488437
Jun 03 08:45:24.181356 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 57568) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:45:24.229082 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-5834c7ff-b8d3-45a3-bc3d-031f139966da admin admin] 10.222.0.11 "GET /v2.0/security-groups?tenant_id=b51f5fefb5f6423fa63fde3f8d7c6b71&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0465443
Jun 03 08:45:24.231419 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [-] (92323) accepted ('10.222.0.11', 57570) {{(pid=92323) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 03 08:45:24.287548 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7e4687bd-9013-4862-9ee8-ad022362b814 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:24.316045 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7e4687bd-9013-4862-9ee8-ad022362b814 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:24.429425 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7e4687bd-9013-4862-9ee8-ad022362b814 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-16375394'] for security_group, after_delete {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:24.433229 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-1f95553c-bc6c-432f-8d8c-f9a25c044ad1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 03 08:45:24.444748 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e4687bd-9013-4862-9ee8-ad022362b814 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cd98479b-8e87-4fc9-9027-5357fe68b6c0,revision_number=None']} {{(pid=92323) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 03 08:45:24.448283 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG oslo_concurrency.lockutils [None req-7e4687bd-9013-4862-9ee8-ad022362b814 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 03 08:45:24.451456 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron_lib.callbacks.manager [None req-7e4687bd-9013-4862-9ee8-ad022362b814 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92323) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:24.454087 dv-cinder-787262-5-iscsi neutron-server[92323]: INFO neutron.wsgi [None req-7e4687bd-9013-4862-9ee8-ad022362b814 admin admin] 10.222.0.11 "DELETE /v2.0/security-groups/cd98479b-8e87-4fc9-9027-5357fe68b6c0 HTTP/1.1" status: 204  len: 168 time: 0.2217562
Jun 03 08:45:26.210870 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:32.545227 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-ec5be138-d998-4e02-80ac-a83b38723b7a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:34.825379 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:35.261852 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-46a736c1-67e7-486f-87dc-3dadf7e48f7f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:36.278590 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:36.320274 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:45:38.107781 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:45:56.265130 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:46:02.570103 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0b616a63-3698-47e4-8269-866b250d0411 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:46:04.870518 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:46:05.250067 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-617961e8-d634-48dc-9d08-f0c14f82a1e2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:46:06.255724 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:46:08.089598 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:46:13.319518 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:46:26.232901 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:46:32.524714 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-1897a792-2058-4b48-9b14-f93bf0f85240 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:46:34.850101 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:46:35.249982 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-92f55373-fec4-4b01-8c8b-1aa75af0ecd5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:46:36.282450 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:46:38.110415 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:46:50.318177 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:46:56.230523 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:47:02.561804 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-7a81348e-903a-4497-a9e3-8a827ac61b5d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:47:04.820789 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:47:05.235895 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4204e631-fe9f-436b-9680-f5159510704a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:47:06.277924 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:47:08.078128 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:47:26.282579 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:47:27.317392 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:47:32.506475 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-8d7bd546-5f78-4ad9-a06c-806e21fc3e14 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:47:34.871340 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:47:35.243413 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-4852d4cf-0f8f-4907-8d3e-ad486cd82bbe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:47:36.317609 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:47:38.089342 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:47:56.277353 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:48:02.540258 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-e2734496-d564-4028-a07d-84cb328fe068 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:48:04.317022 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:48:04.864613 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:48:05.294911 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-ebe885a0-e0e7-4d9f-9dce-3ad4829e3264 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:48:06.323303 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:48:08.134953 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:48:24.779610 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [req-6f42c112-71f5-42f2-89d1-35617d22a9cb req-9b6004a2-1ce9-4fdb-a43c-bd6270508ac4 service neutron] (92324) timed out ('10.222.0.55', 49911) {{(pid=92324) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
Jun 03 08:48:26.282894 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:48:32.550760 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-a4371a35-4d1b-43da-a698-562a71eeacbc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:48:34.825763 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:48:35.254759 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-98da546b-edd3-49c2-af14-706007ae3c66 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:48:36.281849 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:48:38.107021 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:48:41.315461 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:48:56.299968 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:49:02.528250 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-adf05cfe-f398-408c-818c-8b070afc867d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:49:04.808290 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:49:05.237377 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-08f625b5-e06b-4b9c-ba93-a56982227505 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:49:06.288799 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:49:08.088629 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:49:10.699952 dv-cinder-787262-5-iscsi neutron-server[92324]: DEBUG neutron.wsgi [req-744a500e-c907-416e-98d6-92ed4e17da82 req-42e0780c-7efe-4dd7-a443-dc03105b28e1 tempest-AttachVolumeNegativeTest-2018156224 tempest-AttachVolumeNegativeTest-2018156224-project] (92324) timed out ('10.222.0.55', 50120) {{(pid=92324) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
Jun 03 08:49:18.315356 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:49:26.351063 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:49:32.551183 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-5e776088-2fc9-4b98-ba63-6fca881d5fcd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:49:34.825170 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:49:35.282273 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-6f0840da-e521-40e6-9630-3737334d00df None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:49:36.282884 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:49:38.082353 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:49:49.702924 dv-cinder-787262-5-iscsi neutron-server[92323]: DEBUG neutron.wsgi [req-a11797a3-de94-4e68-9caf-b3335acdc9bb req-c84e7364-ed17-4d7a-affb-8ff177f88af3 service neutron] (92323) timed out ('10.222.0.55', 50117) {{(pid=92323) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
Jun 03 08:49:55.314731 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:49:56.276779 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:50:02.510798 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-1c1b0cda-5202-40e5-94d6-3dc7d39fb239 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:50:04.808407 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:50:05.230769 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-78252f01-e116-4a52-b3ab-1949defc5074 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:50:06.259411 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:50:08.104752 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:50:26.276162 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-0ddd9ec2-7132-4a0d-ac00-783e4a60dca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:50:32.313562 dv-cinder-787262-5-iscsi neutron-server[92326]: DEBUG neutron.db.agents_db [None req-aaa6484e-5a4f-4112-bc22-3d43c0a3adef None None] Agent healthcheck: found 6 active agents {{(pid=92326) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 03 08:50:32.533845 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-8307c0bc-5b8e-4946-8f59-abd67789c674 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:50:34.858953 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-158451c6-6729-4259-9765-082b44ee0938 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:50:35.253889 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-257298d4-d0a3-494e-92f8-5809a932da13 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:50:36.327768 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-670b5fa6-872c-447a-9b7e-2fab6039478e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 03 08:50:38.139092 dv-cinder-787262-5-iscsi neutron-server[92325]: DEBUG neutron_lib.callbacks.manager [None req-20ed3570-dc15-4939-bdee-76c505bc551e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8774224314534', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-858318'] for agent, after_update {{(pid=92325) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}